00000001:02000400:0.0F:1787338435.775622:0:2968:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg153-server.virtnet: executing set_hostid 00000001:02000400:0.0:1787338454.649384:0:3190:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg153-server.virtnet: executing load_modules_local 00000001:01000000:2.0F:1787338456.747202:0:3234:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 509 MB/s 00000001:01000000:3.0F:1787338456.997292:0:3234:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 647 MB/s 00000001:01000000:2.0:1787338457.247000:0:3234:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 4287 MB/s 00000020:02000000:2.0:1787338458.048197:0:3282:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_44_g85e5bce 00000400:02000000:3.0:1787338459.132973:0:3297:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.201.153@tcp [8/256/0/180] 00008000:02000000:2.0:1787338462.849570:0:3447:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:3.0:1787338510.802469:0:5251:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg153-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1787338522.232947:0:5819:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787338522.232954:0:5819:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1787338522.233651:0:5819:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000ae5aea26 00000080:02000400:0.0:1787338522.233662:0:5819:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:0.0:1787338522.242037:0:5819:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:0.0:1787338522.242055:0:5819:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1787338522.243360:0:5819:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000004dcb4bae) 00000020:00000080:1.0F:1787338522.245055:0:5819:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1787338522.269583:0:5819:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1787338522.269956:0:5819:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1787338522.290140:0:5819:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1787338522.290173:0:5819:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787338522.290190:0:5819:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1787338522.290233:0:5819:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787338522.290254:0:5819:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1787338522.290667:0:5819:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1787338522.290675:0:5819:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787338522.290684:0:5819:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x83671231080c10f1 00000020:01000004:2.0:1787338522.290692:0:5819:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1787338522.290697:0:5819:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1787338522.290701:0:5819:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000ae5aea26 from MGS 00000020:01000004:2.0:1787338522.290705:0:5819:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1787338522.291005:0:5819:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000005da7f2a4) 00000020:00000080:2.0:1787338522.291022:0:5819:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1787338522.291085:0:5819:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000ae5aea26 from MGS, refs=2 00080000:01000000:2.0:1787338522.291091:0:5819:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787338522.291096:0:5819:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x83671231080c10ff 00000100:00100000:2.0:1787338522.291202:0:5819:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1787338522.291330:0:5819:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1787338522.291336:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1787338522.292033:0:5819:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1787338522.292052:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1787338522.292857:0:5819:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787338522.293179:0:5819:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1787338522.293185:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1787338522.294024:0:5819:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1787338522.294032:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1787338522.294377:0:5819:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1787338522.294384:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1787338522.295223:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787338522.295226:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787338522.295228:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338522.295668:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338522.295672:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338522.295673:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787338522.296706:0:5819:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1787338522.302788:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:0.0:1787338522.546043:0:5819:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2991 MB/s 00000001:01000000:0.0:1787338522.796297:0:5819:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3311 MB/s 00000001:01000000:1.0:1787338523.046052:0:5819:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 351 MB/s 00000001:01000000:3.0:1787338523.296181:0:5819:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 519 MB/s 00010000:00010000:2.0:1787338523.319044:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:1.0:1787338523.342646:0:5819:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:1.0:1787338523.358375:0:5819:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1787338523.358393:0:5819:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787338523.358396:0:5819:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1787338523.359898:0:5830:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1787338523.360011:0:5819:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1787338523.360059:0:5819:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:1.0:1787338523.360300:0:5819:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1787338523.360327:0:5819:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1787338523.360657:0:5819:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787338523.361624:0:5819:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1787338523.361631:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1787338523.368186:0:5819:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1787338523.368201:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1787338523.373593:0:5819:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1787338523.373607:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:1.0:1787338523.375404:0:5835:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:0.0:1787338523.375425:0:5819:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1787338523.375457:0:5819:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.153@tcp' 00000020:01000004:0.0:1787338523.375459:0:5819:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1787338523.375506:0:5819:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.153@tcp (typ=mgc) 00000020:00000080:0.0:1787338523.375517:0:5819:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.153@tcp (000000004716849e) 00000020:00000080:0.0:1787338523.375533:0:5819:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1787338523.375643:0:5819:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000e7bb624e@MGC192.168.201.153@tcp: add connection 192.168.201.153@tcp at head 00010000:00010000:0.0:1787338523.375818:0:5819:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.153@tcp-0 is initialized 00000040:01000000:0.0:1787338523.375824:0:5819:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.153@tcp ctxt 1 is initialized 10000000:01000000:3.0:1787338523.376427:0:5836:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1787338523.377982:0:5819:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.153@tcp (uuid d79243c8-b367-45ff-8d76-fbaa4be8becb) 00000020:00000080:2.0:1787338523.378007:0:5819:0:(genops.c:1385:class_connect()) connect: client d79243c8-b367-45ff-8d76-fbaa4be8becb, cookie 0x83671231080c110d 00000100:00080000:2.0:1787338523.378019:0:5819:0:(import.c:510:import_select_connection()) MGC192.168.201.153@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787338523.378024:0:5819:0:(import.c:624:import_select_connection()) MGC192.168.201.153@tcp: import 00000000e7bb624e using connection 192.168.201.153@tcp/0@lo 00000100:00100000:2.0:1787338523.378066:0:5819:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000c4e5f68f x1874160211984512/t0(0) o250->MGC192.168.201.153@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787338523.378088:0:5819:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import d79243c8-b367-45ff-8d76-fbaa4be8becb->MGS 00000020:01000004:2.0:1787338523.378117:0:5819:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1787338523.378122:0:5819:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1787338523.378136:0:5819:0:(genops.c:413:class_newdev()) Allocate new device MDS (0000000023230358) 00000020:00000080:2.0:1787338523.378148:0:5819:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1787338523.378942:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c4e5f68f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d79243c8-b367-45ff-8d76-fbaa4be8becb:3313:1874160211984512:0@lo:250: 00000100:00100000:0.0:1787338523.379059:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338523.379154:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211984512 00000100:00100000:0.0:1787338523.379162:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211984512 00000100:00100000:0.0:1787338523.379193:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787338523.379199:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009e651d3a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3313:x1874160211984512:12345-0@lo:250: 00010000:00080000:0.0:1787338523.379223:0:5832:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from d79243c8-b367-45ff-8d76-fbaa4be8becb@0@lo t0 exp 0000000000000000 cur 176 last 0 00000020:00000080:0.0:1787338523.379258:0:5832:0:(genops.c:1385:class_connect()) connect: client d79243c8-b367-45ff-8d76-fbaa4be8becb, cookie 0x83671231080c111b 00000100:00080000:0.0:1787338523.379388:0:5832:0:(import.c:65:import_set_state_nolock()) 000000003afb4a31 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787338523.379439:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009e651d3a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+5:3313:x1874160211984512:12345-0@lo:250: Request processed in 238us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338523.379446:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787338523.380233:0:3313:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.201.153@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1787338523.380243:0:3313:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.153@tcp: connect to target with instance 0 00000100:00080000:0.0:1787338523.380251:0:3313:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.201.153@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1787338523.380255:0:3313:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1787338523.380258:0:3313:0:(import.c:65:import_set_state_nolock()) 00000000e7bb624e MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1787338523.380261:0:3313:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1787338523.380269:0:3313:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1787338523.380275:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c4e5f68f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d79243c8-b367-45ff-8d76-fbaa4be8becb:3313:1874160211984512:0@lo:250: 00000100:00100000:3.0:1787338523.408197:0:5819:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787338523.408424:0:5819:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1787338523.408431:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1787338523.409843:0:5819:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1787338523.409854:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1787338523.410443:0:5819:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1787338523.410460:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1787338523.411205:0:5819:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787338523.411394:0:5819:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1787338523.411400:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1787338523.414178:0:5819:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1787338523.414193:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1787338523.454860:0:5819:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787338523.455331:0:5819:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1787338523.455350:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1787338523.458902:0:5819:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1787338523.458919:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1787338523.459833:0:5819:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787338523.460299:0:5819:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787338523.460306:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1787338523.460870:0:5819:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787338523.461201:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1787338523.461805:0:5819:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787338523.462275:0:5819:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787338523.462281:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1787338523.463223:0:5819:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787338523.463316:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1787338523.464794:0:5819:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787338523.465411:0:5819:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787338523.465418:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1787338523.466479:0:5819:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787338523.466488:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1787338523.516086:0:5819:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787338523.516434:0:5819:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1787338523.516440:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1787338523.524802:0:5819:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1787338523.524820:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1787338523.526029:0:5819:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1787338523.526039:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1787338523.527980:0:5819:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1787338523.528005:0:5819:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1787338523.528011:0:5819:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.153@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1787338523.528363:0:5819:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.153@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787338523.528398:0:5819:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.153@tcp, index=0000, flags=0x20065 00000020:01000004:0.0:1787338523.528403:0:5819:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787338523.528404:0:5819:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787338523.528406:0:5819:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787338523.528407:0:5819:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787338523.528408:0:5819:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787338523.528409:0:5819:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787338523.528414:0:5819:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787338523.528415:0:5819:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787338523.528417:0:5819:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787338523.528418:0:5819:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787338523.528419:0:5819:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787338523.528420:0:5819:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787338523.528423:0:5819:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:0.0:1787338523.528425:0:5819:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787338523.528426:0:5819:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787338523.528427:0:5819:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787338523.528428:0:5819:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787338523.528428:0:5819:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787338523.528429:0:5819:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787338523.528430:0:5819:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787338523.528431:0:5819:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787338523.528432:0:5819:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787338523.528433:0:5819:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787338523.528434:0:5819:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787338523.528434:0:5819:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787338523.528476:0:5819:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1787338523.528493:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000332cc8ea pname:cluuid:pid:xid:nid:opc:job mount.lustre:d79243c8-b367-45ff-8d76-fbaa4be8becb:5819:1874160211984640:0@lo:253: 00000100:00100000:0.0:1787338523.528778:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338523.528917:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set 0000000027ea695b going to sleep for 11 seconds 00000100:00100000:2.0:1787338523.529076:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211984640 00000100:00100000:2.0:1787338523.529083:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211984640 00000100:00100000:2.0:1787338523.529225:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787338523.529234:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008e2a13d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+5:5819:x1874160211984640:12345-0@lo:253: 20000000:01000000:2.0:1787338523.529280:0:5834:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787338523.529283:0:5834:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:2.0:1787338523.529656:0:5855:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1787338523.529714:0:5834:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:3.0:1787338523.530016:0:5834:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787338523.530867:0:5856:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:2.0:1787338523.531301:0:5834:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787338523.531305:0:5834:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:2.0:1787338523.531310:0:5834:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:2.0:1787338523.531313:0:5834:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:2.0:1787338523.531328:0:5834:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:2.0:1787338523.531492:0:5834:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787338523.532408:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:3.0:1787338523.532425:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1787338523.532478:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:3.0:1787338523.532528:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:3.0:1787338523.532584:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:3.0:1787338523.532684:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:3.0:1787338523.532693:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:3.0:1787338523.532752:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:3.0:1787338523.532761:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:3.0:1787338523.532793:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:3.0:1787338523.532809:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:3.0:1787338523.532842:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:3.0:1787338523.533167:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:3.0:1787338523.533206:0:5834:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1787338523.533211:0:5834:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:3.0:1787338523.533223:0:5834:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787338523.533428:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:3.0:1787338523.533438:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1787338523.533471:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:3.0:1787338523.533507:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:3.0:1787338523.533570:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:3.0:1787338523.533582:0:5834:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:3.0:1787338523.533651:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:3.0:1787338523.533660:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1787338523.533702:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:3.0:1787338523.533739:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:3.0:1787338523.533774:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:3.0:1787338523.533785:0:5834:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:3.0:1787338523.534288:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:3.0:1787338523.534299:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:3.0:1787338523.534335:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:3.0:1787338523.534371:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:3.0:1787338523.534538:0:5834:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:3.0:1787338523.534588:0:5834:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1787338523.534595:0:5834:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:0.0:1787338523.535721:0:5857:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:3.0:1787338523.536264:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:3.0:1787338523.536287:0:5834:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.201.153@tcp for mdt 20000000:01000000:3.0:1787338523.536290:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.153@tcp (null) (null) (null) 00000040:00080000:3.0:1787338523.536324:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:3.0:1787338523.536331:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1787338523.536363:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:3.0:1787338523.536370:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.201.153@tcp (null) (null) 00000040:00080000:3.0:1787338523.536444:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:3.0:1787338523.536454:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1787338523.536487:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:3.0:1787338523.536858:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:3.0:1787338523.537074:0:5834:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1787338523.537078:0:5834:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1787338523.537084:0:5834:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1787338523.537091:0:5834:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1787338523.537625:0:5858:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:3.0:1787338523.537768:0:5834:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:3.0:1787338523.552088:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:3.0:1787338523.552257:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:3.0:1787338523.552368:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:3.0:1787338523.552389:0:5834:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1787338523.552391:0:5834:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1787338523.552394:0:5834:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1787338523.552418:0:5834:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787338523.552421:0:5834:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1787338523.552458:0:5834:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1787338523.552460:0:5834:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:0.0:1787338523.556372:0:5859:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:1.0:1787338523.556797:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:1.0:1787338523.556846:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:1.0:1787338523.556925:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:1.0:1787338523.556940:0:5834:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787338523.556942:0:5834:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1787338523.557585:0:5860:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:2.0:1787338523.557932:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:2.0:1787338523.557997:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:2.0:1787338523.558058:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 00000020:00000080:2.0:1787338523.558075:0:5834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787338523.558077:0:5834:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:2.0:1787338523.558085:0:5834:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787338523.558115:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000713286f3/0x83671231080c1122 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338523.558131:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000713286f3/0x83671231080c1122 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338523.558140:0:5834:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000713286f3/0x83671231080c1122 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338523.558146:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000713286f3/0x83671231080c1122 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338523.558151:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000713286f3/0x83671231080c1122 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338523.558166:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000713286f3/0x83671231080c1122 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338523.558172:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000713286f3 already unused, calling callback (00000000efedfb20) 00010000:00010000:2.0:1787338523.558175:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000713286f3/0x83671231080c1122 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338523.558181:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000713286f3/0x83671231080c1122 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338523.558193:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000713286f3/0x83671231080c1122 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338523.558199:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000713286f3/0x83671231080c1122 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338523.558204:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000713286f3/0x83671231080c1122 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787338523.558220:0:5834:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1787338523.846125:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008e2a13d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+5:5819:x1874160211984640:12345-0@lo:253: Request processed in 316885us (317340us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338523.846140:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787338523.846426:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000332cc8ea pname:cluuid:pid:xid:nid:opc:job mount.lustre:d79243c8-b367-45ff-8d76-fbaa4be8becb:5819:1874160211984640:0@lo:253: 10000000:01000000:1.0:1787338523.846442:0:5819:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1787338523.846445:0:5819:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787338523.846447:0:5819:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787338523.846448:0:5819:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787338523.846464:0:5819:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:1.0:1787338523.846465:0:5819:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787338523.846466:0:5819:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787338523.846467:0:5819:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787338523.846469:0:5819:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787338523.846470:0:5819:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1787338523.846471:0:5819:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787338523.846472:0:5819:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787338523.846490:0:5819:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000ae5aea26 from lustre-MDT0000 10000000:01000000:1.0:1787338523.846515:0:5819:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1787338523.846528:0:5819:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787338523.846532:0:5819:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff90bbde3e99b8 10000000:01000000:1.0:1787338523.846538:0:5819:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787338523.846546:0:5819:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff90bbde3e99b8 from 1 10000000:01000000:1.0:1787338523.846549:0:5819:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787338523.846597:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.153@tcp lock: 000000008867d8ad/0x83671231080c1129 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338523.846607:0:5819:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.153@tcp lock: 000000008867d8ad/0x83671231080c1129 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338523.846615:0:5819:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.153@tcp lock: 000000008867d8ad/0x83671231080c1129 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338523.846632:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d82fe209 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d79243c8-b367-45ff-8d76-fbaa4be8becb:5819:1874160211984768:0@lo:101: 00000100:00100000:1.0:1787338523.846688:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338523.846780:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set 00000000964fa67a going to sleep for 11 seconds 00000100:00100000:0.0:1787338523.847082:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211984768 00000100:00100000:0.0:1787338523.847099:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211984768 00000100:00100000:0.0:1787338523.847177:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787338523.847186:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fba086dc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+5:5819:x1874160211984768:12345-0@lo:101: 00010000:00010000:0.0:1787338523.847197:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787338523.847210:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000efba33dc/0x83671231080c1130 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x83671231080c1129 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338523.847239:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000efba33dc/0x83671231080c1130 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x83671231080c1129 expref: 6 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338523.847259:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000efba33dc/0x83671231080c1130 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c1129 expref: 6 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338523.847268:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000efba33dc, rc 0) 00000100:00100000:0.0:1787338523.847310:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fba086dc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+6:5819:x1874160211984768:12345-0@lo:101: Request processed in 126us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338523.847317:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787338523.847551:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d82fe209 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d79243c8-b367-45ff-8d76-fbaa4be8becb:5819:1874160211984768:0@lo:101: 00010000:00010000:1.0:1787338523.847565:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.153@tcp lock: 000000008867d8ad/0x83671231080c1129 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c1130 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338523.847574:0:5819:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.153@tcp lock: 000000008867d8ad/0x83671231080c1129 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x83671231080c1130 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338523.847635:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d82fe209 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d79243c8-b367-45ff-8d76-fbaa4be8becb:5819:1874160211984896:0@lo:501: 00000100:00100000:1.0:1787338523.847668:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338523.849079:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set 00000000964fa67a going to sleep for 11 seconds 00000100:00100000:2.0:1787338523.849234:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211984896 00000100:00100000:2.0:1787338523.849252:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211984896 00000100:00100000:2.0:1787338523.849294:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787338523.849304:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d04400cd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+6:5819:x1874160211984896:12345-0@lo:501: 00000100:00100000:2.0:1787338523.849609:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d04400cd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+6:5819:x1874160211984896:12345-0@lo:501: Request processed in 306us (1940us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787338523.849617:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787338523.849911:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d82fe209 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d79243c8-b367-45ff-8d76-fbaa4be8becb:5819:1874160211984896:0@lo:501: 10000000:01000000:1.0:1787338523.849965:0:5819:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.153@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787338523.849986:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: 000000008867d8ad/0x83671231080c1129 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c1130 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338523.849996:0:5819:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.153@tcp lock: 000000008867d8ad/0x83671231080c1129 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c1130 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787338523.850005:0:5819:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff90bbd0622000 10000000:01000000:1.0:1787338523.850010:0:5819:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787338523.850015:0:5819:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff90bbd0622000 10000000:01000000:1.0:1787338523.850017:0:5819:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1787338523.850020:0:5819:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff90bbd0622000 from 1 10000000:01000000:1.0:1787338523.850023:0:5819:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1787338523.850052:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.153@tcp lock: 00000000c84289fc/0x83671231080c1137 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338523.850059:0:5819:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.153@tcp lock: 00000000c84289fc/0x83671231080c1137 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338523.850068:0:5819:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.153@tcp lock: 00000000c84289fc/0x83671231080c1137 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338523.850085:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d82fe209 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d79243c8-b367-45ff-8d76-fbaa4be8becb:5819:1874160211985024:0@lo:101: 00000100:00100000:1.0:1787338523.850137:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338523.850152:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set 00000000964fa67a going to sleep for 11 seconds 00000100:00100000:2.0:1787338523.850330:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211985024 00000100:00100000:2.0:1787338523.850336:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211985024 00000100:00100000:2.0:1787338523.850428:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787338523.850434:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003225a5be pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+6:5819:x1874160211985024:12345-0@lo:101: 00010000:00010000:2.0:1787338523.850444:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787338523.850455:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000713286f3/0x83671231080c113e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x83671231080c1137 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338523.850474:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000713286f3/0x83671231080c113e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x83671231080c1137 expref: 7 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338523.850482:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000713286f3/0x83671231080c113e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c1137 expref: 7 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338523.850490:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000713286f3, rc 0) 00000100:00100000:2.0:1787338523.850589:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003225a5be pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+7:5819:x1874160211985024:12345-0@lo:101: Request processed in 155us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338523.850596:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787338523.850722:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d82fe209 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d79243c8-b367-45ff-8d76-fbaa4be8becb:5819:1874160211985024:0@lo:101: 00010000:00010000:1.0:1787338523.850734:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.153@tcp lock: 00000000c84289fc/0x83671231080c1137 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c113e expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338523.850741:0:5819:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.153@tcp lock: 00000000c84289fc/0x83671231080c1137 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x83671231080c113e expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787338523.850752:0:5819:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.153@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1787338523.850757:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: 00000000c84289fc/0x83671231080c1137 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c113e expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338523.850762:0:5819:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.153@tcp lock: 00000000c84289fc/0x83671231080c1137 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c113e expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787338523.850768:0:5819:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787338523.850772:0:5819:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787338523.850775:0:5819:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff90bbd0622000 10000000:01000000:1.0:1787338523.850778:0:5819:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1787338523.850780:0:5819:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1787338523.850782:0:5819:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787338523.850794:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.153@tcp lock: 0000000023f2dc57/0x83671231080c1145 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338523.850801:0:5819:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.153@tcp lock: 0000000023f2dc57/0x83671231080c1145 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338523.850807:0:5819:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.153@tcp lock: 0000000023f2dc57/0x83671231080c1145 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338523.850824:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d82fe209 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d79243c8-b367-45ff-8d76-fbaa4be8becb:5819:1874160211985152:0@lo:101: 00000100:00100000:1.0:1787338523.850849:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338523.850985:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set 00000000964fa67a going to sleep for 11 seconds 00000100:00100000:3.0:1787338523.851074:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211985152 00000100:00100000:3.0:1787338523.851079:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211985152 00000100:00100000:0.0:1787338523.851211:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787338523.851221:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a1290685 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+7:5819:x1874160211985152:12345-0@lo:101: 00010000:00010000:0.0:1787338523.851229:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787338523.851237:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000049f56791/0x83671231080c114c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x83671231080c1145 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338523.851323:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000049f56791/0x83671231080c114c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x83671231080c1145 expref: 8 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338523.851331:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000049f56791/0x83671231080c114c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c1145 expref: 8 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338523.851338:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000049f56791, rc 0) 00000100:00100000:0.0:1787338523.851482:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a1290685 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+8:5819:x1874160211985152:12345-0@lo:101: Request processed in 264us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338523.851488:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787338523.851675:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d82fe209 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d79243c8-b367-45ff-8d76-fbaa4be8becb:5819:1874160211985152:0@lo:101: 00010000:00010000:1.0:1787338523.851686:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.153@tcp lock: 0000000023f2dc57/0x83671231080c1145 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c114c expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338523.851693:0:5819:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.153@tcp lock: 0000000023f2dc57/0x83671231080c1145 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x83671231080c114c expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338523.851736:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d82fe209 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d79243c8-b367-45ff-8d76-fbaa4be8becb:5819:1874160211985280:0@lo:501: 00000100:00100000:1.0:1787338523.851763:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338523.851818:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set 00000000964fa67a going to sleep for 11 seconds 00000100:00100000:0.0:1787338523.851855:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211985280 00000100:00100000:0.0:1787338523.851867:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211985280 00000100:00100000:0.0:1787338523.852001:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787338523.852007:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006fb5d7dd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+8:5819:x1874160211985280:12345-0@lo:501: 00000100:00100000:0.0:1787338523.852362:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006fb5d7dd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+9:5819:x1874160211985280:12345-0@lo:501: Request processed in 354us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338523.852370:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787338523.852597:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d82fe209 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d79243c8-b367-45ff-8d76-fbaa4be8becb:5819:1874160211985280:0@lo:501: 00000100:00100000:1.0:1787338523.852627:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d82fe209 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d79243c8-b367-45ff-8d76-fbaa4be8becb:5819:1874160211985408:0@lo:503: 00000100:00100000:1.0:1787338523.852668:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338523.852750:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set 00000000964fa67a going to sleep for 11 seconds 00000100:00100000:0.0:1787338523.852790:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211985408 00000100:00100000:0.0:1787338523.852796:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211985408 00000100:00100000:0.0:1787338523.852825:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787338523.852831:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000072adb388 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+9:5819:x1874160211985408:12345-0@lo:503: 00000100:00100000:0.0:1787338523.853207:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000072adb388 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+9:5819:x1874160211985408:12345-0@lo:503: Request processed in 375us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338523.853214:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787338523.853500:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d82fe209 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d79243c8-b367-45ff-8d76-fbaa4be8becb:5819:1874160211985408:0@lo:503: 00000100:00100000:3.0:1787338523.854217:0:5862:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cec2abd9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d79243c8-b367-45ff-8d76-fbaa4be8becb:5862:1874160211985536:0@lo:502: 00000100:00100000:3.0:1787338523.854341:0:5862:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338523.854483:0:5862:0:(client.c:2715:ptlrpc_set_wait()) set 00000000838c277f going to sleep for 11 seconds 00000100:00100000:0.0:1787338523.854586:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211985536 00000100:00100000:0.0:1787338523.854593:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211985536 00000100:00100000:0.0:1787338523.854672:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787338523.854681:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000054d219a0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+9:5862:x1874160211985536:12345-0@lo:502: 00000100:00100000:0.0:1787338523.854936:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000054d219a0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+9:5862:x1874160211985536:12345-0@lo:502: Request processed in 255us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338523.854943:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787338523.855035:0:5862:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cec2abd9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d79243c8-b367-45ff-8d76-fbaa4be8becb:5862:1874160211985536:0@lo:502: 00000020:01000000:3.0:1787338523.855062:0:5862:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787338523.855074:0:5862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787338523.855076:0:5862:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1787338523.855081:0:5862:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1787338523.855100:0:5862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787338523.855122:0:5862:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000b22b54f7) 00000020:00000080:3.0:1787338523.855142:0:5862:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1787338523.855149:0:5862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1787338523.855276:0:5862:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:3.0:1787338523.855286:0:5862:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x83671231080c115a 00000020:00000080:3.0:1787338523.855534:0:5862:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1787338523.855539:0:5862:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787338523.855542:0:5862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787338523.855543:0:5862:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1787338523.855546:0:5862:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787338523.855549:0:5862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787338523.855550:0:5862:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1787338523.855553:0:5862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787338523.855560:0:5862:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000006abf7b81) 00000020:00000080:3.0:1787338523.855570:0:5862:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1787338523.855573:0:5862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1787338523.855575:0:5862:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1787338523.855577:0:5862:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1787338523.855583:0:5862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787338523.855631:0:5862:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000ae5aea26 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1787338523.855641:0:5862:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000515075f3) 00000020:00000080:3.0:1787338523.855648:0:5862:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1787338523.855696:0:5862:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1787338523.855701:0:5862:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x83671231080c116f 00000020:00000080:3.0:1787338523.855811:0:5862:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1787338523.855819:0:5862:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1787338523.855823:0:5862:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x83671231080c1176 00080000:01000000:3.0:1787338523.855829:0:5862:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:3.0:1787338523.855832:0:5862:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x83671231080c117d 00080000:10000000:3.0:1787338523.856238:0:5862:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:3.0:1787338523.856447:0:5862:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1787338523.864763:0:5862:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1787338523.956052:0:5862:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1787338523.957019:0:5862:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1787338523.961700:0:5862:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1787338523.962066:0:5862:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1787338523.992169:0:5862:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (0000000088d30642) 00000020:00000080:2.0:1787338523.992200:0:5862:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1787338523.993596:0:5862:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:2.0:1787338523.993608:0:5862:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x83671231080c118b 00000020:00000080:3.0:1787338523.998181:0:5862:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1787338524.000228:0:5862:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:3.0:1787338524.041086:0:5862:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1787338524.105848:0:5862:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1787338524.133015:0:5862:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:2.0:1787338524.194829:0:5862:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:2.0:1787338524.252497:0:5862:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:1.0:1787338524.294802:0:5862:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x83671231080c1192 00000020:00000080:1.0:1787338524.295219:0:5862:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1787338524.295230:0:5862:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787338524.295409:0:5862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787338524.295412:0:5862:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1787338524.295417:0:5862:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787338524.295422:0:5862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787338524.295430:0:5862:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1787338524.295435:0:5862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1787338524.295470:0:5862:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1787338524.295482:0:5862:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787338524.295485:0:5862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787338524.295486:0:5862:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1787338524.295488:0:5862:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787338524.295492:0:5862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787338524.295493:0:5862:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787338524.295496:0:5862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787338524.295497:0:5862:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1787338524.295556:0:5862:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d82fe209 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d79243c8-b367-45ff-8d76-fbaa4be8becb:5862:1874160211985664:0@lo:502: 00000100:00100000:1.0:1787338524.295649:0:5862:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338524.295718:0:5862:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bb098e83 going to sleep for 11 seconds 00000100:00100000:2.0:1787338524.295827:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211985664 00000100:00100000:2.0:1787338524.295841:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211985664 00000100:00100000:2.0:1787338524.295912:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787338524.295922:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e5861190 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+9:5862:x1874160211985664:12345-0@lo:502: 00000100:00100000:2.0:1787338524.296510:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e5861190 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+9:5862:x1874160211985664:12345-0@lo:502: Request processed in 588us (859us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338524.296520:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787338524.296686:0:5862:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d82fe209 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d79243c8-b367-45ff-8d76-fbaa4be8becb:5862:1874160211985664:0@lo:502: 00000020:01000000:1.0:1787338524.296718:0:5862:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787338524.296723:0:5862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787338524.296725:0:5862:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787338524.296729:0:5862:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:0.0:1787338524.296909:0:5819:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:0.0:1787338524.296929:0:5819:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.153@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787338524.296956:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: 0000000023f2dc57/0x83671231080c1145 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c114c expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338524.296967:0:5819:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.153@tcp lock: 0000000023f2dc57/0x83671231080c1145 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c114c expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787338524.296987:0:5819:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90bbd0622000 from 1 10000000:01000000:0.0:1787338524.296990:0:5819:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787338524.297018:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.153@tcp lock: 000000005a8a3f67/0x83671231080c1199 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338524.297024:0:5819:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.153@tcp lock: 000000005a8a3f67/0x83671231080c1199 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338524.297033:0:5819:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.153@tcp lock: 000000005a8a3f67/0x83671231080c1199 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338524.297048:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000002dd98c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d79243c8-b367-45ff-8d76-fbaa4be8becb:5819:1874160211985792:0@lo:101: 00000100:00100000:0.0:1787338524.297096:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338524.297128:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set 000000000be03ef2 going to sleep for 11 seconds 00000100:00100000:1.0:1787338524.297526:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211985792 00000100:00100000:1.0:1787338524.297534:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211985792 00000100:00100000:1.0:1787338524.297564:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787338524.297572:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f20ccace pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+9:5819:x1874160211985792:12345-0@lo:101: 00010000:00010000:1.0:1787338524.297583:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787338524.297596:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000cd1bcfeb/0x83671231080c11a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x83671231080c1199 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338524.297618:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000cd1bcfeb/0x83671231080c11a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x83671231080c1199 expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338524.297628:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000cd1bcfeb/0x83671231080c11a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c1199 expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338524.297644:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000cd1bcfeb, rc 0) 00000100:00100000:1.0:1787338524.297678:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f20ccace pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+10:5819:x1874160211985792:12345-0@lo:101: Request processed in 106us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338524.297684:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787338524.297860:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000002dd98c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d79243c8-b367-45ff-8d76-fbaa4be8becb:5819:1874160211985792:0@lo:101: 00010000:00010000:0.0:1787338524.297902:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.153@tcp lock: 000000005a8a3f67/0x83671231080c1199 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c11a0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338524.297910:0:5819:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.153@tcp lock: 000000005a8a3f67/0x83671231080c1199 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x83671231080c11a0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338524.298785:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000002dd98c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d79243c8-b367-45ff-8d76-fbaa4be8becb:5819:1874160211985920:0@lo:256: 00000100:00100000:0.0:1787338524.298830:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338524.298963:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set 000000000be03ef2 going to sleep for 11 seconds 00000100:00100000:2.0:1787338524.299308:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211985920 00000100:00100000:2.0:1787338524.299316:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211985920 00000100:00100000:2.0:1787338524.299464:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787338524.299473:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000f643ede pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+10:5819:x1874160211985920:12345-0@lo:256: 20000000:01000000:2.0:1787338524.299493:0:5833:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1787338524.299499:0:5833:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1787338524.299987:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000f643ede pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+10:5819:x1874160211985920:12345-0@lo:256: Request processed in 514us (1155us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338524.299996:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787338524.300094:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000002dd98c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d79243c8-b367-45ff-8d76-fbaa4be8becb:5819:1874160211985920:0@lo:256: 10000000:01000000:0.0:1787338524.300961:0:5819:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.153@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787338524.300977:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: 000000005a8a3f67/0x83671231080c1199 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c11a0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338524.300998:0:5819:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.153@tcp lock: 000000005a8a3f67/0x83671231080c1199 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c11a0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787338524.301006:0:5819:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90bbd0622000 from 1 10000000:01000000:0.0:1787338524.301008:0:5819:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787338524.301041:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.153@tcp lock: 00000000a207d33d/0x83671231080c11a7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338524.301047:0:5819:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.153@tcp lock: 00000000a207d33d/0x83671231080c11a7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338524.301056:0:5819:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.153@tcp lock: 00000000a207d33d/0x83671231080c11a7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338524.301073:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000002dd98c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d79243c8-b367-45ff-8d76-fbaa4be8becb:5819:1874160211986048:0@lo:101: 00000100:00100000:0.0:1787338524.301131:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338524.301977:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set 000000000be03ef2 going to sleep for 11 seconds 00000100:00100000:1.0:1787338524.302113:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211986048 00000100:00100000:1.0:1787338524.302124:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211986048 00000100:00100000:1.0:1787338524.302167:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787338524.302174:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000befa7ca4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+10:5819:x1874160211986048:12345-0@lo:101: 00010000:00010000:1.0:1787338524.302189:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787338524.302207:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000cfaba056/0x83671231080c11ae lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x83671231080c11a7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338524.302232:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000cfaba056/0x83671231080c11ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x83671231080c11a7 expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338524.302523:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000cfaba056/0x83671231080c11ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c11a7 expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338524.302531:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000cfaba056, rc 0) 00000100:00100000:1.0:1787338524.302589:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000befa7ca4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+11:5819:x1874160211986048:12345-0@lo:101: Request processed in 415us (1458us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338524.302596:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787338524.302713:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000002dd98c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d79243c8-b367-45ff-8d76-fbaa4be8becb:5819:1874160211986048:0@lo:101: 00010000:00010000:0.0:1787338524.302729:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.153@tcp lock: 00000000a207d33d/0x83671231080c11a7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c11ae expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338524.302737:0:5819:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.153@tcp lock: 00000000a207d33d/0x83671231080c11a7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x83671231080c11ae expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338524.302801:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000002dd98c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d79243c8-b367-45ff-8d76-fbaa4be8becb:5819:1874160211986176:0@lo:501: 00000100:00100000:0.0:1787338524.302832:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338524.302865:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set 000000000be03ef2 going to sleep for 11 seconds 00000100:00100000:1.0:1787338524.303039:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211986176 00000100:00100000:1.0:1787338524.303044:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211986176 00000100:00100000:1.0:1787338524.303064:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787338524.303070:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ecef0cf2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+11:5819:x1874160211986176:12345-0@lo:501: 00000100:00100000:1.0:1787338524.304010:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ecef0cf2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+11:5819:x1874160211986176:12345-0@lo:501: Request processed in 936us (1174us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338524.304027:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787338524.304275:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000002dd98c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d79243c8-b367-45ff-8d76-fbaa4be8becb:5819:1874160211986176:0@lo:501: 00000100:00100000:0.0:1787338524.304317:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000002dd98c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d79243c8-b367-45ff-8d76-fbaa4be8becb:5819:1874160211986304:0@lo:503: 00000100:00100000:0.0:1787338524.304481:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338524.304526:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set 000000000be03ef2 going to sleep for 11 seconds 00000100:00100000:1.0:1787338524.304672:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211986304 00000100:00100000:1.0:1787338524.304680:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211986304 00000100:00100000:1.0:1787338524.304707:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787338524.304714:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002971a01b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+11:5819:x1874160211986304:12345-0@lo:503: 00000040:00080000:1.0:1787338524.304758:0:5834:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787338524.304805:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002971a01b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+11:5819:x1874160211986304:12345-0@lo:503: Request processed in 92us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338524.304811:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787338524.304914:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000002dd98c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d79243c8-b367-45ff-8d76-fbaa4be8becb:5819:1874160211986304:0@lo:503: 00000040:00080000:0.0:1787338524.305922:0:5866:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:0.0:1787338524.305998:0:5819:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1787338524.306015:0:5819:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787338524.306033:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: 00000000a207d33d/0x83671231080c11a7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c11ae expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338524.306043:0:5819:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.153@tcp lock: 00000000a207d33d/0x83671231080c11a7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c11ae expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787338524.306504:0:5819:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787338524.306560:0:5819:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff90bbd0622000 10000000:01000000:0.0:1787338524.306563:0:5819:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff90bbd0622000 10000000:01000000:0.0:1787338524.306569:0:5819:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787338524.306577:0:5819:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90bbd0622000 from 1 10000000:01000000:0.0:1787338524.306604:0:5819:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787338524.306638:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.153@tcp lock: 000000006cc20cec/0x83671231080c11b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338524.306645:0:5819:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.153@tcp lock: 000000006cc20cec/0x83671231080c11b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338524.306654:0:5819:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.153@tcp lock: 000000006cc20cec/0x83671231080c11b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338524.306672:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000002dd98c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d79243c8-b367-45ff-8d76-fbaa4be8becb:5819:1874160211986432:0@lo:101: 00000100:00100000:0.0:1787338524.306736:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338524.306770:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set 0000000082c078ef going to sleep for 11 seconds 00000100:00100000:0.0:1787338524.306793:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211986432 00000100:00100000:0.0:1787338524.306799:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211986432 00000100:00100000:0.0:1787338524.306830:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787338524.306837:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a7fc3d1b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+11:5819:x1874160211986432:12345-0@lo:101: 00010000:00010000:0.0:1787338524.306849:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787338524.306861:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009518b918/0x83671231080c11bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x83671231080c11b5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338524.306904:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009518b918/0x83671231080c11bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x83671231080c11b5 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338524.306913:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009518b918/0x83671231080c11bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c11b5 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338524.306922:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009518b918, rc 0) 00000100:00100000:0.0:1787338524.306969:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a7fc3d1b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+12:5819:x1874160211986432:12345-0@lo:101: Request processed in 132us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338524.306975:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787338524.307019:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000002dd98c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d79243c8-b367-45ff-8d76-fbaa4be8becb:5819:1874160211986432:0@lo:101: 00010000:00010000:0.0:1787338524.307033:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.153@tcp lock: 000000006cc20cec/0x83671231080c11b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c11bc expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338524.307040:0:5819:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.153@tcp lock: 000000006cc20cec/0x83671231080c11b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x83671231080c11bc expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338524.307537:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000002dd98c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d79243c8-b367-45ff-8d76-fbaa4be8becb:5819:1874160211986560:0@lo:501: 00000100:00100000:0.0:1787338524.307582:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338524.307614:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set 0000000082c078ef going to sleep for 11 seconds 00000100:00100000:2.0:1787338524.307731:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211986560 00000100:00100000:2.0:1787338524.307738:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211986560 00000100:00100000:0.0:1787338524.307901:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787338524.307908:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000670a6c14 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+12:5819:x1874160211986560:12345-0@lo:501: 00000100:00100000:0.0:1787338524.308523:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000670a6c14 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+12:5819:x1874160211986560:12345-0@lo:501: Request processed in 614us (940us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338524.308532:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787338524.308659:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000002dd98c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d79243c8-b367-45ff-8d76-fbaa4be8becb:5819:1874160211986560:0@lo:501: 00000100:00100000:1.0:1787338524.308700:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d82fe209 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d79243c8-b367-45ff-8d76-fbaa4be8becb:5819:1874160211986688:0@lo:503: 00000100:00100000:1.0:1787338524.308741:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338524.308772:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set 0000000097b94324 going to sleep for 11 seconds 00000100:00100000:0.0:1787338524.308815:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211986688 00000100:00100000:0.0:1787338524.308821:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211986688 00000100:00100000:0.0:1787338524.308898:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787338524.308906:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000eb4e6094 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+12:5819:x1874160211986688:12345-0@lo:503: 00000100:00100000:2.0:1787338524.309351:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d82fe209 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d79243c8-b367-45ff-8d76-fbaa4be8becb:5819:1874160211986688:0@lo:503: 00000100:00100000:0.0:1787338524.309699:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000eb4e6094 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+12:5819:x1874160211986688:12345-0@lo:503: Request processed in 328us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338524.309708:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787338524.310331:0:5867:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000007fa7a44 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d79243c8-b367-45ff-8d76-fbaa4be8becb:5867:1874160211986816:0@lo:502: 00000100:00100000:0.0:1787338524.310452:0:5867:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338524.310529:0:5867:0:(client.c:2715:ptlrpc_set_wait()) set 000000000f63b605 going to sleep for 11 seconds 00000100:00100000:3.0:1787338524.310646:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211986816 00000100:00100000:3.0:1787338524.310653:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211986816 00000100:00100000:3.0:1787338524.310692:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787338524.310699:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002ffb97ab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+12:5867:x1874160211986816:12345-0@lo:502: 00000100:00100000:3.0:1787338524.310972:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002ffb97ab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+12:5867:x1874160211986816:12345-0@lo:502: Request processed in 272us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338524.310979:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787338524.311304:0:5867:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000007fa7a44 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d79243c8-b367-45ff-8d76-fbaa4be8becb:5867:1874160211986816:0@lo:502: 00000020:01000004:2.0:1787338524.311433:0:5867:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1787338524.311449:0:5867:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000a78fcb22) 00000020:00000080:2.0:1787338524.311471:0:5867:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:2.0:1787338524.311624:0:5867:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000ae5aea26 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787338524.311628:0:5867:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000ae5aea26 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787338524.311630:0:5867:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000ae5aea26 4 00010000:00080000:2.0:1787338524.311659:0:5867:0:(ldlm_lib.c:102:import_set_conn()) imp 000000002334e074@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.153@tcp at head 00010000:00010000:3.0:1787338524.314782:0:5867:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1787338524.315053:0:5867:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1787338524.315213:0:5867:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787338524.315228:0:5867:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x83671231080c11ca 00000100:00080000:3.0:1787338524.315305:0:5867:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787338524.315310:0:5867:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000002334e074 using connection 192.168.201.153@tcp/0@lo 00000100:00100000:3.0:1787338524.315417:0:5867:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000cec2abd9 x1874160211986944/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787338524.315442:0:5867:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787338524.315720:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cec2abd9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874160211986944:0@lo:38: 00000100:00100000:0.0:1787338524.315792:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338524.315957:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211986944 00000100:00100000:2.0:1787338524.315964:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211986944 00000100:00100000:2.0:1787338524.316009:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787338524.316015:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e50dc0ed pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3313:x1874160211986944:12345-0@lo:38: 00000100:00100000:2.0:1787338524.316071:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e50dc0ed pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3313:x1874160211986944:12345-0@lo:38: Request processed in 54us (278us total) trans 0 rc -11/-11 00000100:00100000:2.0:1787338524.316077:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787338524.316767:0:3313:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787338524.316776:0:3313:0:(import.c:65:import_set_state_nolock()) 000000002334e074 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787338524.316780:0:3313:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1787338524.316783:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cec2abd9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874160211986944:0@lo:38: 00000100:00100000:3.0:1787338524.316969:0:5867:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000aebeab99 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d79243c8-b367-45ff-8d76-fbaa4be8becb:5867:1874160211987072:0@lo:502: 00000100:00100000:3.0:1787338524.317024:0:5867:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338524.317049:0:5867:0:(client.c:2715:ptlrpc_set_wait()) set 000000008c370174 going to sleep for 11 seconds 00000100:00100000:2.0:1787338524.317462:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211987072 00000100:00100000:2.0:1787338524.317470:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211987072 00000100:00100000:2.0:1787338524.317588:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787338524.317597:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000536ca4ea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+12:5867:x1874160211987072:12345-0@lo:502: 00000100:00100000:2.0:1787338524.317826:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000536ca4ea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+12:5867:x1874160211987072:12345-0@lo:502: Request processed in 230us (801us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338524.317834:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787338524.318406:0:5867:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000aebeab99 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d79243c8-b367-45ff-8d76-fbaa4be8becb:5867:1874160211987072:0@lo:502: 00000040:00080000:3.0:1787338524.318442:0:5867:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:0.0:1787338524.318591:0:5819:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:0.0:1787338524.318611:0:5819:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787338524.318627:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: 000000006cc20cec/0x83671231080c11b5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c11bc expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338524.318647:0:5819:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.153@tcp lock: 000000006cc20cec/0x83671231080c11b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c11bc expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787338524.318688:0:5819:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787338524.318691:0:5819:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787338524.318692:0:5819:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787338524.318693:0:5819:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787338524.318695:0:5819:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787338524.318696:0:5819:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787338524.318698:0:5819:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787338524.318699:0:5819:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787338524.318700:0:5819:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787338524.318701:0:5819:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787338524.318703:0:5819:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787338524.318704:0:5819:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787338524.318708:0:5819:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1787338524.318711:0:5819:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787338524.318712:0:5819:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787338524.318713:0:5819:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787338524.318714:0:5819:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787338524.318716:0:5819:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787338524.318716:0:5819:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787338524.318717:0:5819:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787338524.318718:0:5819:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787338524.318719:0:5819:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787338524.318719:0:5819:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787338524.318720:0:5819:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787338524.318721:0:5819:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787338524.318739:0:5819:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1787338524.318750:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004ad23382 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d79243c8-b367-45ff-8d76-fbaa4be8becb:5819:1874160211987200:0@lo:253: 00000100:00100000:0.0:1787338524.318788:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338524.318816:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e3f0cfd1 going to sleep for 11 seconds 00000100:00100000:0.0:1787338524.319048:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211987200 00000100:00100000:0.0:1787338524.319053:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211987200 00000100:00100000:0.0:1787338524.319308:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787338524.319325:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000038b761a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+12:5819:x1874160211987200:12345-0@lo:253: 20000000:01000000:0.0:1787338524.319418:0:5833:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787338524.319432:0:5833:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00010000:2.0:1787338524.344968:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:01000000:0.0:1787338524.376991:0:5833:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787338524.377006:0:5833:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1787338524.377025:0:5855:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787338524.377029:0:5855:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787338524.377048:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000030ab811d/0x83671231080c11d1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338524.377066:0:5855:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000cd1bcfeb/0x83671231080c11a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c1199 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338524.377074:0:5855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000030ab811d/0x83671231080c11d1 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338524.377433:0:5855:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000cd1bcfeb/0x83671231080c11a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x83671231080c1199 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338524.377449:0:5855:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000cd1bcfeb/0x83671231080c11a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x83671231080c1199 expref: 12 pid: 5834 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338524.377463:0:5855:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e4b74889 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5855:1874160211987328:0@lo:104: 00000100:00100000:0.0:1787338524.377527:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338524.377586:0:5855:0:(client.c:2715:ptlrpc_set_wait()) set 00000000589cca29 going to sleep for 11 seconds 00000100:00100000:1.0:1787338524.378012:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211987328 00000100:00100000:1.0:1787338524.378020:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211987328 00000100:00100000:1.0:1787338524.378065:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787338524.378074:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000317f7845 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d79243c8-b367-45ff-8d76-fbaa4be8becb+3:5855:x1874160211987328:12345-0@lo:104: 00010000:00010000:1.0:1787338524.378209:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.153@tcp lock: 000000005a8a3f67/0x83671231080c1199 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x83671231080c11a0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338524.378415:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787338524.378422:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000317f7845 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d79243c8-b367-45ff-8d76-fbaa4be8becb+3:5855:x1874160211987328:12345-0@lo:104: Request processed in 350us (895us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338524.378429:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1787338524.378451:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787338524.378456:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.153@tcp lock: 000000005a8a3f67/0x83671231080c1199 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x83671231080c11a0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338524.378482:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000005a8a3f67 already unused, calling callback (00000000e5978148) 10000000:00010000:1.0:1787338524.378486:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.153@tcp lock: 000000005a8a3f67/0x83671231080c1199 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x83671231080c11a0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338524.378494:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.153@tcp lock: 000000005a8a3f67/0x83671231080c1199 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x83671231080c11a0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787338524.378500:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.153@tcp lock: 000000005a8a3f67/0x83671231080c1199 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x83671231080c11a0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787338524.378506:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787338524.378549:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.153@tcp lock: 000000005a8a3f67/0x83671231080c1199 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c11a0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338524.378555:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787338524.378575:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.153@tcp lock: 000000005a8a3f67/0x83671231080c1199 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c11a0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338524.378581:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.153@tcp lock: 000000005a8a3f67/0x83671231080c1199 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c11a0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338524.378599:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338524.378601:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338524.378602:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787338524.378654:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c73b3258 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d79243c8-b367-45ff-8d76-fbaa4be8becb:3315:1874160211987456:0@lo:103: 00000100:00100000:1.0:1787338524.378685:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338524.378731:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211987456 00000100:00100000:1.0:1787338524.378736:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211987456 00010000:00010000:1.0:1787338524.378752:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000cd1bcfeb/0x83671231080c11a0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x83671231080c1199 expref: 13 pid: 5834 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338524.378783:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787338524.378789:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a74aede1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d79243c8-b367-45ff-8d76-fbaa4be8becb+13:3315:x1874160211987456:12345-0@lo:103: 00010000:00010000:1.0:1787338524.378801:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787338524.378805:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000cd1bcfeb/0x83671231080c11a0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x83671231080c1199 expref: 13 pid: 5834 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338524.378814:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000cd1bcfeb/0x83671231080c11a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x83671231080c1199 expref: 13 pid: 5834 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338524.378829:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000030ab811d/0x83671231080c11d1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338524.378835:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000030ab811d/0x83671231080c11d1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787338524.378848:0:5823:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001819834s 00010000:00010000:1.0:1787338524.378851:0:5823:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000030ab811d/0x83671231080c11d1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338524.378857:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000030ab811d/0x83671231080c11d1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338524.378861:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000030ab811d/0x83671231080c11d1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338524.378866:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000030ab811d/0x83671231080c11d1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338524.378870:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000030ab811d already unused, calling callback (00000000efedfb20) 00010000:00010000:1.0:1787338524.378909:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000030ab811d/0x83671231080c11d1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338524.378922:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000030ab811d/0x83671231080c11d1 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338524.378930:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000030ab811d/0x83671231080c11d1 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338524.378939:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787338524.378978:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a74aede1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d79243c8-b367-45ff-8d76-fbaa4be8becb+13:3315:x1874160211987456:12345-0@lo:103: Request processed in 190us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338524.378985:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787338524.379027:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c73b3258 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d79243c8-b367-45ff-8d76-fbaa4be8becb:3315:1874160211987456:0@lo:103: 00010000:00010000:2.0:1787338524.379104:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000cd1bcfeb/0x83671231080c11a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x83671231080c1199 expref: 12 pid: 5834 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338524.379112:0:5855:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e4b74889 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5855:1874160211987328:0@lo:104: 00010000:00010000:2.0:1787338524.379123:0:5855:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000030ab811d/0x83671231080c11d1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338524.379128:0:5855:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000030ab811d/0x83671231080c11d1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338524.379132:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000030ab811d/0x83671231080c11d1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338524.379135:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000030ab811d/0x83671231080c11d1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338524.391607:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000038b761a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+11:5819:x1874160211987200:12345-0@lo:253: Request processed in 72276us (72811us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338524.391622:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787338524.391747:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004ad23382 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d79243c8-b367-45ff-8d76-fbaa4be8becb:5819:1874160211987200:0@lo:253: 10000000:01000000:0.0:1787338524.391763:0:5819:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1787338524.391767:0:5819:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787338524.391768:0:5819:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787338524.391770:0:5819:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787338524.391771:0:5819:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787338524.391782:0:5819:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787338524.391783:0:5819:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787338524.391784:0:5819:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787338524.391786:0:5819:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787338524.391787:0:5819:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787338524.391788:0:5819:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787338524.391789:0:5819:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787338524.391791:0:5819:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787338524.391805:0:5819:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1787338524.399868:0:5819:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1787338524.400669:0:5819:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1787338524.400915:0:5819:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1787338524.401398:0:5819:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1787338524.401684:0:5819:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1787338524.401854:0:5819:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1787338524.403972:0:5819:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1787338524.404463:0:5819:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1787338524.404747:0:5819:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1787338524.405059:0:5819:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1787338524.405608:0:5819:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1787338524.405798:0:5819:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:0.0:1787338524.462628:0:5819:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:2.0:1787338524.508237:0:5819:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1787338524.508684:0:5872:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:3.0:1787338524.508689:0:5872:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:2.0:1787338524.508744:0:5873:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1787338524.513793:0:5819:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1787338524.515017:0:5819:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1787338524.515754:0:5819:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1787338524.515767:0:5819:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1787338524.516019:0:5819:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787338524.518617:0:5819:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1787338524.519455:0:5819:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1787338524.519499:0:5819:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1787338524.519858:0:5819:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1787338524.520289:0:5819:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:0.0:1787338524.526701:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1787338524.526849:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1787338524.527046:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1787338524.527192:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1787338524.527637:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1787338524.527779:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1787338524.528001:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1787338524.528154:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1787338524.528324:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1787338524.528760:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1787338524.528963:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1787338524.529126:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1787338524.529299:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1787338524.532864:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1787338524.533108:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1787338524.533281:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1787338524.536039:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1787338524.536220:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1787338524.537978:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1787338524.539464:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1787338524.539708:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1787338524.539860:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1787338524.540444:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1787338524.540667:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1787338524.540834:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1787338524.543806:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1787338524.544059:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1787338524.548070:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1787338524.552044:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1787338524.557520:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1787338524.557795:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1787338524.557999:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1787338524.559894:0:5819:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:2.0:1787338524.592285:0:5873:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:3.0:1787338524.659467:0:5819:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1787338524.659534:0:5819:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa35141d9b988 00100000:10000000:3.0:1787338524.659542:0:5819:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1787338524.661328:0:5819:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787338524.661345:0:5819:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.153@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787338524.661357:0:5819:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1787338524.661415:0:5819:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:1.0:1787338524.735019:0:5873:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787338524.735366:0:5873:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1787338524.735372:0:5873:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:2.0:1787338525.366701:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338526.391168:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787338527.414677:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338528.446512:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787338529.417610:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1787338529.417621:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787338529.417624:0:37:0:(import.c:65:import_set_state_nolock()) 000000002334e074 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787338529.417637:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000002334e074 using connection 192.168.201.153@tcp/0@lo 00000100:00100000:1.0:1787338529.417659:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000093e30993 x1874160211987712/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787338529.417699:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000093e30993 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874160211987712:0@lo:38: 00000100:00100000:1.0:1787338529.417776:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338529.417989:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c73b3258 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d79243c8-b367-45ff-8d76-fbaa4be8becb:3316:1874160211987584:0@lo:400: 00000100:00100000:0.0:1787338529.418025:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338529.418102:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211987584 00000100:00100000:1.0:1787338529.418110:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211987584 00000100:00100000:1.0:1787338529.418163:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787338529.418172:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000035df02b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+11:3316:x1874160211987584:12345-0@lo:400: 00000100:00100000:1.0:1787338529.418225:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000035df02b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+11:3316:x1874160211987584:12345-0@lo:400: Request processed in 54us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338529.418233:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787338529.418281:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c73b3258 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d79243c8-b367-45ff-8d76-fbaa4be8becb:3316:1874160211987584:0@lo:400: 00000100:00100000:3.0:1787338529.420296:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211987712 00000100:00100000:3.0:1787338529.420310:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211987712 00000100:00100000:3.0:1787338529.420358:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787338529.420365:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c4681fcb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3313:x1874160211987712:12345-0@lo:38: 00010000:00080000:3.0:1787338529.420392:0:5841:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 182 last 0 00000020:00000080:3.0:1787338529.420428:0:5841:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x83671231080c11d8 00000004:00100000:3.0:1787338529.420476:0:5841:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787338529.420588:0:5841:0:(import.c:65:import_set_state_nolock()) 0000000029c0bc95 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787338529.420698:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c4681fcb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874160211987712:12345-0@lo:38: Request processed in 332us (2921us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338529.420705:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787338529.420853:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000093e30993 x1874160211987712/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787338539 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787338529.420943:0:3313:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1787338529.420950:0:3313:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1787338529.420954:0:3313:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787338529.420957:0:3313:0:(import.c:65:import_set_state_nolock()) 000000002334e074 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787338529.420962:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000093e30993 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874160211987712:0@lo:38: 00010000:00010000:2.0:1787338529.463041:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787338530.331607:0:6115:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg153-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787338530.486080:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787338531.520334:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787338531.958608:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787338531.958623:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90bbd0622000 from 3 10000000:01000000:0.0:1787338531.958629:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787338531.958692:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.153@tcp lock: 000000005a8a3f67/0x83671231080c11df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338531.958706:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.153@tcp lock: 000000005a8a3f67/0x83671231080c11df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338531.958719:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.153@tcp lock: 000000005a8a3f67/0x83671231080c11df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338531.958748:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004ad23382 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160211987840:0@lo:101: 00000100:00100000:0.0:1787338531.958846:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338531.959076:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211987840 00000100:00100000:1.0:1787338531.959308:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211987840 00000100:00100000:1.0:1787338531.962918:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787338531.962939:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c79b1417 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+11:5836:x1874160211987840:12345-0@lo:101: 00010000:00010000:1.0:1787338531.962961:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787338531.962983:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000cd1bcfeb/0x83671231080c11e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x83671231080c11df expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338531.963013:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000cd1bcfeb/0x83671231080c11e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x83671231080c11df expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338531.963024:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000cd1bcfeb/0x83671231080c11e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c11df expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338531.963033:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000cd1bcfeb, rc 0) 00000100:00100000:1.0:1787338531.968187:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c79b1417 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+12:5836:x1874160211987840:12345-0@lo:101: Request processed in 5246us (9332us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338531.968204:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787338531.977199:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set 000000004d3e214e going to sleep for 11 seconds 00000100:00100000:0.0:1787338531.977320:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004ad23382 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160211987840:0@lo:101: 00010000:00010000:0.0:1787338531.977361:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.153@tcp lock: 000000005a8a3f67/0x83671231080c11df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c11e6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338531.977373:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.153@tcp lock: 000000005a8a3f67/0x83671231080c11df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x83671231080c11e6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338531.977518:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004ad23382 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160211987968:0@lo:256: 00000100:00100000:0.0:1787338531.977581:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338531.978373:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set 000000004d3e214e going to sleep for 11 seconds 00000100:00100000:3.0:1787338531.982604:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211987968 00000100:00100000:3.0:1787338531.982625:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211987968 00000100:00100000:2.0:1787338531.986501:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787338531.986515:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000418d2008 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+12:5836:x1874160211987968:12345-0@lo:256: 20000000:01000000:2.0:1787338531.986545:0:5832:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787338531.986571:0:5832:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787338531.986574:0:5832:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1787338531.992042:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000418d2008 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+12:5836:x1874160211987968:12345-0@lo:256: Request processed in 5522us (14452us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338531.992057:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787338531.992131:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004ad23382 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160211987968:0@lo:256: 10000000:01000000:2.0:1787338531.992558:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.153@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787338531.992568:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: 000000005a8a3f67/0x83671231080c11df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c11e6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338531.992579:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.153@tcp lock: 000000005a8a3f67/0x83671231080c11df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c11e6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338532.534110:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787338533.558602:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787338534.523092:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787338534.523114:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c73b3258 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d79243c8-b367-45ff-8d76-fbaa4be8becb:3316:1874160211988096:0@lo:400: 00000100:00100000:1.0:1787338534.523210:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338534.523242:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787338534.523252:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003b7abe33 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874160211988224:0@lo:400: 00000100:00100000:1.0:1787338534.523267:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211988096 00000100:00100000:1.0:1787338534.523274:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211988096 00000100:00100000:0.0:1787338534.523282:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338534.523312:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787338534.523314:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211988224 00000100:00100000:0.0:1787338534.523317:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211988224 00000100:00100000:1.0:1787338534.523320:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ae53bf08 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+12:3316:x1874160211988096:12345-0@lo:400: 00000100:00100000:0.0:1787338534.523342:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787338534.523347:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b374a974 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874160211988224:12345-0@lo:400: 00000100:00100000:1.0:1787338534.523376:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ae53bf08 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+12:3316:x1874160211988096:12345-0@lo:400: Request processed in 57us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338534.523377:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b374a974 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874160211988224:12345-0@lo:400: Request processed in 29us (94us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338534.523383:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787338534.523383:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787338534.523417:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c73b3258 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d79243c8-b367-45ff-8d76-fbaa4be8becb:3316:1874160211988096:0@lo:400: 00010000:00080000:0.0:1787338534.523417:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000003b7abe33 x1874160211988224/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787338550 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787338534.523428:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003b7abe33 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874160211988224:0@lo:400: 00010000:00010000:1.0:1787338534.583442:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787338535.619544:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787338535.747443:0:6317:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffc22c9810 20000000:00000080:0.0:1787338535.747461:0:6317:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff90bbeb13fc00 uarg=0000000000000000 20000000:01000000:0.0:1787338535.747493:0:6317:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1787338535.747500:0:6317:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1787338535.747504:0:6317:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1787338535.747703:0:6317:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:0.0:1787338535.747717:0:6317:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:0.0:1787338535.755453:0:6317:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787338535.755719:0:6317:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1787338535.755786:0:6317:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:0.0:1787338535.755839:0:6317:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:0.0:1787338535.755859:0:6317:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787338535.756160:0:6317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000030ab811d/0x83671231080c11ed lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338535.756180:0:6317:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000cfaba056/0x83671231080c11ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c11a7 expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338535.756188:0:6317:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000030ab811d/0x83671231080c11ed lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338535.756287:0:6317:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000cfaba056/0x83671231080c11ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x83671231080c11a7 expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338535.756302:0:6317:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000cfaba056/0x83671231080c11ae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x83671231080c11a7 expref: 11 pid: 5834 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338535.756327:0:6317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c73b3258 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6317:1874160211988352:0@lo:104: 00000100:00100000:1.0:1787338535.756390:0:6317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338535.756440:0:6317:0:(client.c:2715:ptlrpc_set_wait()) set 000000004088a8e8 going to sleep for 11 seconds 00000100:00100000:0.0:1787338535.756551:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211988352 00000100:00100000:0.0:1787338535.756559:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211988352 00000100:00100000:0.0:1787338535.756609:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787338535.756618:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000063708aae pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d79243c8-b367-45ff-8d76-fbaa4be8becb+3:6317:x1874160211988352:12345-0@lo:104: 00010000:00010000:0.0:1787338535.756629:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.153@tcp lock: 00000000a207d33d/0x83671231080c11a7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x83671231080c11ae expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338535.756692:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787338535.756698:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000063708aae pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d79243c8-b367-45ff-8d76-fbaa4be8becb+3:6317:x1874160211988352:12345-0@lo:104: Request processed in 82us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338535.756705:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787338535.756793:0:6317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c73b3258 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6317:1874160211988352:0@lo:104: 00010000:00010000:3.0:1787338535.756812:0:6317:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000030ab811d/0x83671231080c11ed lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338535.756860:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787338535.756866:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.153@tcp lock: 00000000a207d33d/0x83671231080c11a7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x83671231080c11ae expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338535.757013:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000a207d33d already unused, calling callback (00000000e5978148) 10000000:00010000:1.0:1787338535.757017:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.153@tcp lock: 00000000a207d33d/0x83671231080c11a7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x83671231080c11ae expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338535.757025:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.153@tcp lock: 00000000a207d33d/0x83671231080c11a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x83671231080c11ae expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787338535.757040:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.153@tcp lock: 00000000a207d33d/0x83671231080c11a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x83671231080c11ae expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787338535.757046:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787338535.757079:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.153@tcp lock: 00000000a207d33d/0x83671231080c11a7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c11ae expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338535.757086:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787338535.757142:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a3d0c72c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d79243c8-b367-45ff-8d76-fbaa4be8becb:3315:1874160211988480:0@lo:103: 00000100:00100000:3.0:1787338535.757172:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787338535.757221:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.153@tcp lock: 00000000a207d33d/0x83671231080c11a7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c11ae expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338535.757228:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.153@tcp lock: 00000000a207d33d/0x83671231080c11a7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c11ae expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338535.757244:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338535.757246:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338535.757247:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787338535.757258:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211988480 00000100:00100000:1.0:1787338535.757262:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211988480 00010000:00010000:1.0:1787338535.757279:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000cfaba056/0x83671231080c11ae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x83671231080c11a7 expref: 12 pid: 5834 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338535.757302:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787338535.757309:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000aebeab99 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d79243c8-b367-45ff-8d76-fbaa4be8becb+12:3315:x1874160211988480:12345-0@lo:103: 00010000:00010000:1.0:1787338535.757480:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787338535.757485:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000cfaba056/0x83671231080c11ae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x83671231080c11a7 expref: 12 pid: 5834 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338535.757496:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000cfaba056/0x83671231080c11ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x83671231080c11a7 expref: 12 pid: 5834 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338535.757515:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000cfaba056/0x83671231080c11ae lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x83671231080c11a7 expref: 12 pid: 5834 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338535.757528:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000030ab811d/0x83671231080c11ed lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338535.757536:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000030ab811d/0x83671231080c11ed lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338535.757548:0:5823:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000030ab811d/0x83671231080c11ed lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338535.757554:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000030ab811d/0x83671231080c11ed lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338535.757560:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000030ab811d/0x83671231080c11ed lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338535.757565:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000030ab811d/0x83671231080c11ed lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338535.757570:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000030ab811d already unused, calling callback (00000000efedfb20) 00010000:00010000:1.0:1787338535.757573:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000030ab811d/0x83671231080c11ed lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338535.757579:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000030ab811d/0x83671231080c11ed lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338535.757601:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000030ab811d/0x83671231080c11ed lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338535.757621:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787338535.757669:0:6317:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000030ab811d/0x83671231080c11ed lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338535.757676:0:6317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000030ab811d/0x83671231080c11ed lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338535.757687:0:6317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000030ab811d/0x83671231080c11ed lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338535.760912:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000aebeab99 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d79243c8-b367-45ff-8d76-fbaa4be8becb+11:3315:x1874160211988480:12345-0@lo:103: Request processed in 3599us (3735us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338535.760927:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787338535.761244:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a3d0c72c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d79243c8-b367-45ff-8d76-fbaa4be8becb:3315:1874160211988480:0@lo:103: 00010000:00010000:3.0:1787338536.630580:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338537.655279:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338538.682020:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787338539.642264:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ca44cfb7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874160211988736:0@lo:400: 00000100:00100000:0.0:1787338539.642335:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338539.642389:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787338539.642394:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000677c2ec3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d79243c8-b367-45ff-8d76-fbaa4be8becb:3317:1874160211988608:0@lo:400: 00000100:00100000:0.0:1787338539.642425:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338539.642459:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211988736 00000100:00100000:0.0:1787338539.642466:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211988736 00000100:00100000:0.0:1787338539.642512:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787338539.642520:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a7333b51 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874160211988736:12345-0@lo:400: 00000100:00100000:0.0:1787338539.642570:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a7333b51 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874160211988736:12345-0@lo:400: Request processed in 51us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338539.642578:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787338539.642600:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211988608 00000100:00100000:0.0:1787338539.642603:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211988608 00000100:00100000:0.0:1787338539.642628:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787338539.642634:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b5fd67e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+11:3317:x1874160211988608:12345-0@lo:400: 00000100:00100000:0.0:1787338539.642663:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b5fd67e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+11:3317:x1874160211988608:12345-0@lo:400: Request processed in 29us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338539.642669:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787338539.642723:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000677c2ec3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d79243c8-b367-45ff-8d76-fbaa4be8becb:3317:1874160211988608:0@lo:400: 00010000:00080000:0.0:1787338539.642735:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000ca44cfb7 x1874160211988736/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787338555 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787338539.642760:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ca44cfb7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874160211988736:0@lo:400: 00010000:00010000:1.0:1787338539.703025:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787338539.766719:0:5836:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787338539.766728:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90bbd0622000 from 1 10000000:01000000:2.0:1787338539.766734:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787338539.766780:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.153@tcp lock: 000000009d841f67/0x83671231080c11f4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338539.766793:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.153@tcp lock: 000000009d841f67/0x83671231080c11f4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338539.766803:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.153@tcp lock: 000000009d841f67/0x83671231080c11f4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338539.766827:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000081765a5b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160211988864:0@lo:101: 00000100:00100000:2.0:1787338539.766917:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338539.766967:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set 000000007bb33d96 going to sleep for 11 seconds 00000100:00100000:2.0:1787338539.766988:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211988864 00000100:00100000:2.0:1787338539.766994:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211988864 00000100:00100000:2.0:1787338539.767040:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787338539.767048:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000062dc2904 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+11:5836:x1874160211988864:12345-0@lo:101: 00010000:00010000:2.0:1787338539.767060:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787338539.767083:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003a96cad7/0x83671231080c11fb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x83671231080c11f4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338539.767121:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003a96cad7/0x83671231080c11fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x83671231080c11f4 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338539.767131:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003a96cad7/0x83671231080c11fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c11f4 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338539.767150:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003a96cad7, rc 0) 00000100:00100000:2.0:1787338539.767188:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000062dc2904 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+12:5836:x1874160211988864:12345-0@lo:101: Request processed in 141us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338539.767196:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787338539.767253:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000081765a5b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160211988864:0@lo:101: 00010000:00010000:2.0:1787338539.767266:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.153@tcp lock: 000000009d841f67/0x83671231080c11f4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c11fb expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338539.767275:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.153@tcp lock: 000000009d841f67/0x83671231080c11f4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x83671231080c11fb expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338539.767327:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000081765a5b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160211988992:0@lo:501: 00000100:00100000:2.0:1787338539.767352:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338539.767367:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set 000000007bb33d96 going to sleep for 11 seconds 00000100:00100000:2.0:1787338539.767381:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211988992 00000100:00100000:2.0:1787338539.767384:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211988992 00000100:00100000:2.0:1787338539.767406:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787338539.767412:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d3963210 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+12:5836:x1874160211988992:12345-0@lo:501: 00000100:00100000:2.0:1787338539.767632:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d3963210 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+12:5836:x1874160211988992:12345-0@lo:501: Request processed in 220us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338539.767639:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787338539.767667:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000081765a5b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160211988992:0@lo:501: 00000100:00100000:2.0:1787338539.767723:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000081765a5b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160211989120:0@lo:503: 00000100:00100000:2.0:1787338539.767770:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338539.767782:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set 000000007bb33d96 going to sleep for 11 seconds 00000100:00100000:2.0:1787338539.767799:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211989120 00000100:00100000:2.0:1787338539.767803:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211989120 00000100:00100000:2.0:1787338539.767823:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787338539.767829:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004430ed18 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+12:5836:x1874160211989120:12345-0@lo:503: 00000100:00100000:2.0:1787338539.767961:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004430ed18 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+12:5836:x1874160211989120:12345-0@lo:503: Request processed in 132us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338539.767967:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787338539.767999:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000081765a5b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160211989120:0@lo:503: 00000100:00100000:3.0:1787338539.776571:0:6587:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008a3f4249 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d79243c8-b367-45ff-8d76-fbaa4be8becb:6587:1874160211989248:0@lo:502: 00000100:00100000:3.0:1787338539.776688:0:6587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338539.776737:0:6587:0:(client.c:2715:ptlrpc_set_wait()) set 000000002c38beb6 going to sleep for 11 seconds 00000100:00100000:2.0:1787338539.776788:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211989248 00000100:00100000:2.0:1787338539.776796:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211989248 00000100:00100000:2.0:1787338539.776848:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787338539.776859:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c2854d51 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+12:6587:x1874160211989248:12345-0@lo:502: 00000100:00100000:2.0:1787338539.777080:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c2854d51 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+12:6587:x1874160211989248:12345-0@lo:502: Request processed in 224us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338539.777089:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787338539.777145:0:6587:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008a3f4249 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d79243c8-b367-45ff-8d76-fbaa4be8becb:6587:1874160211989248:0@lo:502: 00000020:01000000:2.0:1787338539.777173:0:6587:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787338539.777183:0:6587:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787338539.777186:0:6587:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787338539.777193:0:6587:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90bbd0622000 00000020:00000080:2.0:1787338539.777194:0:6587:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787338539.777229:0:6587:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc91ddc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d79243c8-b367-45ff-8d76-fbaa4be8becb:6587:1874160211989376:0@lo:502: 00000100:00100000:2.0:1787338539.777258:0:6587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338539.777278:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211989376 00000100:00100000:2.0:1787338539.777282:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211989376 00000100:00100000:2.0:1787338539.777301:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787338539.777308:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4089850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+12:6587:x1874160211989376:12345-0@lo:502: 00000100:00100000:2.0:1787338539.777399:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4089850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+12:6587:x1874160211989376:12345-0@lo:502: Request processed in 90us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338539.777406:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787338539.777433:0:6587:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc954ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1787338539.777444:0:6587:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc91ddc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d79243c8-b367-45ff-8d76-fbaa4be8becb:6587:1874160211989376:0@lo:502: 00000020:01000000:2.0:1787338539.777462:0:6587:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787338539.777466:0:6587:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787338539.777468:0:6587:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1787338539.777471:0:6587:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1787338539.777520:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1787338539.777536:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787338539.777546:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bc021c9a00/0x83671231080c11f4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c11fb expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338539.777558:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.153@tcp lock: ffff90bc021c9a00/0x83671231080c11f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c11fb expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338540.729373:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787338541.675566:0:6686:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787338541.675572:0:6686:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1787338541.675722:0:6686:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff90bbc9632800 00000020:01000004:0.0:1787338541.675738:0:6686:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1787338541.675749:0:6686:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1787338541.675761:0:6686:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff90bbde3eb370) 00000020:00000080:0.0:1787338541.675776:0:6686:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787338541.689944:0:6686:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1787338541.690200:0:6686:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1787338541.708444:0:6686:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1787338541.713589:0:6686:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787338541.713630:0:6686:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1787338541.713845:0:6686:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787338541.713962:0:6686:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1787338541.714650:0:6686:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1787338541.714663:0:6686:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787338541.714676:0:6686:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x83671231080c1209 00000020:01000004:2.0:1787338541.714685:0:6686:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1787338541.714706:0:6686:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.153@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787338541.714715:0:6686:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.153@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787338541.714721:0:6686:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1787338541.714726:0:6686:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1787338541.714748:0:6686:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff90bbee0a8000) 00000020:00000080:2.0:1787338541.714760:0:6686:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:2.0:1787338541.719405:0:6686:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787338541.719620:0:6686:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1787338541.719636:0:6686:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1787338541.725696:0:6686:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1787338541.725715:0:6686:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1787338541.726742:0:6686:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1787338541.726750:0:6686:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1787338541.728530:0:6686:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787338541.728801:0:6686:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1787338541.728807:0:6686:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1787338541.734051:0:6686:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1787338541.734068:0:6686:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00010000:00010000:1.0:1787338541.751082:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787338541.753064:0:6686:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787338541.754866:0:6686:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787338541.754889:0:6686:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1787338541.757361:0:6686:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1787338541.757373:0:6686:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1787338541.760836:0:6686:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1787338541.760848:0:6686:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1787338541.766036:0:6686:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787338541.766435:0:6686:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1787338541.766442:0:6686:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1787338541.767065:0:6686:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1787338541.767072:0:6686:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1787338541.817174:0:6686:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787338541.817546:0:6686:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1787338541.817554:0:6686:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1787338541.818578:0:6686:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1787338541.818586:0:6686:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1787338541.820017:0:6686:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1787338541.820042:0:6686:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1787338541.820049:0:6686:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.153@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1787338541.844103:0:6686:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.153@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787338541.844144:0:6686:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.153@tcp, index=0000, flags=0x20062 00000020:01000004:0.0:1787338541.844148:0:6686:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787338541.844150:0:6686:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787338541.844151:0:6686:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787338541.844153:0:6686:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787338541.844154:0:6686:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787338541.844155:0:6686:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787338541.844157:0:6686:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787338541.844158:0:6686:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787338541.844160:0:6686:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787338541.844162:0:6686:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787338541.844163:0:6686:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787338541.844167:0:6686:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:0.0:1787338541.844169:0:6686:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787338541.844170:0:6686:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787338541.844171:0:6686:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787338541.844176:0:6686:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787338541.844177:0:6686:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787338541.844178:0:6686:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787338541.844179:0:6686:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787338541.844180:0:6686:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787338541.844181:0:6686:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787338541.844182:0:6686:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787338541.844183:0:6686:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787338541.844209:0:6686:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1787338541.844225:0:6686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbed9cb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d79243c8-b367-45ff-8d76-fbaa4be8becb:6686:1874160211989504:0@lo:253: 00000100:00100000:0.0:1787338541.844299:0:6686:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338541.844386:0:6686:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc7c28840 going to sleep for 11 seconds 00000100:00100000:2.0:1787338541.846811:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211989504 00000100:00100000:2.0:1787338541.846823:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211989504 00000100:00100000:2.0:1787338541.846901:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787338541.846912:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc408b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+12:6686:x1874160211989504:12345-0@lo:253: 20000000:01000000:2.0:1787338541.846967:0:5833:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1787338541.846972:0:5833:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:2.0:1787338541.846977:0:5833:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:2.0:1787338541.846980:0:5833:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:2.0:1787338541.849238:0:5833:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787338541.849478:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:2.0:1787338541.849493:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:2.0:1787338541.849530:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:2.0:1787338541.849539:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:2.0:1787338541.849568:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:2.0:1787338541.849617:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:2.0:1787338541.850020:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:2.0:1787338541.850042:0:5833:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.153@tcp 20000000:01000000:2.0:1787338541.850044:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.153@tcp (null) (null) (null) 00000040:00080000:2.0:1787338541.850076:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:2.0:1787338541.850083:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1787338541.850128:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:2.0:1787338541.850142:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.201.153@tcp (null) (null) 00000040:00080000:2.0:1787338541.850172:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:2.0:1787338541.850181:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1787338541.850206:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:2.0:1787338541.850266:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:2.0:1787338541.856391:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:2.0:1787338541.856435:0:5833:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.153@tcp 20000000:01000000:2.0:1787338541.856438:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.153@tcp (null) (null) (null) 00000040:00080000:2.0:1787338541.856502:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:2.0:1787338541.856511:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1787338541.856543:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:2.0:1787338541.856551:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.201.153@tcp (null) (null) 00000040:00080000:2.0:1787338541.856656:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:2.0:1787338541.856668:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1787338541.856702:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:2.0:1787338541.856743:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:2.0:1787338541.856768:0:5833:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:2.0:1787338541.856772:0:5833:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1787338541.856776:0:5833:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1787338541.856789:0:5833:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787338541.856791:0:5833:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1787338541.856831:0:5833:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1787338541.856834:0:5833:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787338541.859947:0:6701:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:2.0:1787338541.860020:0:6701:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:2.0:1787338541.860059:0:6701:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:3.0:1787338541.863267:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:3.0:1787338541.863326:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:3.0:1787338541.864081:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:3.0:1787338541.864098:0:5833:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1787338541.864101:0:5833:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787338541.866494:0:6702:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 10 1->4: lustre sys.timeout 20000000:01000000:3.0:1787338541.866576:0:6702:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 10 2->4: lustre sys.timeout 00000040:00080000:3.0:1787338541.866629:0:6702:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:2.0:1787338541.867211:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:2.0:1787338541.867254:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:2.0:1787338541.867314:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:2.0:1787338541.867330:0:5833:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1787338541.867332:0:5833:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1787338541.867721:0:6703:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:3.0:1787338541.867941:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:3.0:1787338541.867982:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:3.0:1787338541.868041:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:3.0:1787338541.868058:0:5833:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:3.0:1787338541.868060:0:5833:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:3.0:1787338541.868070:0:5833:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1787338541.868092:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90bbc14a9a00/0x83671231080c1217 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338541.868115:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90bbc0030c00/0x83671231080c1130 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c1129 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338541.868123:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90bbc0031800/0x83671231080c114c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c1145 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338541.868130:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90bbc0031c00/0x83671231080c11bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c11b5 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338541.868137:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90bbc14a9a00/0x83671231080c1217 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338541.868177:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90bbc0031c00/0x83671231080c11bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x83671231080c11b5 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338541.868194:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90bbc0031c00/0x83671231080c11bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x83671231080c11b5 expref: 12 pid: 5834 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338541.868212:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee562d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5833:1874160211989632:0@lo:104: 00000100:00100000:3.0:1787338541.868287:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338541.868458:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211989632 00000100:00100000:0.0:1787338541.868467:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211989632 00010000:00010000:3.0:1787338541.868477:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90bbc0031800/0x83671231080c114c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x83671231080c1145 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338541.868487:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90bbc0031800/0x83671231080c114c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x83671231080c1145 expref: 12 pid: 5832 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338541.868496:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee560380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5833:1874160211989760:0@lo:104: 00000100:00100000:0.0:1787338541.868522:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787338541.868526:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338541.868538:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee560a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d79243c8-b367-45ff-8d76-fbaa4be8becb+3:5833:x1874160211989632:12345-0@lo:104: 00010000:00010000:0.0:1787338541.868553:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.153@tcp lock: ffff90bbc0030200/0x83671231080c11b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x83671231080c11bc expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338541.868556:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90bbc0030c00/0x83671231080c1130 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x83671231080c1129 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338541.868574:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90bbc0030c00/0x83671231080c1130 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x83671231080c1129 expref: 12 pid: 5833 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338541.868584:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee563480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5833:1874160211989888:0@lo:104: 00000100:00100000:3.0:1787338541.868618:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787338541.868627:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787338541.868634:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbd0cd7a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787338541.868635:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee560a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d79243c8-b367-45ff-8d76-fbaa4be8becb+3:5833:x1874160211989632:12345-0@lo:104: Request processed in 100us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338541.868660:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787338541.868678:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211989760 00010000:00010000:2.0:1787338541.868679:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1787338541.868681:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211989760 00010000:00010000:2.0:1787338541.868689:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.153@tcp lock: ffff90bbc0030200/0x83671231080c11b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x83671231080c11bc expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338541.868695:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211989888 00000100:00100000:0.0:1787338541.868699:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211989888 00010000:00010000:2.0:1787338541.868701:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbc0030200 already unused, calling callback (ffffffffc1b2ec20) 10000000:00010000:2.0:1787338541.868708:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.153@tcp lock: ffff90bbc0030200/0x83671231080c11b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x83671231080c11bc expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338541.868712:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787338541.868722:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee561180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d79243c8-b367-45ff-8d76-fbaa4be8becb+4:5833:x1874160211989760:12345-0@lo:104: 00010000:00010000:2.0:1787338541.868725:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.153@tcp lock: ffff90bbc0030200/0x83671231080c11b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x83671231080c11bc expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338541.868733:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.153@tcp lock: ffff90bc02045000/0x83671231080c1145 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x83671231080c114c expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787338541.868736:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.153@tcp lock: ffff90bbc0030200/0x83671231080c11b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x83671231080c11bc expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787338541.868749:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787338541.868790:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.153@tcp lock: ffff90bbc0030200/0x83671231080c11b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c11bc expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338541.868794:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:2.0:1787338541.868800:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1787338541.868805:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee561180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d79243c8-b367-45ff-8d76-fbaa4be8becb+4:5833:x1874160211989760:12345-0@lo:104: Request processed in 81us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338541.868813:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787338541.868826:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1787338541.868832:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.153@tcp lock: ffff90bbc0030200/0x83671231080c11b5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c11bc expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338541.868833:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee561880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d79243c8-b367-45ff-8d76-fbaa4be8becb+3:5833:x1874160211989888:12345-0@lo:104: 00010000:00010000:2.0:1787338541.868846:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.153@tcp lock: ffff90bbc0030200/0x83671231080c11b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c11bc expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338541.868848:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.153@tcp lock: ffff90bc02045600/0x83671231080c1129 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x83671231080c1130 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338541.868867:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787338541.868897:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.153@tcp lock: ffff90bc02045000/0x83671231080c1145 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x83671231080c114c expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338541.868906:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bc02045000 already unused, calling callback (ffffffffc1b2ec20) 10000000:00010000:2.0:1787338541.868909:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.153@tcp lock: ffff90bc02045000/0x83671231080c1145 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x83671231080c114c expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338541.868926:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.153@tcp lock: ffff90bc02045000/0x83671231080c1145 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x83671231080c114c expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338541.868928:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787338541.868938:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee561880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d79243c8-b367-45ff-8d76-fbaa4be8becb+3:5833:x1874160211989888:12345-0@lo:104: Request processed in 105us (319us total) trans 0 rc 0/0 10000000:00010000:2.0:1787338541.868939:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.153@tcp lock: ffff90bc02045000/0x83671231080c1145 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x83671231080c114c expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338541.868949:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 10000000:01000000:2.0:1787338541.868954:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787338541.868975:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.153@tcp lock: ffff90bc02045000/0x83671231080c1145 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c114c expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338541.868976:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc91ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d79243c8-b367-45ff-8d76-fbaa4be8becb:3314:1874160211990016:0@lo:103: 00010000:00010000:2.0:1787338541.868987:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787338541.868994:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.153@tcp lock: ffff90bc02045000/0x83671231080c1145 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c114c expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338541.869001:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.153@tcp lock: ffff90bc02045000/0x83671231080c1145 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c114c expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338541.869010:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787338541.869017:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787338541.869022:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.153@tcp lock: ffff90bc02045600/0x83671231080c1129 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x83671231080c1130 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338541.869028:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bc02045600 already unused, calling callback (ffffffffc1b2ec20) 10000000:00010000:2.0:1787338541.869031:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.153@tcp lock: ffff90bc02045600/0x83671231080c1129 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x83671231080c1130 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338541.869037:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.153@tcp lock: ffff90bc02045600/0x83671231080c1129 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x83671231080c1130 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338541.869041:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 10000000:00010000:2.0:1787338541.869049:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.153@tcp lock: ffff90bc02045600/0x83671231080c1129 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x83671231080c1130 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338541.869050:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc91ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d79243c8-b367-45ff-8d76-fbaa4be8becb:3314:1874160211990144:0@lo:103: 10000000:01000000:2.0:1787338541.869061:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1787338541.869072:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787338541.869081:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.153@tcp lock: ffff90bc02045600/0x83671231080c1129 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c1130 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338541.869089:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1787338541.869110:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211990016 00010000:00010000:2.0:1787338541.869111:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.153@tcp lock: ffff90bc02045600/0x83671231080c1129 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c1130 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338541.869116:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211990016 00010000:00010000:2.0:1787338541.869122:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.153@tcp lock: ffff90bc02045600/0x83671231080c1129 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c1130 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338541.869135:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90bbc0031c00/0x83671231080c11bc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x83671231080c11b5 expref: 13 pid: 5834 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338541.869139:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787338541.869143:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787338541.869145:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787338541.869163:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211990144 00000100:00100000:0.0:1787338541.869168:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211990144 00010000:00010000:0.0:1787338541.869179:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90bbc0031800/0x83671231080c114c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x83671231080c1145 expref: 14 pid: 5832 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338541.869217:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787338541.869224:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbed9cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d79243c8-b367-45ff-8d76-fbaa4be8becb+14:3314:x1874160211990016:12345-0@lo:103: 00010000:00010000:0.0:1787338541.869236:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787338541.869242:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90bbc0031c00/0x83671231080c11bc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x83671231080c11b5 expref: 14 pid: 5834 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338541.869250:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787338541.869265:0:5823:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:0.0:1787338541.869269:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90bbc0031c00/0x83671231080c11bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x83671231080c11b5 expref: 14 pid: 5834 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338541.869278:0:5823:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:0.0:1787338541.869290:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787338541.869322:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbed9cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d79243c8-b367-45ff-8d76-fbaa4be8becb+14:3314:x1874160211990016:12345-0@lo:103: Request processed in 99us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338541.869328:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787338541.869339:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787338541.869345:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbed9c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d79243c8-b367-45ff-8d76-fbaa4be8becb+13:3314:x1874160211990144:12345-0@lo:103: 00010000:00010000:0.0:1787338541.869352:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787338541.869356:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90bbc0031800/0x83671231080c114c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x83671231080c1145 expref: 13 pid: 5832 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338541.869366:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90bbc0031800/0x83671231080c114c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x83671231080c1145 expref: 13 pid: 5832 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338541.869377:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787338541.869396:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbed9c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d79243c8-b367-45ff-8d76-fbaa4be8becb+13:3314:x1874160211990144:12345-0@lo:103: Request processed in 52us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338541.869402:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787338541.869426:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787338541.869443:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc91dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d79243c8-b367-45ff-8d76-fbaa4be8becb:3317:1874160211990272:0@lo:103: 00000100:00100000:0.0:1787338541.869472:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338541.869510:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc91ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d79243c8-b367-45ff-8d76-fbaa4be8becb:3314:1874160211990144:0@lo:103: 00000100:00100000:1.0:1787338541.869521:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211990272 00000100:00100000:0.0:1787338541.869524:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc91ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d79243c8-b367-45ff-8d76-fbaa4be8becb:3314:1874160211990016:0@lo:103: 00000100:00100000:1.0:1787338541.869528:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211990272 00010000:00010000:1.0:1787338541.869549:0:6704:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90bbc0030c00/0x83671231080c1130 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x83671231080c1129 expref: 13 pid: 5833 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338541.869571:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787338541.869580:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbed9c8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d79243c8-b367-45ff-8d76-fbaa4be8becb+13:3317:x1874160211990272:12345-0@lo:103: 00010000:00010000:1.0:1787338541.869589:0:6704:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787338541.869593:0:6704:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90bbc0030c00/0x83671231080c1130 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x83671231080c1129 expref: 13 pid: 5833 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338541.869611:0:6704:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90bbc0030c00/0x83671231080c1130 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x83671231080c1129 expref: 13 pid: 5833 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338541.869625:0:6704:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90bbc14a9a00/0x83671231080c1217 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338541.869632:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bbc14a9a00/0x83671231080c1217 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338541.869655:0:6704:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90bbc14a9a00/0x83671231080c1217 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338541.869662:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90bbc14a9a00/0x83671231080c1217 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338541.869669:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90bbc14a9a00/0x83671231080c1217 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338541.869675:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90bbc14a9a00/0x83671231080c1217 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338541.869682:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbc14a9a00 already unused, calling callback (ffffffffc1546230) 00010000:00010000:1.0:1787338541.869686:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90bbc14a9a00/0x83671231080c1217 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338541.869694:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90bbc14a9a00/0x83671231080c1217 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338541.869702:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90bbc14a9a00/0x83671231080c1217 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338541.869723:0:6704:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787338541.869763:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbed9c8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d79243c8-b367-45ff-8d76-fbaa4be8becb+13:3317:x1874160211990272:12345-0@lo:103: Request processed in 185us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338541.869770:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1787338541.870061:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90bbc0031c00/0x83671231080c11bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x83671231080c11b5 expref: 12 pid: 5834 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338541.870075:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee562d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5833:1874160211989632:0@lo:104: 00010000:00010000:3.0:1787338541.870085:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90bbc0031800/0x83671231080c114c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x83671231080c1145 expref: 11 pid: 5832 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338541.870094:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee560380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5833:1874160211989760:0@lo:104: 00010000:00010000:3.0:1787338541.870104:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90bbc0030c00/0x83671231080c1130 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x83671231080c1129 expref: 10 pid: 5833 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338541.870114:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee563480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5833:1874160211989888:0@lo:104: 00010000:00010000:3.0:1787338541.870134:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90bbc14a9a00/0x83671231080c1217 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338541.870143:0:5833:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90bbc14a9a00/0x83671231080c1217 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338541.870150:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90bbc14a9a00/0x83671231080c1217 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338541.870156:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90bbc14a9a00/0x83671231080c1217 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787338541.870179:0:5833:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1787338541.870537:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc91dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d79243c8-b367-45ff-8d76-fbaa4be8becb:3317:1874160211990272:0@lo:103: 00000100:00100000:3.0:1787338541.939116:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc408b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+9:6686:x1874160211989504:12345-0@lo:253: Request processed in 92198us (94808us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338541.939130:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787338541.939261:0:6686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbed9cb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d79243c8-b367-45ff-8d76-fbaa4be8becb:6686:1874160211989504:0@lo:253: 10000000:01000000:0.0:1787338541.939280:0:6686:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1787338541.939283:0:6686:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787338541.939285:0:6686:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787338541.939286:0:6686:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787338541.939287:0:6686:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:0.0:1787338541.939288:0:6686:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787338541.939290:0:6686:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787338541.939291:0:6686:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787338541.939293:0:6686:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1787338541.939295:0:6686:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787338541.939296:0:6686:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787338541.939315:0:6686:0:(tgt_mount.c:101:server_register_mount()) register mount ffff90bbc9632800 from lustre-OST0000 10000000:01000000:0.0:1787338541.939352:0:6686:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1787338541.939356:0:6686:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1787338541.939363:0:6686:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff90bbde3e99b8 local copy 10000000:01000000:0.0:1787338541.939367:0:6686:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787338541.939404:0:6686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbc0030a00/0x83671231080c121e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338541.939417:0:6686:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.153@tcp lock: ffff90bbc0030a00/0x83671231080c121e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338541.939425:0:6686:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.153@tcp lock: ffff90bbc0030a00/0x83671231080c121e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338541.939463:0:6686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbed9cb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d79243c8-b367-45ff-8d76-fbaa4be8becb:6686:1874160211990400:0@lo:101: 00000100:00100000:0.0:1787338541.939501:0:6686:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338541.939565:0:6686:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbde498e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787338541.939792:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211990400 00000100:00100000:3.0:1787338541.939800:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211990400 00000100:00100000:3.0:1787338541.939847:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787338541.939858:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4088c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+9:6686:x1874160211990400:12345-0@lo:101: 00010000:00010000:3.0:1787338541.939871:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787338541.939920:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90bbc14a9a00/0x83671231080c1225 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x83671231080c121e expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338541.939944:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bbc14a9a00/0x83671231080c1225 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x83671231080c121e expref: 10 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338541.939956:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90bbc14a9a00/0x83671231080c1225 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c121e expref: 10 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338541.939965:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbc14a9a00, rc 0) 00000100:00100000:3.0:1787338541.940002:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4088c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+10:6686:x1874160211990400:12345-0@lo:101: Request processed in 146us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338541.940009:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787338541.940087:0:6686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbed9cb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d79243c8-b367-45ff-8d76-fbaa4be8becb:6686:1874160211990400:0@lo:101: 00010000:00010000:1.0:1787338541.940100:0:6686:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.153@tcp lock: ffff90bbc0030a00/0x83671231080c121e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x83671231080c1225 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338541.940109:0:6686:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.153@tcp lock: ffff90bbc0030a00/0x83671231080c121e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x83671231080c1225 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338541.940244:0:6686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee44dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d79243c8-b367-45ff-8d76-fbaa4be8becb:6686:1874160211990528:0@lo:501: 00000100:00100000:1.0:1787338541.940273:0:6686:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338541.940305:0:6686:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbee0289c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787338541.940456:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211990528 00000100:00100000:0.0:1787338541.940461:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211990528 00000100:00100000:0.0:1787338541.940569:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787338541.940577:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4089c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+10:6686:x1874160211990528:12345-0@lo:501: 00000100:00100000:0.0:1787338541.940797:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4089c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+10:6686:x1874160211990528:12345-0@lo:501: Request processed in 220us (523us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787338541.940804:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787338541.940981:0:6686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee44dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d79243c8-b367-45ff-8d76-fbaa4be8becb:6686:1874160211990528:0@lo:501: 10000000:01000000:1.0:1787338541.940997:0:6686:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.153@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787338541.941025:0:6686:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.153@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787338541.941032:0:6686:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbc0030a00/0x83671231080c121e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x83671231080c1225 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338541.941040:0:6686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbc0030a00/0x83671231080c121e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x83671231080c1225 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338541.941047:0:6686:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.153@tcp lock: ffff90bbc0030a00/0x83671231080c121e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x83671231080c1225 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338541.941065:0:6686:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787338541.941088:0:6686:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff90bbc9632800 10000000:01000000:1.0:1787338541.941092:0:6686:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787338541.941097:0:6686:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff90bbde3e99b8 10000000:01000000:1.0:1787338541.941099:0:6686:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1787338541.941103:0:6686:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff90bbde3e99b8 from 1 10000000:01000000:1.0:1787338541.941106:0:6686:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1787338541.941126:0:6686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bc02045400/0x83671231080c122c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338541.941134:0:6686:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.153@tcp lock: ffff90bc02045400/0x83671231080c122c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338541.941143:0:6686:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.153@tcp lock: ffff90bc02045400/0x83671231080c122c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338541.941157:0:6686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee44dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d79243c8-b367-45ff-8d76-fbaa4be8becb:6686:1874160211990656:0@lo:101: 00000100:00100000:1.0:1787338541.941185:0:6686:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338541.941425:0:6686:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbee0283c0 going to sleep for 11 seconds 00010000:00010000:1.0:1787338541.942491:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787338541.942500:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.153@tcp lock: ffff90bbc0030a00/0x83671231080c121e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x83671231080c1225 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338541.942511:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbc0030a00 already unused, calling callback (ffffffffc1b2ec20) 10000000:00010000:1.0:1787338541.942515:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.153@tcp lock: ffff90bbc0030a00/0x83671231080c121e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x83671231080c1225 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338541.942524:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.153@tcp lock: ffff90bbc0030a00/0x83671231080c121e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x83671231080c1225 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787338541.942532:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.153@tcp lock: ffff90bbc0030a00/0x83671231080c121e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x83671231080c1225 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787338541.942553:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787338541.942585:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.153@tcp lock: ffff90bbc0030a00/0x83671231080c121e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x83671231080c1225 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338541.942592:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787338541.942614:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.153@tcp lock: ffff90bbc0030a00/0x83671231080c121e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x83671231080c1225 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338541.942621:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.153@tcp lock: ffff90bbc0030a00/0x83671231080c121e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x83671231080c1225 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338541.942651:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338541.942653:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338541.942655:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787338541.942686:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211990656 00000100:00100000:2.0:1787338541.942693:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211990656 00000100:00100000:2.0:1787338541.942731:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787338541.942740:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4089450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+10:6686:x1874160211990656:12345-0@lo:101: 00010000:00010000:2.0:1787338541.942751:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787338541.942768:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90bc021c8400/0x83671231080c1233 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x83671231080c122c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338541.942789:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bc021c8400/0x83671231080c1233 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x83671231080c122c expref: 11 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338541.942800:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90bc021c8400/0x83671231080c1233 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c122c expref: 11 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338541.942808:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bc021c8400, rc 0) 00000100:00100000:2.0:1787338541.942894:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4089450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+11:6686:x1874160211990656:12345-0@lo:101: Request processed in 155us (1707us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338541.942901:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787338541.943033:0:6686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee44dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d79243c8-b367-45ff-8d76-fbaa4be8becb:6686:1874160211990656:0@lo:101: 00010000:00010000:1.0:1787338541.943048:0:6686:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.153@tcp lock: ffff90bc02045400/0x83671231080c122c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c1233 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338541.943057:0:6686:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.153@tcp lock: ffff90bc02045400/0x83671231080c122c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x83671231080c1233 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787338541.943074:0:6686:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.153@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1787338541.943082:0:6686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bc02045400/0x83671231080c122c lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c1233 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338541.943089:0:6686:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.153@tcp lock: ffff90bc02045400/0x83671231080c122c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c1233 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787338541.943096:0:6686:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1787338541.943106:0:6686:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787338541.943111:0:6686:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1787338541.943114:0:6686:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1787338541.943129:0:6686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bc02045e00/0x83671231080c123a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338541.943138:0:6686:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.153@tcp lock: ffff90bc02045e00/0x83671231080c123a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338541.943146:0:6686:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.153@tcp lock: ffff90bc02045e00/0x83671231080c123a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338541.943159:0:6686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee44dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d79243c8-b367-45ff-8d76-fbaa4be8becb:6686:1874160211990912:0@lo:101: 00000100:00100000:1.0:1787338541.943186:0:6686:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338541.943218:0:6686:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbee0283c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787338541.943313:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211990912 00000100:00100000:3.0:1787338541.943318:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211990912 00000100:00100000:3.0:1787338541.943352:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787338541.943359:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc408a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+11:6686:x1874160211990912:12345-0@lo:101: 00010000:00010000:3.0:1787338541.943366:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787338541.943380:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90bbc14a9600/0x83671231080c1241 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x83671231080c123a expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338541.943393:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bbc14a9600/0x83671231080c1241 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x83671231080c123a expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338541.943402:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90bbc14a9600/0x83671231080c1241 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c123a expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338541.943409:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbc14a9600, rc 0) 00000100:00100000:3.0:1787338541.943443:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc408a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+12:6686:x1874160211990912:12345-0@lo:101: Request processed in 84us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338541.943449:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787338541.943471:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787338541.943479:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee44df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d79243c8-b367-45ff-8d76-fbaa4be8becb:3316:1874160211990784:0@lo:103: 00000100:00100000:3.0:1787338541.943501:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338541.943541:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211990784 00000100:00100000:3.0:1787338541.943544:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211990784 00000100:00100000:3.0:1787338541.943570:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787338541.943577:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee563480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d79243c8-b367-45ff-8d76-fbaa4be8becb+12:3316:x1874160211990784:12345-0@lo:103: 00010000:00010000:3.0:1787338541.943587:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787338541.943599:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90bbc14a9a00/0x83671231080c1225 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x83671231080c121e expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338541.943609:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787338541.943632:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee563480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d79243c8-b367-45ff-8d76-fbaa4be8becb+11:3316:x1874160211990784:12345-0@lo:103: Request processed in 55us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338541.943648:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787338541.943672:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee44df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d79243c8-b367-45ff-8d76-fbaa4be8becb:3316:1874160211990784:0@lo:103: 00000100:00100000:1.0:1787338541.943814:0:6686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee44dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d79243c8-b367-45ff-8d76-fbaa4be8becb:6686:1874160211990912:0@lo:101: 00010000:00010000:1.0:1787338541.943825:0:6686:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.153@tcp lock: ffff90bc02045e00/0x83671231080c123a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c1241 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338541.943833:0:6686:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.153@tcp lock: ffff90bc02045e00/0x83671231080c123a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x83671231080c1241 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338541.943954:0:6686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee44dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d79243c8-b367-45ff-8d76-fbaa4be8becb:6686:1874160211991040:0@lo:501: 00000100:00100000:1.0:1787338541.943976:0:6686:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338541.943989:0:6686:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbee0283c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787338541.944054:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211991040 00000100:00100000:2.0:1787338541.944058:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211991040 00000100:00100000:2.0:1787338541.944075:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787338541.944081:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4089050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+11:6686:x1874160211991040:12345-0@lo:501: 00000100:00100000:1.0:1787338541.944502:0:6686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee44dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d79243c8-b367-45ff-8d76-fbaa4be8becb:6686:1874160211991040:0@lo:501: 00000100:00100000:1.0:1787338541.944530:0:6686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee44dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d79243c8-b367-45ff-8d76-fbaa4be8becb:6686:1874160211991168:0@lo:503: 00000100:00100000:1.0:1787338541.944723:0:6686:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338541.944780:0:6686:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbee0283c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787338541.944793:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211991168 00000100:00100000:1.0:1787338541.944797:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211991168 00000100:00100000:2.0:1787338541.944835:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4089050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+12:6686:x1874160211991040:12345-0@lo:501: Request processed in 753us (857us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338541.944842:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787338541.944861:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787338541.944867:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc408ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+11:6686:x1874160211991168:12345-0@lo:503: 00000100:00100000:2.0:1787338541.945024:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc408ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+11:6686:x1874160211991168:12345-0@lo:503: Request processed in 156us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338541.945030:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787338541.945120:0:6686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee44dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d79243c8-b367-45ff-8d76-fbaa4be8becb:6686:1874160211991168:0@lo:503: 00000040:00080000:0.0:1787338541.945387:0:6686:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787338541.945445:0:6686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbed9c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d79243c8-b367-45ff-8d76-fbaa4be8becb:6686:1874160211991296:0@lo:502: 00000100:00100000:0.0:1787338541.945480:0:6686:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338541.945508:0:6686:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbde498840 going to sleep for 11 seconds 00000100:00100000:3.0:1787338541.945612:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211991296 00000100:00100000:3.0:1787338541.945617:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211991296 00000100:00100000:3.0:1787338541.945646:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787338541.945653:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc408a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+11:6686:x1874160211991296:12345-0@lo:502: 00000100:00100000:3.0:1787338541.945788:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc408a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+11:6686:x1874160211991296:12345-0@lo:502: Request processed in 134us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338541.945794:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787338541.951952:0:6686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbed9c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d79243c8-b367-45ff-8d76-fbaa4be8becb:6686:1874160211991296:0@lo:502: 00000040:00080000:0.0:1787338541.952306:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1787338541.952398:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1787338541.952435:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1787338541.952483:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1787338541.952521:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1787338541.952553:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1787338541.952593:0:6686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbed9c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d79243c8-b367-45ff-8d76-fbaa4be8becb:6686:1874160211991424:0@lo:502: 00000100:00100000:0.0:1787338541.952678:0:6686:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338541.952726:0:6686:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbde498840 going to sleep for 11 seconds 00000100:00100000:3.0:1787338541.952890:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211991424 00000100:00100000:3.0:1787338541.952897:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211991424 00000100:00100000:3.0:1787338541.952935:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787338541.952943:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4088850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+11:6686:x1874160211991424:12345-0@lo:502: 00000100:00100000:3.0:1787338541.953126:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4088850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+11:6686:x1874160211991424:12345-0@lo:502: Request processed in 182us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338541.953133:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787338541.953518:0:6686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbed9c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d79243c8-b367-45ff-8d76-fbaa4be8becb:6686:1874160211991424:0@lo:502: 00000040:00080000:0.0:1787338541.953619:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1787338541.953629:0:6686:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:3.0:1787338541.954599:0:6705:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787338541.954607:0:6705:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1787338541.954614:0:6705:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787338541.954617:0:6705:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1787338541.954622:0:6705:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787338541.954647:0:6705:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff90bbee59b370) 00000020:00000080:3.0:1787338541.954667:0:6705:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787338541.954673:0:6705:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787338541.954748:0:6705:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90bbc9632800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1787338541.954756:0:6705:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787338541.954762:0:6705:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x83671231080c124f 00010000:00010000:3.0:1787338541.960704:0:6705:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:3.0:1787338541.961393:0:6705:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1787338541.964693:0:6705:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1787338541.965118:0:6705:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:0.0:1787338541.979128:0:6705:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1787338541.979661:0:6705:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1787338541.982351:0:6705:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1787338541.982364:0:6705:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787338541.982370:0:6705:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787338541.982373:0:6705:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1787338541.982376:0:6705:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787338541.982380:0:6705:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787338541.982381:0:6705:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787338541.982384:0:6705:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787338541.982386:0:6705:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787338541.982437:0:6705:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787338541.982442:0:6705:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787338541.982444:0:6705:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787338541.982447:0:6705:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1787338541.982497:0:6686:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:0.0:1787338541.982520:0:6686:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.153@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787338541.982536:0:6686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bc02045e00/0x83671231080c123a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c1241 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338541.982548:0:6686:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.153@tcp lock: ffff90bc02045e00/0x83671231080c123a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c1241 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787338541.982556:0:6686:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90bbc9632800 from 1 10000000:01000000:0.0:1787338541.982559:0:6686:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787338541.982598:0:6686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbc0030600/0x83671231080c1256 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338541.982606:0:6686:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.153@tcp lock: ffff90bbc0030600/0x83671231080c1256 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338541.982623:0:6686:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.153@tcp lock: ffff90bbc0030600/0x83671231080c1256 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338541.982658:0:6686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbed9c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d79243c8-b367-45ff-8d76-fbaa4be8becb:6686:1874160211991552:0@lo:101: 00000100:00100000:0.0:1787338541.982726:0:6686:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338541.982779:0:6686:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbde498e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787338541.985369:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211991552 00000100:00100000:0.0:1787338541.985385:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211991552 00000100:00100000:0.0:1787338541.985466:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787338541.985477:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4088050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+11:6686:x1874160211991552:12345-0@lo:101: 00010000:00010000:0.0:1787338541.985497:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787338541.985520:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90bbc0031a00/0x83671231080c125d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x83671231080c1256 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338541.985553:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bbc0031a00/0x83671231080c125d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x83671231080c1256 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338541.985563:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90bbc0031a00/0x83671231080c125d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c1256 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338541.985573:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbc0031a00, rc 0) 00000100:00100000:0.0:1787338541.985656:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4088050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+12:6686:x1874160211991552:12345-0@lo:101: Request processed in 181us (2930us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338541.985663:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787338541.985716:0:6686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbed9c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d79243c8-b367-45ff-8d76-fbaa4be8becb:6686:1874160211991552:0@lo:101: 00010000:00010000:0.0:1787338541.985735:0:6686:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.153@tcp lock: ffff90bbc0030600/0x83671231080c1256 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c125d expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338541.985764:0:6686:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.153@tcp lock: ffff90bbc0030600/0x83671231080c1256 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x83671231080c125d expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338541.985913:0:6686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbed9c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d79243c8-b367-45ff-8d76-fbaa4be8becb:6686:1874160211991680:0@lo:501: 00000100:00100000:0.0:1787338541.985948:0:6686:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338541.985972:0:6686:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc7c77480 going to sleep for 11 seconds 00000100:00100000:2.0:1787338541.986094:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211991680 00000100:00100000:2.0:1787338541.986100:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211991680 00000100:00100000:2.0:1787338541.986131:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787338541.986139:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4088450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+12:6686:x1874160211991680:12345-0@lo:501: 00000100:00100000:2.0:1787338541.986429:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4088450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+12:6686:x1874160211991680:12345-0@lo:501: Request processed in 289us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338541.986437:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787338541.987138:0:6686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbed9c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d79243c8-b367-45ff-8d76-fbaa4be8becb:6686:1874160211991680:0@lo:501: 00000100:00100000:0.0:1787338541.987178:0:6686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbed9c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d79243c8-b367-45ff-8d76-fbaa4be8becb:6686:1874160211991808:0@lo:503: 00000100:00100000:0.0:1787338541.987754:0:6686:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338541.987793:0:6686:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc7c77480 going to sleep for 11 seconds 00000100:00100000:0.0:1787338541.987813:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211991808 00000100:00100000:0.0:1787338541.987819:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211991808 00000100:00100000:0.0:1787338541.987866:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787338541.987905:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4012050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+12:6686:x1874160211991808:12345-0@lo:503: 00000100:00100000:0.0:1787338541.990392:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4012050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+12:6686:x1874160211991808:12345-0@lo:503: Request processed in 2510us (2632us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338541.990405:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787338541.990548:0:6686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbed9c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d79243c8-b367-45ff-8d76-fbaa4be8becb:6686:1874160211991808:0@lo:503: 00000040:00080000:3.0:1787338541.990904:0:6686:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787338541.990999:0:6686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee560380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d79243c8-b367-45ff-8d76-fbaa4be8becb:6686:1874160211991936:0@lo:502: 00000100:00100000:3.0:1787338541.991052:0:6686:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338541.991090:0:6686:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbd0cd70c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787338541.991583:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211991936 00000100:00100000:0.0:1787338541.991591:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211991936 00000100:00100000:0.0:1787338541.991650:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787338541.991660:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4011050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+12:6686:x1874160211991936:12345-0@lo:502: 00000100:00100000:0.0:1787338541.991915:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4011050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+12:6686:x1874160211991936:12345-0@lo:502: Request processed in 256us (862us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338541.991923:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787338541.992095:0:6686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee560380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d79243c8-b367-45ff-8d76-fbaa4be8becb:6686:1874160211991936:0@lo:502: 00000040:00080000:3.0:1787338541.992816:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1787338541.992870:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1787338541.992940:0:6686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee560380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d79243c8-b367-45ff-8d76-fbaa4be8becb:6686:1874160211992064:0@lo:502: 00000100:00100000:3.0:1787338541.992984:0:6686:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338541.994387:0:6686:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbd0cd70c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787338541.998365:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211992064 00000100:00100000:0.0:1787338541.998394:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211992064 00000100:00100000:0.0:1787338541.998449:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787338541.998458:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4012c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+12:6686:x1874160211992064:12345-0@lo:502: 00000100:00100000:0.0:1787338541.998728:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4012c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+12:6686:x1874160211992064:12345-0@lo:502: Request processed in 269us (5741us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338541.998736:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787338541.999464:0:6686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee560380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d79243c8-b367-45ff-8d76-fbaa4be8becb:6686:1874160211992064:0@lo:502: 00000040:00080000:3.0:1787338541.999634:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1787338541.999659:0:6686:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1787338542.000768:0:6709:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787338542.000777:0:6709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787338542.000779:0:6709:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787338542.000786:0:6709:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90bbc9632800 00000020:00000080:2.0:1787338542.000788:0:6709:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787338542.000803:0:6709:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787338542.000813:0:6709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787338542.000814:0:6709:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1787338542.000817:0:6709:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1787338542.000956:0:6686:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1787338542.000974:0:6686:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787338542.000992:0:6686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbc0030600/0x83671231080c1256 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c125d expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338542.001004:0:6686:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.153@tcp lock: ffff90bbc0030600/0x83671231080c1256 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c125d expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787338542.001039:0:6686:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787338542.001042:0:6686:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff90bbc9632800 10000000:01000000:3.0:1787338542.001044:0:6686:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff90bbc9632800 10000000:01000000:3.0:1787338542.001048:0:6686:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787338542.001052:0:6686:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90bbc9632800 from 1 10000000:01000000:3.0:1787338542.001054:0:6686:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787338542.001089:0:6686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbc14a9a00/0x83671231080c1264 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338542.001098:0:6686:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.153@tcp lock: ffff90bbc14a9a00/0x83671231080c1264 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338542.001108:0:6686:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.153@tcp lock: ffff90bbc14a9a00/0x83671231080c1264 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338542.001125:0:6686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee560380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d79243c8-b367-45ff-8d76-fbaa4be8becb:6686:1874160211992192:0@lo:101: 00000100:00100000:3.0:1787338542.001175:0:6686:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338542.001220:0:6686:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbd0cd7d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787338542.001349:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211992192 00000100:00100000:0.0:1787338542.001355:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211992192 00000100:00100000:0.0:1787338542.001395:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787338542.001404:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4012450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+12:6686:x1874160211992192:12345-0@lo:101: 00010000:00010000:0.0:1787338542.001415:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787338542.001427:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90bbc0030800/0x83671231080c126b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x83671231080c1264 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338542.001449:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bbc0030800/0x83671231080c126b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x83671231080c1264 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338542.001459:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90bbc0030800/0x83671231080c126b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c1264 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338542.001467:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbc0030800, rc 0) 00000100:00100000:0.0:1787338542.001501:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4012450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+13:6686:x1874160211992192:12345-0@lo:101: Request processed in 98us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338542.001507:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787338542.001754:0:6686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee560380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d79243c8-b367-45ff-8d76-fbaa4be8becb:6686:1874160211992192:0@lo:101: 00010000:00010000:3.0:1787338542.001767:0:6686:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.153@tcp lock: ffff90bbc14a9a00/0x83671231080c1264 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c126b expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338542.001775:0:6686:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.153@tcp lock: ffff90bbc14a9a00/0x83671231080c1264 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x83671231080c126b expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338542.001849:0:6686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee560380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d79243c8-b367-45ff-8d76-fbaa4be8becb:6686:1874160211992320:0@lo:501: 00000100:00100000:3.0:1787338542.001897:0:6686:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338542.001920:0:6686:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbd0cd7d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787338542.002776:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211992320 00000100:00100000:0.0:1787338542.002783:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211992320 00000100:00100000:0.0:1787338542.002821:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787338542.002830:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4010850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+13:6686:x1874160211992320:12345-0@lo:501: 00000100:00100000:0.0:1787338542.003117:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4010850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+13:6686:x1874160211992320:12345-0@lo:501: Request processed in 288us (1243us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338542.003131:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787338542.003224:0:6686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee560380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d79243c8-b367-45ff-8d76-fbaa4be8becb:6686:1874160211992320:0@lo:501: 00000100:00100000:3.0:1787338542.003256:0:6686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee560380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d79243c8-b367-45ff-8d76-fbaa4be8becb:6686:1874160211992448:0@lo:503: 00000100:00100000:3.0:1787338542.003297:0:6686:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338542.003329:0:6686:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbd0cd7d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787338542.003574:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211992448 00000100:00100000:1.0:1787338542.003579:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211992448 00000100:00100000:1.0:1787338542.003605:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787338542.003612:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4010050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+13:6686:x1874160211992448:12345-0@lo:503: 00000100:00100000:1.0:1787338542.003773:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4010050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+13:6686:x1874160211992448:12345-0@lo:503: Request processed in 161us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338542.003779:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787338542.003912:0:6686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee560380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d79243c8-b367-45ff-8d76-fbaa4be8becb:6686:1874160211992448:0@lo:503: 00000040:00080000:3.0:1787338542.004145:0:6686:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787338542.004282:0:6686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee560380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d79243c8-b367-45ff-8d76-fbaa4be8becb:6686:1874160211992576:0@lo:502: 00000100:00100000:3.0:1787338542.004319:0:6686:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338542.004436:0:6686:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbd0cd7d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787338542.004453:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211992576 00000100:00100000:3.0:1787338542.004457:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211992576 00000100:00100000:3.0:1787338542.004484:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787338542.004491:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4010450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+13:6686:x1874160211992576:12345-0@lo:502: 00000100:00100000:3.0:1787338542.004661:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4010450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+13:6686:x1874160211992576:12345-0@lo:502: Request processed in 170us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338542.004668:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787338542.004700:0:6686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee560380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d79243c8-b367-45ff-8d76-fbaa4be8becb:6686:1874160211992576:0@lo:502: 00000040:00080000:3.0:1787338542.004943:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1787338542.004993:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1787338542.005022:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1787338542.005070:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1787338542.005106:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1787338542.005149:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1787338542.005184:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1787338542.005573:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1787338542.005630:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1787338542.005700:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1787338542.005737:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1787338542.005792:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1787338542.005831:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1787338542.005867:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1787338542.006517:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1787338542.006559:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1787338542.006595:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1787338542.006675:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1787338542.006715:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1787338542.006763:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1787338542.006812:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1787338542.006847:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1787338542.006913:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1787338542.006964:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1787338542.006999:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1787338542.007033:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1787338542.007078:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1787338542.007113:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:3.0:1787338542.007152:0:6686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee560380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d79243c8-b367-45ff-8d76-fbaa4be8becb:6686:1874160211992704:0@lo:502: 00000100:00100000:3.0:1787338542.007467:0:6686:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338542.007547:0:6686:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbd0cd7d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787338542.008521:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211992704 00000100:00100000:1.0:1787338542.008532:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211992704 00000100:00100000:1.0:1787338542.008622:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787338542.008634:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4013450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+13:6686:x1874160211992704:12345-0@lo:502: 00000100:00100000:1.0:1787338542.008952:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4013450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+13:6686:x1874160211992704:12345-0@lo:502: Request processed in 319us (1484us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338542.008960:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787338542.009132:0:6686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee560380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d79243c8-b367-45ff-8d76-fbaa4be8becb:6686:1874160211992704:0@lo:502: 00000040:00080000:3.0:1787338542.009302:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1787338542.009315:0:6686:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:1.0:1787338542.010447:0:6710:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1787338542.010469:0:6710:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff90bbffd84d28) 00000020:00000080:1.0:1787338542.010488:0:6710:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:1.0:1787338542.010552:0:6710:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90bbc9632800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787338542.010557:0:6710:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90bbc9632800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787338542.010559:0:6710:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90bbc9632800 3 00010000:00080000:1.0:1787338542.010588:0:6710:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90bbffa95800@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.153@tcp at head 00010000:00010000:1.0:1787338542.013983:0:6710:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:1.0:1787338542.014201:0:6710:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1787338542.014237:0:6710:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787338542.014250:0:6710:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x83671231080c1279 00000100:00080000:1.0:1787338542.014261:0:6710:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787338542.014275:0:6710:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff90bbffa95800 using connection 192.168.201.153@tcp/0@lo 00000100:00100000:1.0:1787338542.014311:0:6710:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90bbee44fb80 x1874160211992832/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787338542.016189:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee44fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3313:1874160211992832:0@lo:38: 00000100:00100000:3.0:1787338542.016279:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338542.016391:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211992832 00000100:00100000:0.0:1787338542.016399:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211992832 00000100:00100000:0.0:1787338542.016437:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787338542.016445:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee560380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3313:x1874160211992832:12345-0@lo:38: 00010000:00080000:0.0:1787338542.016472:0:5841:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 194 last 0 00000020:00000080:0.0:1787338542.016505:0:5841:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x83671231080c1280 00000004:00100000:0.0:1787338542.016521:0:5841:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787338542.016554:0:5841:0:(import.c:65:import_set_state_nolock()) ffff90bbf3c20800 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1787338542.016733:0:6710:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787338542.017293:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee560380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874160211992832:12345-0@lo:38: Request processed in 845us (1012us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338542.017302:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000040:00080000:0.0:1787338542.017714:0:6710:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000100:00100000:1.0:1787338542.017989:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbed9cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874160211992960:0@lo:400: 00000100:00100000:1.0:1787338542.018034:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338542.018141:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211992960 00000100:00100000:0.0:1787338542.018146:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211992960 00000100:00100000:0.0:1787338542.018187:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787338542.018195:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee44f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874160211992960:12345-0@lo:400: 00000100:00100000:0.0:1787338542.018513:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee44f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874160211992960:12345-0@lo:400: Request processed in 318us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338542.018521:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787338542.018598:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff90bbee44fb80 x1874160211992832/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787338552 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787338542.018609:0:3313:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787338542.018618:0:3313:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1787338542.018624:0:3313:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787338542.018628:0:3313:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787338542.018631:0:3313:0:(import.c:65:import_set_state_nolock()) ffff90bbffa95800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787338542.018647:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee44fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3313:1874160211992832:0@lo:38: 00000020:01000000:3.0:1787338542.018674:0:6686:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:3.0:1787338542.018701:0:6686:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787338542.018756:0:6686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbc14a9a00/0x83671231080c1264 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c126b expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338542.018780:0:6686:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.153@tcp lock: ffff90bbc14a9a00/0x83671231080c1264 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c126b expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787338542.018825:0:6686:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787338542.018827:0:6686:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787338542.018828:0:6686:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787338542.018829:0:6686:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787338542.018830:0:6686:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787338542.018832:0:6686:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787338542.018833:0:6686:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787338542.018835:0:6686:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787338542.018836:0:6686:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787338542.018837:0:6686:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787338542.018839:0:6686:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787338542.018843:0:6686:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:3.0:1787338542.018845:0:6686:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787338542.018846:0:6686:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787338542.018847:0:6686:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787338542.018848:0:6686:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787338542.018849:0:6686:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787338542.018850:0:6686:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787338542.018851:0:6686:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787338542.018852:0:6686:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787338542.018853:0:6686:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787338542.018854:0:6686:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787338542.018855:0:6686:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787338542.018869:0:6686:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1787338542.018916:0:6686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee562d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d79243c8-b367-45ff-8d76-fbaa4be8becb:6686:1874160211993088:0@lo:253: 00000100:00100000:3.0:1787338542.018951:0:6686:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338542.018975:0:6686:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbd0cd70c0 going to sleep for 11 seconds 00010000:00080000:2.0:1787338542.020500:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff90bbed9cb480 x1874160211992960/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787338558 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787338542.020514:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbed9cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874160211992960:0@lo:400: 00000100:00100000:1.0:1787338542.020985:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211993088 00000100:00100000:1.0:1787338542.020994:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211993088 00000100:00100000:1.0:1787338542.021058:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787338542.021068:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4013050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+13:6686:x1874160211993088:12345-0@lo:253: 20000000:01000000:1.0:1787338542.021101:0:5832:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1787338542.021115:0:5832:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787338542.061808:0:5832:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787338542.061833:0:5832:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1787338542.061896:0:5855:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787338542.061901:0:5855:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787338542.061927:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90bbc14a9e00/0x83671231080c1287 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338542.061967:0:5855:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90bc02044a00/0x83671231080c11e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c11df expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338542.061976:0:5855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90bbc14a9e00/0x83671231080c1287 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338542.062027:0:5855:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90bc02044a00/0x83671231080c11e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x83671231080c11df expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338542.062043:0:5855:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90bc02044a00/0x83671231080c11e6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x83671231080c11df expref: 13 pid: 5833 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338542.062058:0:5855:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee562680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5855:1874160211993216:0@lo:104: 00000100:00100000:3.0:1787338542.062139:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338542.062476:0:5855:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbd0cd7900 going to sleep for 11 seconds 00000100:00100000:0.0:1787338542.065488:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211993216 00000100:00100000:0.0:1787338542.065503:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211993216 00000100:00100000:0.0:1787338542.065564:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787338542.065577:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee560700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d79243c8-b367-45ff-8d76-fbaa4be8becb+3:5855:x1874160211993216:12345-0@lo:104: 00010000:00010000:0.0:1787338542.065597:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.153@tcp lock: ffff90bbc0031400/0x83671231080c11df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x83671231080c11e6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338542.065724:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787338542.065730:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee560700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d79243c8-b367-45ff-8d76-fbaa4be8becb+3:5855:x1874160211993216:12345-0@lo:104: Request processed in 156us (3591us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338542.065737:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1787338542.065761:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787338542.065767:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.153@tcp lock: ffff90bbc0031400/0x83671231080c11df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x83671231080c11e6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338542.065775:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbc0031400 already unused, calling callback (ffffffffc1b2ec20) 10000000:00010000:0.0:1787338542.065780:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.153@tcp lock: ffff90bbc0031400/0x83671231080c11df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x83671231080c11e6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338542.065789:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.153@tcp lock: ffff90bbc0031400/0x83671231080c11df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x83671231080c11e6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787338542.065796:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.153@tcp lock: ffff90bbc0031400/0x83671231080c11df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x83671231080c11e6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787338542.065802:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787338542.065837:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.153@tcp lock: ffff90bbc0031400/0x83671231080c11df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c11e6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338542.065844:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787338542.065863:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.153@tcp lock: ffff90bbc0031400/0x83671231080c11df lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c11e6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338542.065870:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.153@tcp lock: ffff90bbc0031400/0x83671231080c11df lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c11e6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338542.065919:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787338542.065921:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787338542.065923:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787338542.065945:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbed9c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d79243c8-b367-45ff-8d76-fbaa4be8becb:3315:1874160211993344:0@lo:103: 00000100:00100000:0.0:1787338542.065989:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338542.066037:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211993344 00000100:00100000:0.0:1787338542.066041:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211993344 00010000:00010000:0.0:1787338542.066058:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90bc02044a00/0x83671231080c11e6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x83671231080c11df expref: 14 pid: 5833 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338542.066080:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787338542.066086:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc7c22050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d79243c8-b367-45ff-8d76-fbaa4be8becb+14:3315:x1874160211993344:12345-0@lo:103: 00010000:00010000:0.0:1787338542.066097:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787338542.066102:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90bc02044a00/0x83671231080c11e6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x83671231080c11df expref: 14 pid: 5833 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338542.066113:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90bc02044a00/0x83671231080c11e6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x83671231080c11df expref: 14 pid: 5833 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338542.066133:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90bbc14a9e00/0x83671231080c1287 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338542.066141:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bbc14a9e00/0x83671231080c1287 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787338542.066156:0:5824:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004255546s 00010000:00010000:0.0:1787338542.066161:0:5824:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90bbc14a9e00/0x83671231080c1287 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338542.066176:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90bbc14a9e00/0x83671231080c1287 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338542.066182:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90bbc14a9e00/0x83671231080c1287 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338542.066188:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90bbc14a9e00/0x83671231080c1287 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338542.066193:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbc14a9e00 already unused, calling callback (ffffffffc1546230) 00010000:00010000:0.0:1787338542.066197:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90bbc14a9e00/0x83671231080c1287 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338542.066319:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90bc02044a00/0x83671231080c11e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x83671231080c11df expref: 14 pid: 5833 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338542.066331:0:5855:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee562680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5855:1874160211993216:0@lo:104: 00010000:00010000:2.0:1787338542.066352:0:5855:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90bbc14a9e00/0x83671231080c1287 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338542.066362:0:5855:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: MGS lock: ffff90bbc14a9e00/0x83671231080c1287 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338542.066368:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90bbc14a9e00/0x83671231080c1287 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338542.066452:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90bbc14a9e00/0x83671231080c1287 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338542.066462:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90bbc14a9e00/0x83671231080c1287 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338542.066469:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90bbc14a9e00/0x83671231080c1287 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338542.066480:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787338542.066525:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc7c22050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d79243c8-b367-45ff-8d76-fbaa4be8becb+13:3315:x1874160211993344:12345-0@lo:103: Request processed in 438us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338542.066532:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787338542.066629:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbed9c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d79243c8-b367-45ff-8d76-fbaa4be8becb:3315:1874160211993344:0@lo:103: 00000100:00100000:2.0:1787338542.071803:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4013050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+12:6686:x1874160211993088:12345-0@lo:253: Request processed in 50723us (52837us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338542.071819:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787338542.071939:0:6686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee562d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d79243c8-b367-45ff-8d76-fbaa4be8becb:6686:1874160211993088:0@lo:253: 10000000:01000000:0.0:1787338542.071955:0:6686:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1787338542.071958:0:6686:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787338542.071975:0:6686:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787338542.071976:0:6686:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787338542.071977:0:6686:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787338542.071978:0:6686:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787338542.071981:0:6686:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787338542.071982:0:6686:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787338542.071984:0:6686:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787338542.071985:0:6686:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787338542.071987:0:6686:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787338542.071988:0:6686:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787338542.072006:0:6686:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1787338542.080130:0:6686:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1787338542.080315:0:6686:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1787338542.080513:0:6686:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1787338542.080725:0:6686:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1787338542.080958:0:6686:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1787338542.081202:0:6686:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1787338542.083025:0:6686:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1787338542.390441:0:6686:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1787338542.390450:0:6686:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1787338542.390485:0:6686:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787338542.390540:0:6686:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.153@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787338542.390557:0:6686:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1787338542.390583:0:6686:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1787338542.778703:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787338543.805328:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787338544.826201:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787338545.846281:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787338546.873259:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787338547.335858:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee563100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d79243c8-b367-45ff-8d76-fbaa4be8becb:3316:1874160211993472:0@lo:400: 00000100:00100000:3.0:1787338547.335961:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338547.336016:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787338547.336023:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee562300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874160211993600:0@lo:400: 00000100:00100000:3.0:1787338547.336054:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338547.336122:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee562a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1874160211993728:0@lo:400: 00000100:00100000:3.0:1787338547.336148:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338547.336395:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211993472 00000100:00100000:3.0:1787338547.336402:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211993472 00000100:00100000:3.0:1787338547.336445:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787338547.336454:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4012850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+12:3316:x1874160211993472:12345-0@lo:400: 00000100:00100000:3.0:1787338547.336502:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4012850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+12:3316:x1874160211993472:12345-0@lo:400: Request processed in 49us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338547.336522:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787338547.336568:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211993600 00000100:00100000:3.0:1787338547.336572:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211993600 00000100:00100000:3.0:1787338547.338338:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211993728 00000100:00100000:3.0:1787338547.338348:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211993728 00000100:00100000:3.0:1787338547.338383:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787338547.338391:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee561500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874160211993600:12345-0@lo:400: 00000100:00100000:3.0:1787338547.338453:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee561500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874160211993600:12345-0@lo:400: Request processed in 63us (2398us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338547.338460:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787338547.338475:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787338547.338481:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee560e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874160211993728:12345-0@lo:400: 00000100:00100000:3.0:1787338547.338517:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee560e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874160211993728:12345-0@lo:400: Request processed in 36us (2367us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338547.338522:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1787338547.338579:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90bbee562300 x1874160211993600/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787338563 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787338547.338802:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787338547.340369:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee562300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874160211993600:0@lo:400: 00000100:00100000:3.0:1787338547.340393:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee563100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d79243c8-b367-45ff-8d76-fbaa4be8becb:3316:1874160211993472:0@lo:400: 00010000:00080000:3.0:1787338547.340450:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90bbee562a00 x1874160211993728/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787338563 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787338547.340460:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee562a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1874160211993728:0@lo:400: 00010000:00010000:0.0:1787338547.899591:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787338548.929626:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787338549.891565:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787338549.891573:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90bbd0622000 from 21 10000000:01000000:2.0:1787338549.891579:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787338549.891636:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bc021c9200/0x83671231080c128e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338549.891649:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.153@tcp lock: ffff90bc021c9200/0x83671231080c128e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338549.891661:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.153@tcp lock: ffff90bc021c9200/0x83671231080c128e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338549.891688:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc91df800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160211993856:0@lo:101: 00000100:00100000:2.0:1787338549.891953:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338549.892031:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211993856 00000100:00100000:2.0:1787338549.892038:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211993856 00000100:00100000:2.0:1787338549.892092:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787338549.892102:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4013c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+12:5836:x1874160211993856:12345-0@lo:101: 00010000:00010000:2.0:1787338549.892114:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787338549.892141:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90bc021c8800/0x83671231080c1295 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x83671231080c128e expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338549.892164:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bc021c8800/0x83671231080c1295 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x83671231080c128e expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338549.892175:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90bc021c8800/0x83671231080c1295 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c128e expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338549.892184:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bc021c8800, rc 0) 00000100:00100000:2.0:1787338549.892218:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4013c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+13:5836:x1874160211993856:12345-0@lo:101: Request processed in 117us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338549.892225:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787338549.896018:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc3287900 going to sleep for 11 seconds 00000100:00100000:2.0:1787338549.896070:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc91df800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160211993856:0@lo:101: 00010000:00010000:2.0:1787338549.896097:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.153@tcp lock: ffff90bc021c9200/0x83671231080c128e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c1295 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338549.896111:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.153@tcp lock: ffff90bc021c9200/0x83671231080c128e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x83671231080c1295 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338549.896218:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc91df800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160211993984:0@lo:501: 00000100:00100000:2.0:1787338549.898380:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338549.898425:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc3287900 going to sleep for 11 seconds 00000100:00100000:3.0:1787338549.899420:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211993984 00000100:00100000:3.0:1787338549.899430:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211993984 00000100:00100000:3.0:1787338549.899525:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787338549.899545:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4011850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+13:5836:x1874160211993984:12345-0@lo:501: 00000100:00100000:3.0:1787338549.900042:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4011850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+13:5836:x1874160211993984:12345-0@lo:501: Request processed in 499us (1666us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338549.900050:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787338549.901068:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc91df800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160211993984:0@lo:501: 00000100:00100000:2.0:1787338549.901117:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc91df800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160211994112:0@lo:503: 00000100:00100000:2.0:1787338549.901169:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338549.901208:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc3287900 going to sleep for 11 seconds 00000100:00100000:0.0:1787338549.901947:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211994112 00000100:00100000:0.0:1787338549.901955:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211994112 00000100:00100000:0.0:1787338549.902016:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787338549.902026:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4013850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+13:5836:x1874160211994112:12345-0@lo:503: 00000100:00100000:0.0:1787338549.904207:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4013850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+13:5836:x1874160211994112:12345-0@lo:503: Request processed in 2175us (3029us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338549.904221:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787338549.905005:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc91df800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160211994112:0@lo:503: 00000100:00100000:1.0:1787338549.906200:0:7041:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee44ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d79243c8-b367-45ff-8d76-fbaa4be8becb:7041:1874160211994240:0@lo:502: 00000100:00100000:1.0:1787338549.906335:0:7041:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338549.906376:0:7041:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc411c000 going to sleep for 11 seconds 00000100:00100000:3.0:1787338549.906860:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211994240 00000100:00100000:3.0:1787338549.906868:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211994240 00000100:00100000:3.0:1787338549.906942:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787338549.906952:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4010c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+13:7041:x1874160211994240:12345-0@lo:502: 00000100:00100000:3.0:1787338549.908359:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4010c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+13:7041:x1874160211994240:12345-0@lo:502: Request processed in 1403us (2019us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338549.908370:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787338549.908909:0:7041:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee44ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d79243c8-b367-45ff-8d76-fbaa4be8becb:7041:1874160211994240:0@lo:502: 00000100:00100000:0.0:1787338549.908979:0:7041:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbed9cbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d79243c8-b367-45ff-8d76-fbaa4be8becb:7041:1874160211994368:0@lo:502: 00000100:00100000:0.0:1787338549.909029:0:7041:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338549.909069:0:7041:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbd0cea540 going to sleep for 11 seconds 00000100:00100000:1.0:1787338549.909329:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211994368 00000100:00100000:1.0:1787338549.909336:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211994368 00000100:00100000:1.0:1787338549.909383:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787338549.909393:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4011c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+13:7041:x1874160211994368:12345-0@lo:502: 00000100:00100000:1.0:1787338549.909608:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4011c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+13:7041:x1874160211994368:12345-0@lo:502: Request processed in 216us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338549.909621:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787338549.909716:0:7041:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbed9cbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d79243c8-b367-45ff-8d76-fbaa4be8becb:7041:1874160211994368:0@lo:502: 00000040:00080000:0.0:1787338549.909742:0:7041:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:1.0:1787338549.910949:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:1.0:1787338549.910974:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787338549.910986:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bc021c9200/0x83671231080c128e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c1295 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338549.910998:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.153@tcp lock: ffff90bc021c9200/0x83671231080c128e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c1295 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787338549.911008:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787338549.911010:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90bbd0622000 from 4 10000000:01000000:1.0:1787338549.911013:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787338549.911048:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bc02045800/0x83671231080c129c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338549.911056:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.153@tcp lock: ffff90bc02045800/0x83671231080c129c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338549.911066:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.153@tcp lock: ffff90bc02045800/0x83671231080c129c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338549.911085:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee44ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160211994496:0@lo:101: 00000100:00100000:1.0:1787338549.911134:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338549.911779:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc411c000 going to sleep for 11 seconds 00000100:00100000:3.0:1787338549.919351:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211994496 00000100:00100000:3.0:1787338549.919367:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211994496 00000100:00100000:3.0:1787338549.919415:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787338549.919424:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4011450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+13:5836:x1874160211994496:12345-0@lo:101: 00010000:00010000:3.0:1787338549.919440:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787338549.919457:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90bbc14a8200/0x83671231080c12a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x83671231080c129c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338549.919482:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bbc14a8200/0x83671231080c12a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x83671231080c129c expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338549.919491:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90bbc14a8200/0x83671231080c12a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c129c expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338549.919511:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbc14a8200, rc 0) 00000100:00100000:3.0:1787338549.919679:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4011450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+14:5836:x1874160211994496:12345-0@lo:101: Request processed in 256us (8544us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338549.919700:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787338549.920920:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee44ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160211994496:0@lo:101: 00010000:00010000:0.0:1787338549.920948:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.153@tcp lock: ffff90bc02045800/0x83671231080c129c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c12a3 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338549.920960:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.153@tcp lock: ffff90bc02045800/0x83671231080c129c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x83671231080c12a3 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338549.927622:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee562a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160211994624:0@lo:256: 00000100:00100000:3.0:1787338549.927700:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338549.927776:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbf42ddf00 going to sleep for 11 seconds 00000100:00100000:2.0:1787338549.928058:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211994624 00000100:00100000:2.0:1787338549.928067:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211994624 00000100:00100000:2.0:1787338549.928108:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787338549.928116:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc414f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+14:5836:x1874160211994624:12345-0@lo:256: 20000000:01000000:2.0:1787338549.928135:0:5833:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787338549.928150:0:5833:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787338549.928153:0:5833:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1787338549.928228:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc414f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+14:5836:x1874160211994624:12345-0@lo:256: Request processed in 112us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338549.928247:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787338549.928380:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee562a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160211994624:0@lo:256: 10000000:01000000:3.0:1787338549.928426:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.153@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787338549.928435:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bc02045800/0x83671231080c129c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c12a3 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338549.928446:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.153@tcp lock: ffff90bc02045800/0x83671231080c129c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c12a3 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787338549.928455:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1787338549.928457:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:3.0:1787338549.928460:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787338549.928482:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbc14a9e00/0x83671231080c12aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338549.928489:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.153@tcp lock: ffff90bbc14a9e00/0x83671231080c12aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338549.928510:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.153@tcp lock: ffff90bbc14a9e00/0x83671231080c12aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338549.928521:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee562a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160211994752:0@lo:101: 00000100:00100000:3.0:1787338549.928544:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338549.928572:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbf42ddf00 going to sleep for 11 seconds 00000100:00100000:2.0:1787338549.928613:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211994752 00000100:00100000:2.0:1787338549.928618:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211994752 00000100:00100000:2.0:1787338549.928644:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787338549.928650:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc414e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+14:5836:x1874160211994752:12345-0@lo:101: 00010000:00010000:2.0:1787338549.928663:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787338549.928675:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90bc021c8a00/0x83671231080c12b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x83671231080c12aa expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338549.928694:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bc021c8a00/0x83671231080c12b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x83671231080c12aa expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338549.928703:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90bc021c8a00/0x83671231080c12b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c12aa expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338549.928834:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bc021c8a00, rc 0) 00000100:00100000:2.0:1787338549.928862:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc414e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+15:5836:x1874160211994752:12345-0@lo:101: Request processed in 212us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338549.928868:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787338549.929022:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee562a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160211994752:0@lo:101: 00010000:00010000:3.0:1787338549.929041:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.153@tcp lock: ffff90bbc14a9e00/0x83671231080c12aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c12b1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338549.929048:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.153@tcp lock: ffff90bbc14a9e00/0x83671231080c12aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x83671231080c12b1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338549.929094:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee562a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160211994880:0@lo:501: 00000100:00100000:3.0:1787338549.929120:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338549.929149:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbf42ddf00 going to sleep for 11 seconds 00000100:00100000:2.0:1787338549.929201:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211994880 00000100:00100000:2.0:1787338549.929206:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211994880 00000100:00100000:3.0:1787338549.929319:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787338549.929328:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc414fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+15:5836:x1874160211994880:12345-0@lo:501: 00000100:00100000:3.0:1787338549.929577:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc414fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+15:5836:x1874160211994880:12345-0@lo:501: Request processed in 250us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338549.929584:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787338549.929655:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee562a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160211994880:0@lo:501: 00000100:00100000:0.0:1787338549.929684:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbed9cbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160211995008:0@lo:503: 00000100:00100000:0.0:1787338549.929864:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338549.929907:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbd0cea540 going to sleep for 11 seconds 00000100:00100000:2.0:1787338549.929960:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211995008 00000100:00100000:2.0:1787338549.929966:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211995008 00000100:00100000:2.0:1787338549.929997:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787338549.930005:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc414d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+15:5836:x1874160211995008:12345-0@lo:503: 00000100:00100000:2.0:1787338549.930340:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc414d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+15:5836:x1874160211995008:12345-0@lo:503: Request processed in 335us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338549.930347:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787338549.930420:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbed9cbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160211995008:0@lo:503: 00000100:00100000:2.0:1787338549.941605:0:7042:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc91ded80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d79243c8-b367-45ff-8d76-fbaa4be8becb:7042:1874160211995136:0@lo:502: 00000100:00100000:2.0:1787338549.941693:0:7042:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338549.943657:0:7042:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc3287840 going to sleep for 11 seconds 00000100:00100000:0.0:1787338549.956383:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211995136 00000100:00100000:0.0:1787338549.956403:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211995136 00010000:00010000:0.0:1787338549.956521:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787338549.957034:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787338549.957045:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc414f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+15:7042:x1874160211995136:12345-0@lo:502: 00000100:00100000:2.0:1787338549.957386:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc414f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+15:7042:x1874160211995136:12345-0@lo:502: Request processed in 342us (15692us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338549.957395:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787338549.957446:0:7042:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc91ded80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d79243c8-b367-45ff-8d76-fbaa4be8becb:7042:1874160211995136:0@lo:502: 00000020:01000000:2.0:1787338549.957478:0:7042:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787338549.957485:0:7042:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1787338549.957492:0:7042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787338549.957494:0:7042:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1787338549.957512:0:7042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787338549.957516:0:7042:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.153@tcp to nid 0x20000c0a8c999 (192.168.201.153@tcp) 00000020:01000000:2.0:1787338549.957536:0:7042:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787338549.957539:0:7042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787338549.957551:0:7042:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff90bbee0acd28) 00000020:00000080:2.0:1787338549.957571:0:7042:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:2.0:1787338549.957575:0:7042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787338549.957662:0:7042:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1787338549.957667:0:7042:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:2.0:1787338549.957696:0:7042:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x83671231080c12bf 00010000:00080000:2.0:1787338549.957935:0:7042:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90bbc40f0800@lustre-OST0000-osc-MDT0000: add connection 192.168.201.153@tcp at head 00010000:00010000:2.0:1787338549.958144:0:7042:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1787338550.036935:0:7042:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1787338550.036957:0:7042:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1787338550.037779:0:7042:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787338550.037987:0:7042:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787338550.038034:0:7042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1787338550.039593:0:7042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1787338550.046670:0:7054:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787338550.046680:0:7054:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1787338550.059179:0:7042:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787338550.059194:0:7042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787338550.059244:0:7042:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1787338550.059265:0:7042:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x83671231080c12c6 00000100:00080000:0.0:1787338550.059407:0:7042:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787338550.059419:0:7042:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff90bbc40f0800 using connection 192.168.201.153@tcp/0@lo 00000100:00100000:0.0:1787338550.059453:0:7042:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90bbed9cbb80 x1874160211995264/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787338550.059523:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbed9cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1874160211995264:0@lo:8: 00000100:00100000:3.0:1787338550.059598:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787338550.059672:0:7042:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1787338550.059739:0:7042:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787338550.059743:0:7042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787338550.059745:0:7042:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1787338550.059748:0:7042:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787338550.059751:0:7042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787338550.059753:0:7042:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787338550.059756:0:7042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787338550.059758:0:7042:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1787338550.059784:0:7042:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbed9c8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d79243c8-b367-45ff-8d76-fbaa4be8becb:7042:1874160211995392:0@lo:502: 00000100:00100000:0.0:1787338550.059828:0:7042:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338550.059846:0:7042:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbd0cea0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787338550.059998:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211995264 00000100:00100000:1.0:1787338550.060007:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211995264 00000100:00100000:1.0:1787338550.060038:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787338550.060046:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee563100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3313:x1874160211995264:12345-0@lo:8: 00010000:00080000:1.0:1787338550.060078:0:6689:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 202 last 0 00000020:00000080:1.0:1787338550.060106:0:6689:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x83671231080c12cd 00002000:00100000:1.0:1787338550.060135:0:6689:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff90bbffa91000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211392c ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1787338550.060139:0:6689:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:1.0:1787338550.060142:0:6689:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1787338550.060266:0:6689:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787338550.060411:0:6689:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787338550.060434:0:6689:0:(import.c:65:import_set_state_nolock()) ffff90bbffa93000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787338550.060812:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee563100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3313:x1874160211995264:12345-0@lo:8: Request processed in 765us (1212us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338550.060821:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787338550.060933:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90bbed9cbb80 x1874160211995264/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787338560 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787338550.060945:0:3313:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787338550.060953:0:3313:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1787338550.060959:0:3313:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787338550.060964:0:3313:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1787338550.060966:0:3313:0:(import.c:65:import_set_state_nolock()) ffff90bbc40f0800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787338550.061023:0:3313:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787338550.061036:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbed9cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1874160211995264:0@lo:8: 00000100:00100000:3.0:1787338550.061075:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211995392 00000100:00100000:3.0:1787338550.061081:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211995392 00000100:00100000:3.0:1787338550.061121:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787338550.061129:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc414cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+15:7042:x1874160211995392:12345-0@lo:502: 00000100:00100000:3.0:1787338550.061778:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc414cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+15:7042:x1874160211995392:12345-0@lo:502: Request processed in 647us (1947us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338550.061785:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787338550.061833:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbed9c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874160211995520:0@lo:400: 00000100:00100000:3.0:1787338550.061921:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338550.061979:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbed9ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874160211995648:0@lo:400: 00000100:00100000:3.0:1787338550.062004:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338550.062045:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211995520 00000100:00100000:3.0:1787338550.062050:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211995520 00000100:00100000:3.0:1787338550.062087:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211995648 00000100:00100000:3.0:1787338550.062091:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211995648 00000100:00100000:3.0:1787338550.062111:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787338550.062117:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee562300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874160211995520:12345-0@lo:400: 00000100:00100000:3.0:1787338550.062153:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee562300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874160211995520:12345-0@lo:400: Request processed in 36us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338550.062158:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787338550.062170:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787338550.062175:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee560000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874160211995648:12345-0@lo:400: 00000100:00100000:3.0:1787338550.062202:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee560000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874160211995648:12345-0@lo:400: Request processed in 27us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338550.062207:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1787338550.062234:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90bbed9ca680 x1874160211995648/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787338566 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787338550.062262:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbed9ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874160211995648:0@lo:400: 00000100:00080000:1.0:1787338550.062364:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787338550.062385:0:7042:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbed9c8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d79243c8-b367-45ff-8d76-fbaa4be8becb:7042:1874160211995392:0@lo:502: 00000020:01000000:1.0:1787338550.062408:0:7042:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787338550.062414:0:7042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787338550.062416:0:7042:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787338550.062420:0:7042:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:1.0:1787338550.062533:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1787338550.062557:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.153@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787338550.062565:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbc14a9e00/0x83671231080c12aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c12b1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338550.062575:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.153@tcp lock: ffff90bbc14a9e00/0x83671231080c12aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c12b1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787338550.062583:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1787338550.062586:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff90bbde3e99b8 from 1 10000000:01000000:1.0:1787338550.062589:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787338550.062613:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bc02044a00/0x83671231080c12d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338550.062629:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.153@tcp lock: ffff90bc02044a00/0x83671231080c12d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338550.062637:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.153@tcp lock: ffff90bc02044a00/0x83671231080c12d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338550.062649:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee44c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160211995776:0@lo:101: 00000100:00100000:1.0:1787338550.062677:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338550.062695:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbde5eaa80 going to sleep for 11 seconds 00010000:00080000:3.0:1787338550.062836:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90bbed9c8380 x1874160211995520/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787338566 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787338550.062844:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbed9c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874160211995520:0@lo:400: 00000100:00100000:2.0:1787338550.063264:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211995776 00000100:00100000:2.0:1787338550.063269:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211995776 00000100:00100000:2.0:1787338550.063298:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787338550.063306:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbde804050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+15:5836:x1874160211995776:12345-0@lo:101: 00010000:00010000:2.0:1787338550.063315:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787338550.063327:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90bc021c8c00/0x83671231080c12db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x83671231080c12d4 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338550.063361:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bc021c8c00/0x83671231080c12db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x83671231080c12d4 expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338550.063372:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90bc021c8c00/0x83671231080c12db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c12d4 expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338550.063381:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bc021c8c00, rc 0) 00000100:00100000:2.0:1787338550.063424:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbde804050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+16:5836:x1874160211995776:12345-0@lo:101: Request processed in 119us (746us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338550.063429:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787338550.064778:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee44c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160211995776:0@lo:101: 00010000:00010000:1.0:1787338550.064800:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.153@tcp lock: ffff90bc02044a00/0x83671231080c12d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c12db expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338550.064810:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.153@tcp lock: ffff90bc02044a00/0x83671231080c12d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x83671231080c12db expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338550.064870:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee44c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160211995904:0@lo:501: 00000100:00100000:1.0:1787338550.064924:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338550.064955:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbde5eaa80 going to sleep for 11 seconds 00000100:00100000:1.0:1787338550.064971:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211995904 00000100:00100000:1.0:1787338550.064976:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211995904 00000100:00100000:1.0:1787338550.065008:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787338550.065015:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbde804450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+16:5836:x1874160211995904:12345-0@lo:501: 00000100:00100000:1.0:1787338550.065222:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbde804450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+16:5836:x1874160211995904:12345-0@lo:501: Request processed in 206us (297us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787338550.066694:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787338550.066947:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee44c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160211995904:0@lo:501: 10000000:01000000:1.0:1787338550.066979:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.153@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787338550.066988:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bc02044a00/0x83671231080c12d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c12db expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338550.066997:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.153@tcp lock: ffff90bc02044a00/0x83671231080c12d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c12db expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787338550.067632:0:7054:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787338550.067915:0:7054:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 202909040622ns, next at 0ns, rc = 0 00000001:02000400:2.0:1787338550.095317:0:7059:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg153-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000004:00080000:3.0:1787338550.130770:0:7058:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:3.0:1787338550.130806:0:7058:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee562a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7058:1874160211996160:0@lo:7: 00000100:00100000:3.0:1787338550.130899:0:7058:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338550.130943:0:7058:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbf42ddb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787338550.130985:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee561c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874160211996032:0@lo:13: 00000100:00100000:3.0:1787338550.131012:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338550.131055:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211996160 00000100:00100000:3.0:1787338550.131074:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211996160 00000100:00100000:3.0:1787338550.131136:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787338550.131145:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee562d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7058:x1874160211996160:12345-0@lo:7: 00000100:00080000:2.0:1787338550.131327:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787338550.137579:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211996032 00000100:00100000:2.0:1787338550.137592:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211996032 00000100:00100000:2.0:1787338550.137644:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787338550.137653:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee563b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3317:x1874160211996032:12345-0@lo:13: 00002000:00000024:2.0:1787338550.137684:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:2.0:1787338550.137895:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee563b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3317:x1874160211996032:12345-0@lo:13: Request processed in 242us (6881us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338550.137903:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787338550.138289:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90bbee561c00 x1874160211996032/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787338566 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787338550.138311:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee561c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874160211996032:0@lo:13: 00002000:00080000:3.0:1787338550.158792:0:6691:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:3.0:1787338550.158802:0:6691:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:3.0:1787338550.158925:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee562d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7058:x1874160211996160:12345-0@lo:7: Request processed in 27776us (28021us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338550.158935:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787338550.159046:0:7058:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90bbee562a00 x1874160211996160/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787338566 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787338550.159062:0:7058:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee562a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7058:1874160211996160:0@lo:7: 00000004:00080000:1.0:1787338550.159075:0:7058:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:1.0:1787338550.159119:0:7058:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee44c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7058:1874160211996288:0@lo:5: 00000100:00100000:1.0:1787338550.159154:0:7058:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338550.159205:0:7058:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbd0cea900 going to sleep for 11 seconds 00000100:00100000:3.0:1787338550.159712:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211996288 00000100:00100000:3.0:1787338550.159720:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211996288 00000100:00100000:3.0:1787338550.159771:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787338550.159780:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee44d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7058:x1874160211996288:12345-0@lo:5: 00002000:00080000:3.0:1787338550.159808:0:6689:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1787338550.159812:0:6689:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1787338550.161776:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee44d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:7058:x1874160211996288:12345-0@lo:5: Request processed in 1989us (2614us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1787338550.161787:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787338550.163904:0:7058:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90bbee44c380 x1874160211996288/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787338566 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787338550.163925:0:7058:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee44c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7058:1874160211996288:0@lo:5: 00000004:00080000:1.0:1787338550.163949:0:7058:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:1.0:1787338550.163989:0:7058:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee44f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7058:1874160211996416:0@lo:700: 00000100:00100000:1.0:1787338550.164037:0:7058:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338550.164073:0:7058:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbd19ba480 going to sleep for 11 seconds 00000100:00100000:3.0:1787338550.166702:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211996416 00000100:00100000:3.0:1787338550.166717:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211996416 00000100:00100000:3.0:1787338550.166774:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787338550.166784:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee44d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7058:x1874160211996416:12345-0@lo:700: 00000100:00100000:3.0:1787338550.166839:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee563480 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6697:1874160211996544:0@lo:700: 00000100:00100000:3.0:1787338550.170660:0:6697:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338550.170713:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbf42dd9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787338550.183954:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211996544 00000100:00100000:0.0:1787338550.183969:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211996544 00000100:00100000:0.0:1787338550.184015:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787338550.184025:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee562680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6697:x1874160211996544:12345-0@lo:700: 00000004:00080000:3.0:1787338550.211164:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 40000000:02000000:1.0:1787338550.283583:0:5846:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:0.0:1787338550.298996:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee562680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6697:x1874160211996544:12345-0@lo:700: Request processed in 114961us (128331us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338550.299011:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787338550.305643:0:6697:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90bbee563480 x1874160211996544/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787338566 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787338550.305695:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee563480 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6697:1874160211996544:0@lo:700: 40000000:02000000:1.0:1787338550.305711:0:6697:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00100000:2.0:1787338550.437330:0:6714:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1787338550.437347:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000100:00100000:0.0:1787338550.438049:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee44d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7058:x1874160211996416:12345-0@lo:700: Request processed in 271259us (274004us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338550.438148:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787338550.438256:0:7058:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90bbee44f480 x1874160211996416/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787338566 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787338550.438293:0:7058:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1787338550.438317:0:7058:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee44f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7058:1874160211996416:0@lo:700: 00000004:02000040:0.0:1787338550.489286:0:7058:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:0.0:1787338550.503744:0:7058:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbed9c8700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7058:1874160211996672:0@lo:5: 00000100:00100000:0.0:1787338550.503825:0:7058:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338550.503998:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211996672 00000100:00100000:1.0:1787338550.504007:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211996672 00000100:00100000:1.0:1787338550.504057:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787338550.504066:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbed9c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:7058:x1874160211996672:12345-0@lo:5: 00000100:00100000:0.0:1787338550.506262:0:7058:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbd0cd7b40 going to sleep for 11 seconds 00002000:00080000:1.0:1787338550.521724:0:6691:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1787338550.521746:0:6691:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:1.0:1787338550.527339:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbed9c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7058:x1874160211996672:12345-0@lo:5: Request processed in 23266us (23506us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1787338550.527351:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1787338550.535483:0:7058:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90bbed9c8700 x1874160211996672/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787338566 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787338550.535517:0:7058:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbed9c8700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7058:1874160211996672:0@lo:5: 00000004:00080000:1.0:1787338550.535533:0:7058:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:2.0:1787338550.966151:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787338551.990459:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787338553.014111:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787338554.037968:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338555.063155:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787338555.510336:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc91ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d79243c8-b367-45ff-8d76-fbaa4be8becb:3314:1874160211996800:0@lo:400: 00000100:00100000:2.0:1787338555.510419:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338555.510468:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787338555.510473:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc91dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874160211996928:0@lo:400: 00000100:00100000:2.0:1787338555.510494:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338555.510517:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc91dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874160211997056:0@lo:400: 00000100:00100000:2.0:1787338555.510541:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338555.510555:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787338555.510558:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc91dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874160211997184:0@lo:400: 00000100:00100000:2.0:1787338555.510574:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338555.510597:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211996800 00000100:00100000:2.0:1787338555.510602:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211996800 00000100:00100000:2.0:1787338555.510651:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787338555.510660:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbde807450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+16:3314:x1874160211996800:12345-0@lo:400: 00000100:00100000:2.0:1787338555.510702:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbde807450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+16:3314:x1874160211996800:12345-0@lo:400: Request processed in 43us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338555.510710:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787338555.510743:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211996928 00000100:00100000:2.0:1787338555.510748:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211996928 00000100:00100000:2.0:1787338555.510772:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211997056 00000100:00100000:2.0:1787338555.510774:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211997056 00000100:00100000:2.0:1787338555.511065:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787338555.511078:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc91df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874160211996928:12345-0@lo:400: 00000100:00100000:2.0:1787338555.511108:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc91df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874160211996928:12345-0@lo:400: Request processed in 31us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338555.511115:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787338555.511127:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787338555.511134:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc91dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874160211997056:12345-0@lo:400: 00000100:00100000:2.0:1787338555.511167:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc91dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874160211997056:12345-0@lo:400: Request processed in 34us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338555.511173:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787338555.511199:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211997184 00000100:00100000:2.0:1787338555.511203:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211997184 00000100:00100000:2.0:1787338555.511228:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787338555.511234:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc91de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3316:x1874160211997184:12345-0@lo:400: 00000100:00100000:2.0:1787338555.511262:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc91de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3316:x1874160211997184:12345-0@lo:400: Request processed in 29us (687us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338555.511269:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1787338555.511287:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787338555.511291:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787338555.511311:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90bbc91dd180 x1874160211997184/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787338571 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787338555.511322:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc91dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874160211997184:0@lo:400: 00010000:00080000:2.0:1787338555.511329:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90bbc91dc380 x1874160211997056/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787338571 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787338555.511337:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc91dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874160211997056:0@lo:400: 00010000:00080000:2.0:1787338555.511367:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90bbc91dca80 x1874160211996928/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787338571 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787338555.511387:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc91dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874160211996928:0@lo:400: 00000100:00100000:2.0:1787338555.511397:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc91ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d79243c8-b367-45ff-8d76-fbaa4be8becb:3314:1874160211996800:0@lo:400: 00000100:00100000:1.0:1787338555.511517:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787338555.511527:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee44f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874160211997312:0@lo:13: 00000100:00100000:1.0:1787338555.511557:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338555.511588:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211997312 00000100:00100000:1.0:1787338555.511593:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211997312 00000100:00100000:1.0:1787338555.511633:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787338555.511642:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee44c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1874160211997312:12345-0@lo:13: 00002000:00000024:1.0:1787338555.511669:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787338555.511703:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee44c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1874160211997312:12345-0@lo:13: Request processed in 63us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338555.511715:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787338555.511743:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90bbee44f480 x1874160211997312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787338571 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787338555.511757:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee44f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874160211997312:0@lo:13: 00000001:00080000:0.0:1787338555.633672:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:0.0:1787338556.091516:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338557.123153:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787338558.135006:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787338559.171776:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787338560.182953:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787338560.630257:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee44f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d79243c8-b367-45ff-8d76-fbaa4be8becb:3315:1874160211997440:0@lo:400: 00000100:00100000:1.0:1787338560.630351:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338560.630370:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee44ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874160211997568:0@lo:400: 00000100:00100000:2.0:1787338560.630399:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338560.630402:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc91ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874160211997952:0@lo:13: 00000100:00100000:1.0:1787338560.630427:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338560.630447:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787338560.630453:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee44f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874160211997824:0@lo:400: 00000100:00100000:1.0:1787338560.630475:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338560.630493:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787338560.630506:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211997440 00000100:00100000:1.0:1787338560.630521:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211997440 00000100:00100000:1.0:1787338560.630575:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787338560.630585:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbde807050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+16:3315:x1874160211997440:12345-0@lo:400: 00000100:00100000:1.0:1787338560.630639:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbde807050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+16:3315:x1874160211997440:12345-0@lo:400: Request processed in 54us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338560.630646:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787338560.630673:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211997952 00000100:00100000:1.0:1787338560.630678:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211997952 00000100:00100000:1.0:1787338560.630723:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787338560.630730:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee44fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874160211997952:12345-0@lo:13: 00000100:00100000:2.0:1787338560.630741:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee44ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874160211997696:0@lo:400: 00002000:00000024:1.0:1787338560.630756:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787338560.635536:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211997824 00000100:00100000:0.0:1787338560.635563:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211997824 00000100:00100000:0.0:1787338560.635621:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787338560.635631:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee44dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3315:x1874160211997824:12345-0@lo:400: 00000100:00100000:1.0:1787338560.636263:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee44fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1874160211997952:12345-0@lo:13: Request processed in 5531us (5831us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338560.636291:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787338560.636356:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90bbc91ded80 x1874160211997952/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787338576 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787338560.636367:0:3315:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1787338560.636391:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc91ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874160211997952:0@lo:13: 00000100:00100000:1.0:1787338560.636404:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee44f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d79243c8-b367-45ff-8d76-fbaa4be8becb:3315:1874160211997440:0@lo:400: 00000100:00100000:2.0:1787338560.643864:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338560.643963:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211997568 00000100:00100000:2.0:1787338560.643972:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211997568 00000100:00100000:2.0:1787338560.644016:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211997696 00000100:00100000:2.0:1787338560.644018:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211997696 00000100:00100000:2.0:1787338560.644037:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787338560.644045:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc91dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874160211997568:12345-0@lo:400: 00000100:00100000:2.0:1787338560.644097:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc91dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874160211997568:12345-0@lo:400: Request processed in 53us (13697us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338560.644104:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787338560.644120:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787338560.644125:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc91dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874160211997696:12345-0@lo:400: 00000100:00100000:2.0:1787338560.644147:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc91dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874160211997696:12345-0@lo:400: Request processed in 22us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338560.644152:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1787338560.644170:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787338560.644174:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787338560.644206:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90bbee44ed80 x1874160211997696/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787338576 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787338560.644238:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee44ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874160211997696:0@lo:400: 00010000:00080000:2.0:1787338560.644251:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90bbee44ca80 x1874160211997568/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787338576 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787338560.644259:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee44ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874160211997568:0@lo:400: 00010000:00080000:1.0:1787338560.648668:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90bbee44f100 x1874160211997824/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787338576 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787338560.648685:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee44f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874160211997824:0@lo:400: 00000100:00100000:0.0:1787338560.648771:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee44dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1874160211997824:12345-0@lo:400: Request processed in 13138us (18291us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338560.648784:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1787338561.213946:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787338562.244215:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338563.256405:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787338563.839795:0:7634:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787338563.839800:0:7634:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:0.0:1787338563.840311:0:7634:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff90bbff941800 00000020:01000004:0.0:1787338563.840329:0:7634:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1787338563.840345:0:7634:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:0.0:1787338563.840359:0:7634:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff90bbde3e8000) 00000020:00000080:0.0:1787338563.840380:0:7634:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787338563.898168:0:7634:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1787338563.898759:0:7634:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1787338563.995096:0:7634:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:0.0:1787338564.009341:0:7634:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1787338564.009381:0:7634:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:0.0:1787338564.009447:0:7634:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1787338564.009476:0:7634:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:0.0:1787338564.009842:0:7634:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1787338564.009859:0:7634:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787338564.009870:0:7634:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x83671231080c12e9 00000020:01000004:0.0:1787338564.009906:0:7634:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:0.0:1787338564.009929:0:7634:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.153@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1787338564.009933:0:7634:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.153@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1787338564.009938:0:7634:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1787338564.009960:0:7634:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:0.0:1787338564.009964:0:7634:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.153@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1787338564.059544:0:7634:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.153@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787338564.059591:0:7634:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.153@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1787338564.059595:0:7634:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787338564.059597:0:7634:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787338564.059598:0:7634:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787338564.059600:0:7634:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787338564.059601:0:7634:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787338564.059602:0:7634:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787338564.059604:0:7634:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787338564.059605:0:7634:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787338564.059607:0:7634:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787338564.059609:0:7634:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787338564.059610:0:7634:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787338564.059613:0:7634:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1787338564.059615:0:7634:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787338564.059617:0:7634:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787338564.059618:0:7634:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787338564.059619:0:7634:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787338564.059620:0:7634:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787338564.059622:0:7634:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787338564.059623:0:7634:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787338564.059624:0:7634:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787338564.059625:0:7634:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787338564.059626:0:7634:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787338564.059627:0:7634:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787338564.059669:0:7634:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787338564.059689:0:7634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc91dd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d79243c8-b367-45ff-8d76-fbaa4be8becb:7634:1874160211998080:0@lo:253: 00000100:00100000:2.0:1787338564.059767:0:7634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338564.060169:0:7634:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbf41c1c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787338564.065081:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211998080 00000100:00100000:1.0:1787338564.065098:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211998080 00000100:00100000:3.0:1787338564.070427:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787338564.070442:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbde806850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+16:7634:x1874160211998080:12345-0@lo:253: 20000000:01000000:3.0:1787338564.070480:0:5833:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1787338564.070485:0:5833:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:3.0:1787338564.070490:0:5833:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:3.0:1787338564.070494:0:5833:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:3.0:1787338564.071754:0:5833:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787338564.076625:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:3.0:1787338564.076657:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:3.0:1787338564.076725:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:3.0:1787338564.076733:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:3.0:1787338564.076760:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:3.0:1787338564.076806:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:3.0:1787338564.080359:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:3.0:1787338564.080397:0:5833:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.153@tcp 20000000:01000000:3.0:1787338564.080399:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.153@tcp (null) (null) (null) 00000040:00080000:3.0:1787338564.080436:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:3.0:1787338564.080455:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1787338564.080509:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:3.0:1787338564.080517:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.201.153@tcp (null) (null) 00000040:00080000:3.0:1787338564.080547:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:3.0:1787338564.080556:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1787338564.080585:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:3.0:1787338564.080633:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:3.0:1787338564.082405:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:3.0:1787338564.082446:0:5833:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.153@tcp 20000000:01000000:3.0:1787338564.082449:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.153@tcp (null) (null) (null) 00000040:00080000:3.0:1787338564.082512:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:3.0:1787338564.082520:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1787338564.082549:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:3.0:1787338564.082556:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.201.153@tcp (null) (null) 00000040:00080000:3.0:1787338564.082584:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:3.0:1787338564.082593:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1787338564.082638:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:3.0:1787338564.082676:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:3.0:1787338564.082706:0:5833:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:3.0:1787338564.082709:0:5833:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:3.0:1787338564.082716:0:5833:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1787338564.082717:0:5833:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1787338564.082720:0:5833:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1787338564.082734:0:5833:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787338564.082737:0:5833:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1787338564.082778:0:5833:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1787338564.082781:0:5833:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787338564.091337:0:7636:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 14 1->4: lustre sys.timeout 20000000:01000000:0.0:1787338564.091431:0:7636:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 14 2->4: lustre sys.timeout 00000040:00080000:0.0:1787338564.091500:0:7636:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:3.0:1787338564.092154:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:3.0:1787338564.092270:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:3.0:1787338564.092309:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:3.0:1787338564.092323:0:5833:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1787338564.092326:0:5833:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1787338564.094091:0:7637:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:3.0:1787338564.100777:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:3.0:1787338564.100834:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:3.0:1787338564.101199:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:3.0:1787338564.101218:0:5833:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1787338564.101221:0:5833:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787338564.105809:0:7638:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 15 1->4: lustre sys.timeout 20000000:01000000:1.0:1787338564.105929:0:7638:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 15 2->4: lustre sys.timeout 00000040:00080000:1.0:1787338564.105986:0:7638:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:0.0:1787338564.106389:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:0.0:1787338564.106427:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:0.0:1787338564.106481:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:0.0:1787338564.106495:0:5833:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1787338564.106498:0:5833:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787338564.107575:0:7639:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:0.0:1787338564.107653:0:7639:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:0.0:1787338564.107687:0:7639:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:1.0:1787338564.108017:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:1.0:1787338564.108069:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:1.0:1787338564.108123:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 10000000:01000000:1.0:1787338564.108144:0:5833:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1787338564.108163:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90bc02045000/0x83671231080c12f0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338564.108343:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90bbc14a9600/0x83671231080c1241 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c123a expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338564.108363:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90bbc0030800/0x83671231080c126b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c1264 expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338564.108370:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90bc021c8800/0x83671231080c1295 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c128e expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338564.108377:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90bc021c8a00/0x83671231080c12b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c12aa expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338564.108383:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90bc021c8c00/0x83671231080c12db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c12d4 expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338564.108391:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90bc02045000/0x83671231080c12f0 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338564.108431:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90bc021c8c00/0x83671231080c12db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x83671231080c12d4 expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338564.108445:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90bc021c8c00/0x83671231080c12db lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x83671231080c12d4 expref: 16 pid: 5832 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338564.108459:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee44f100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5833:1874160211998208:0@lo:104: 00000100:00100000:1.0:1787338564.108529:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787338564.108631:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90bc021c8a00/0x83671231080c12b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x83671231080c12aa expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338564.108639:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90bc021c8a00/0x83671231080c12b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x83671231080c12aa expref: 16 pid: 5834 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338564.108648:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee44f480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5833:1874160211998336:0@lo:104: 00010000:00010000:1.0:1787338564.108680:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90bc021c8800/0x83671231080c1295 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x83671231080c128e expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338564.108688:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90bc021c8800/0x83671231080c1295 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x83671231080c128e expref: 16 pid: 5832 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338564.108696:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee44df80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5833:1874160211998464:0@lo:104: 00010000:00010000:1.0:1787338564.108716:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90bbc0030800/0x83671231080c126b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x83671231080c1264 expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338564.108723:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90bbc0030800/0x83671231080c126b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x83671231080c1264 expref: 16 pid: 5834 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338564.108730:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee44c000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5833:1874160211998592:0@lo:104: 00010000:00010000:1.0:1787338564.108750:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90bbc14a9600/0x83671231080c1241 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x83671231080c123a expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338564.108758:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90bbc14a9600/0x83671231080c1241 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x83671231080c123a expref: 16 pid: 5833 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338564.108764:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee44c700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5833:1874160211998720:0@lo:104: 00000100:00100000:1.0:1787338564.108779:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbd8e9a300 going to sleep for 11 seconds 00000100:00100000:2.0:1787338564.115066:0:5821:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787338564.115111:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338564.115394:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338564.119128:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338564.119758:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211998208 00000100:00100000:0.0:1787338564.119770:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211998208 00000100:00100000:2.0:1787338564.121754:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338564.121775:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211998336 00000100:00100000:2.0:1787338564.121784:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211998336 00000100:00100000:2.0:1787338564.121830:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211998464 00000100:00100000:2.0:1787338564.121833:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211998464 00000100:00100000:2.0:1787338564.121844:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211998592 00000100:00100000:2.0:1787338564.121846:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211998592 00000100:00100000:2.0:1787338564.121854:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211998720 00000100:00100000:2.0:1787338564.121857:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211998720 00000100:00100000:2.0:1787338564.121868:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787338564.121993:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc91dc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d79243c8-b367-45ff-8d76-fbaa4be8becb+7:5833:x1874160211998336:12345-0@lo:104: 00010000:00010000:2.0:1787338564.122009:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.153@tcp lock: ffff90bbc14a9e00/0x83671231080c12aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x83671231080c12b1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338564.122144:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787338564.122150:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc91dc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d79243c8-b367-45ff-8d76-fbaa4be8becb+7:5833:x1874160211998336:12345-0@lo:104: Request processed in 162us (7041us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338564.122157:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787338564.122553:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787338564.122562:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc91df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d79243c8-b367-45ff-8d76-fbaa4be8becb+6:5833:x1874160211998464:12345-0@lo:104: 00010000:00010000:2.0:1787338564.122571:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.153@tcp lock: ffff90bc021c9200/0x83671231080c128e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x83671231080c1295 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338564.122642:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787338564.122647:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc91df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d79243c8-b367-45ff-8d76-fbaa4be8becb+6:5833:x1874160211998464:12345-0@lo:104: Request processed in 88us (7254us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338564.122663:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787338564.122678:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787338564.122684:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc91de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d79243c8-b367-45ff-8d76-fbaa4be8becb+5:5833:x1874160211998592:12345-0@lo:104: 00010000:00010000:2.0:1787338564.122692:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.153@tcp lock: ffff90bbc14a9a00/0x83671231080c1264 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x83671231080c126b expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338564.122720:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787338564.122725:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc91de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d79243c8-b367-45ff-8d76-fbaa4be8becb+5:5833:x1874160211998592:12345-0@lo:104: Request processed in 42us (3606us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338564.122730:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787338564.122742:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787338564.122748:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc91dea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d79243c8-b367-45ff-8d76-fbaa4be8becb+4:5833:x1874160211998720:12345-0@lo:104: 00010000:00010000:2.0:1787338564.122754:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.153@tcp lock: ffff90bc02045e00/0x83671231080c123a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x83671231080c1241 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338564.122779:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1787338564.122784:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc91dea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d79243c8-b367-45ff-8d76-fbaa4be8becb+4:5833:x1874160211998720:12345-0@lo:104: Request processed in 38us (1041us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338564.122790:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:2.0:1787338564.122809:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1787338564.122816:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.153@tcp lock: ffff90bbc14a9e00/0x83671231080c12aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x83671231080c12b1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338564.122824:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbc14a9e00 already unused, calling callback (ffffffffc1b2ec20) 10000000:00010000:2.0:1787338564.122829:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.153@tcp lock: ffff90bbc14a9e00/0x83671231080c12aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x83671231080c12b1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338564.122848:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.153@tcp lock: ffff90bbc14a9e00/0x83671231080c12aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x83671231080c12b1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787338564.122854:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.153@tcp lock: ffff90bbc14a9e00/0x83671231080c12aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x83671231080c12b1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787338564.122859:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787338564.122920:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.153@tcp lock: ffff90bbc14a9e00/0x83671231080c12aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c12b1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338564.122927:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787338564.122945:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.153@tcp lock: ffff90bbc14a9e00/0x83671231080c12aa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c12b1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338564.122952:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.153@tcp lock: ffff90bbc14a9e00/0x83671231080c12aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c12b1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338564.122968:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787338564.122971:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.153@tcp lock: ffff90bc021c9200/0x83671231080c128e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x83671231080c1295 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338564.122976:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bc021c9200 already unused, calling callback (ffffffffc1b2ec20) 10000000:00010000:2.0:1787338564.122979:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.153@tcp lock: ffff90bc021c9200/0x83671231080c128e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x83671231080c1295 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338564.122986:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.153@tcp lock: ffff90bc021c9200/0x83671231080c128e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x83671231080c1295 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787338564.122992:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.153@tcp lock: ffff90bc021c9200/0x83671231080c128e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x83671231080c1295 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787338564.123003:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787338564.123018:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.153@tcp lock: ffff90bc021c9200/0x83671231080c128e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c1295 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338564.123024:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787338564.123029:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.153@tcp lock: ffff90bc021c9200/0x83671231080c128e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c1295 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338564.123035:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.153@tcp lock: ffff90bc021c9200/0x83671231080c128e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c1295 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338564.123046:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787338564.123049:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.153@tcp lock: ffff90bbc14a9a00/0x83671231080c1264 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x83671231080c126b expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338564.123055:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbc14a9a00 already unused, calling callback (ffffffffc1b2ec20) 10000000:00010000:2.0:1787338564.123057:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.153@tcp lock: ffff90bbc14a9a00/0x83671231080c1264 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x83671231080c126b expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338564.123063:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.153@tcp lock: ffff90bbc14a9a00/0x83671231080c1264 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x83671231080c126b expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787338564.123068:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.153@tcp lock: ffff90bbc14a9a00/0x83671231080c1264 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x83671231080c126b expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787338564.123073:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787338564.123084:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.153@tcp lock: ffff90bbc14a9a00/0x83671231080c1264 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c126b expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338564.123090:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787338564.123119:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.153@tcp lock: ffff90bbc14a9a00/0x83671231080c1264 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c126b expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338564.123126:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.153@tcp lock: ffff90bbc14a9a00/0x83671231080c1264 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c126b expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338564.123134:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787338564.123137:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.153@tcp lock: ffff90bc02045e00/0x83671231080c123a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x83671231080c1241 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338564.123143:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bc02045e00 already unused, calling callback (ffffffffc1b2ec20) 10000000:00010000:2.0:1787338564.123145:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.153@tcp lock: ffff90bc02045e00/0x83671231080c123a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x83671231080c1241 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338564.123151:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.153@tcp lock: ffff90bc02045e00/0x83671231080c123a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x83671231080c1241 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787338564.123157:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.153@tcp lock: ffff90bc02045e00/0x83671231080c123a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x83671231080c1241 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787338564.123162:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787338564.123363:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787338564.123410:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.153@tcp lock: ffff90bc02045e00/0x83671231080c123a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c1241 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338564.123416:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787338564.123422:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.153@tcp lock: ffff90bc02045e00/0x83671231080c123a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c1241 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338564.123429:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.153@tcp lock: ffff90bc02045e00/0x83671231080c123a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c1241 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338564.123439:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787338564.123445:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787338564.123447:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787338564.123464:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc91dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d79243c8-b367-45ff-8d76-fbaa4be8becb:3316:1874160211998848:0@lo:103: 00000100:00100000:2.0:1787338564.123508:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338564.123554:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787338564.123561:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc91dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d79243c8-b367-45ff-8d76-fbaa4be8becb:3316:1874160211998976:0@lo:103: 00000100:00100000:2.0:1787338564.123581:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338564.123607:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc91ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d79243c8-b367-45ff-8d76-fbaa4be8becb:3314:1874160211999104:0@lo:103: 00000100:00100000:2.0:1787338564.123627:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338564.123642:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787338564.123647:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc91df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d79243c8-b367-45ff-8d76-fbaa4be8becb:3314:1874160211999232:0@lo:103: 00000100:00100000:2.0:1787338564.123664:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338564.123794:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211998848 00000100:00100000:0.0:1787338564.123801:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211998848 00010000:00010000:0.0:1787338564.123827:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90bc021c8a00/0x83671231080c12b1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x83671231080c12aa expref: 17 pid: 5834 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338564.123845:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211998976 00000100:00100000:0.0:1787338564.123848:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211998976 00010000:00010000:0.0:1787338564.123858:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90bc021c8800/0x83671231080c1295 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x83671231080c128e expref: 18 pid: 5832 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338564.123909:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211999104 00000100:00100000:0.0:1787338564.123912:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211999104 00010000:00010000:0.0:1787338564.123924:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90bbc0030800/0x83671231080c126b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x83671231080c1264 expref: 19 pid: 5834 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338564.123934:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211999232 00000100:00100000:0.0:1787338564.123936:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211999232 00010000:00010000:0.0:1787338564.123945:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90bbc14a9600/0x83671231080c1241 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x83671231080c123a expref: 20 pid: 5833 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338564.123956:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787338564.123963:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc91dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d79243c8-b367-45ff-8d76-fbaa4be8becb+20:3316:x1874160211998848:12345-0@lo:103: 00010000:00010000:0.0:1787338564.123974:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787338564.123979:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90bc021c8a00/0x83671231080c12b1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x83671231080c12aa expref: 20 pid: 5834 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338564.123989:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90bc021c8a00/0x83671231080c12b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x83671231080c12aa expref: 20 pid: 5834 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338564.124009:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787338564.124048:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc91dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d79243c8-b367-45ff-8d76-fbaa4be8becb+20:3316:x1874160211998848:12345-0@lo:103: Request processed in 85us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338564.124054:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787338564.124071:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787338564.124077:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc91ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d79243c8-b367-45ff-8d76-fbaa4be8becb+19:3316:x1874160211998976:12345-0@lo:103: 00010000:00010000:0.0:1787338564.124084:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787338564.124088:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90bc021c8800/0x83671231080c1295 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x83671231080c128e expref: 19 pid: 5832 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338564.124106:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90bc021c8800/0x83671231080c1295 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x83671231080c128e expref: 19 pid: 5832 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338564.124116:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787338564.124139:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc91ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d79243c8-b367-45ff-8d76-fbaa4be8becb+19:3316:x1874160211998976:12345-0@lo:103: Request processed in 63us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338564.124146:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787338564.124161:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787338564.124166:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc91ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d79243c8-b367-45ff-8d76-fbaa4be8becb+18:3314:x1874160211999104:12345-0@lo:103: 00010000:00010000:0.0:1787338564.124186:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787338564.124190:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90bbc0030800/0x83671231080c126b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x83671231080c1264 expref: 18 pid: 5834 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338564.124198:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90bbc0030800/0x83671231080c126b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x83671231080c1264 expref: 18 pid: 5834 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338564.124207:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787338564.124236:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc91ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d79243c8-b367-45ff-8d76-fbaa4be8becb+18:3314:x1874160211999104:12345-0@lo:103: Request processed in 70us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338564.124242:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787338564.124284:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787338564.124292:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc91dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d79243c8-b367-45ff-8d76-fbaa4be8becb+17:3314:x1874160211999232:12345-0@lo:103: 00010000:00010000:0.0:1787338564.124298:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787338564.124301:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90bbc14a9600/0x83671231080c1241 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x83671231080c123a expref: 17 pid: 5833 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338564.124308:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90bbc14a9600/0x83671231080c1241 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x83671231080c123a expref: 17 pid: 5833 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338564.124326:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787338564.124348:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc91dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d79243c8-b367-45ff-8d76-fbaa4be8becb+17:3314:x1874160211999232:12345-0@lo:103: Request processed in 59us (683us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338564.124354:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787338564.124398:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc91df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d79243c8-b367-45ff-8d76-fbaa4be8becb:3314:1874160211999232:0@lo:103: 00000100:00100000:0.0:1787338564.124407:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc91ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d79243c8-b367-45ff-8d76-fbaa4be8becb:3314:1874160211999104:0@lo:103: 00000100:00100000:3.0:1787338564.125072:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787338564.125081:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbdeb84450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d79243c8-b367-45ff-8d76-fbaa4be8becb+3:5833:x1874160211998208:12345-0@lo:104: 00010000:00010000:3.0:1787338564.125093:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.153@tcp lock: ffff90bc02044a00/0x83671231080c12d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x83671231080c12db expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338564.125144:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787338564.125149:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbdeb84450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d79243c8-b367-45ff-8d76-fbaa4be8becb+3:5833:x1874160211998208:12345-0@lo:104: Request processed in 70us (16621us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338564.125156:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1787338564.125215:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787338564.125221:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.153@tcp lock: ffff90bc02044a00/0x83671231080c12d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x83671231080c12db expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338564.125228:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bc02044a00 already unused, calling callback (ffffffffc1b2ec20) 10000000:00010000:3.0:1787338564.125231:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.153@tcp lock: ffff90bc02044a00/0x83671231080c12d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x83671231080c12db expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338564.125240:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.153@tcp lock: ffff90bc02044a00/0x83671231080c12d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x83671231080c12db expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787338564.125248:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.153@tcp lock: ffff90bc02044a00/0x83671231080c12d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x83671231080c12db expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787338564.125262:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787338564.125293:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.153@tcp lock: ffff90bc02044a00/0x83671231080c12d4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c12db expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338564.125309:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787338564.125324:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.153@tcp lock: ffff90bc02044a00/0x83671231080c12d4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c12db expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338564.125330:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.153@tcp lock: ffff90bc02044a00/0x83671231080c12d4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c12db expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338564.125346:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338564.125348:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338564.125350:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787338564.125357:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787338564.125370:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee560a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d79243c8-b367-45ff-8d76-fbaa4be8becb:3317:1874160211999360:0@lo:103: 00000100:00100000:3.0:1787338564.125403:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338564.125464:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211999360 00000100:00100000:3.0:1787338564.125469:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211999360 00010000:00010000:3.0:1787338564.125485:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90bc021c8c00/0x83671231080c12db lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x83671231080c12d4 expref: 17 pid: 5832 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338564.125504:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787338564.125510:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee561180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d79243c8-b367-45ff-8d76-fbaa4be8becb+17:3317:x1874160211999360:12345-0@lo:103: 00010000:00010000:3.0:1787338564.125518:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787338564.125521:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90bc021c8c00/0x83671231080c12db lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x83671231080c12d4 expref: 17 pid: 5832 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338564.125531:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90bc021c8c00/0x83671231080c12db lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x83671231080c12d4 expref: 17 pid: 5832 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338564.125546:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90bc02045000/0x83671231080c12f0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338564.125566:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bc02045000/0x83671231080c12f0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338564.125581:0:5825:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90bc02045000/0x83671231080c12f0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338564.125587:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90bc02045000/0x83671231080c12f0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338564.125593:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90bc02045000/0x83671231080c12f0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338564.125598:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90bc02045000/0x83671231080c12f0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338564.125603:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bc02045000 already unused, calling callback (ffffffffc1546230) 00010000:00010000:3.0:1787338564.125607:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90bc02045000/0x83671231080c12f0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338564.125613:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90bc02045000/0x83671231080c12f0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338564.125621:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90bc02045000/0x83671231080c12f0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338564.125631:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787338564.125658:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee561180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d79243c8-b367-45ff-8d76-fbaa4be8becb+17:3317:x1874160211999360:12345-0@lo:103: Request processed in 149us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338564.125665:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787338564.125704:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee560a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d79243c8-b367-45ff-8d76-fbaa4be8becb:3317:1874160211999360:0@lo:103: 00000100:00100000:2.0:1787338564.125923:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc91dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d79243c8-b367-45ff-8d76-fbaa4be8becb:3316:1874160211998976:0@lo:103: 00000100:00100000:2.0:1787338564.125933:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc91dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d79243c8-b367-45ff-8d76-fbaa4be8becb:3316:1874160211998848:0@lo:103: 00010000:00010000:1.0:1787338564.126482:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90bc021c8a00/0x83671231080c12b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x83671231080c12aa expref: 16 pid: 5834 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338564.126495:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee44f480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5833:1874160211998336:0@lo:104: 00010000:00010000:1.0:1787338564.126522:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90bc021c8800/0x83671231080c1295 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x83671231080c128e expref: 15 pid: 5832 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338564.126543:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee44df80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5833:1874160211998464:0@lo:104: 00010000:00010000:1.0:1787338564.126554:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90bbc0030800/0x83671231080c126b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x83671231080c1264 expref: 14 pid: 5834 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338564.126561:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee44c000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5833:1874160211998592:0@lo:104: 00010000:00010000:1.0:1787338564.126570:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90bbc14a9600/0x83671231080c1241 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x83671231080c123a expref: 13 pid: 5833 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338564.126578:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee44c700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5833:1874160211998720:0@lo:104: 00010000:00010000:1.0:1787338564.126587:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90bc021c8c00/0x83671231080c12db lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x83671231080c12d4 expref: 12 pid: 5832 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338564.126594:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee44f100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5833:1874160211998208:0@lo:104: 00010000:00010000:1.0:1787338564.126614:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90bc02045000/0x83671231080c12f0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338564.126624:0:5833:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90bc02045000/0x83671231080c12f0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338564.126631:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90bc02045000/0x83671231080c12f0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338564.126637:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90bc02045000/0x83671231080c12f0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787338564.126650:0:5833:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1787338564.201185:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbde806850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+11:7634:x1874160211998080:12345-0@lo:253: Request processed in 130725us (141396us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338564.201200:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787338564.201604:0:7634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc91dd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d79243c8-b367-45ff-8d76-fbaa4be8becb:7634:1874160211998080:0@lo:253: 10000000:01000000:2.0:1787338564.201623:0:7634:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1787338564.201627:0:7634:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787338564.201629:0:7634:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787338564.201630:0:7634:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787338564.201631:0:7634:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1787338564.201633:0:7634:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787338564.201635:0:7634:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787338564.201637:0:7634:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787338564.201638:0:7634:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1787338564.201641:0:7634:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787338564.201642:0:7634:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787338564.201675:0:7634:0:(tgt_mount.c:101:server_register_mount()) register mount ffff90bbff941800 from lustre-OST0001 10000000:01000000:2.0:1787338564.201701:0:7634:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1787338564.201705:0:7634:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787338564.201726:0:7634:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff90bbde3e99b8 local copy 10000000:01000000:2.0:1787338564.201730:0:7634:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787338564.201774:0:7634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bc021c9200/0x83671231080c12f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338564.201784:0:7634:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.153@tcp lock: ffff90bc021c9200/0x83671231080c12f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338564.201794:0:7634:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.153@tcp lock: ffff90bc021c9200/0x83671231080c12f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338564.201812:0:7634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc91dd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d79243c8-b367-45ff-8d76-fbaa4be8becb:7634:1874160211999488:0@lo:101: 00000100:00100000:2.0:1787338564.201870:0:7634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338564.201946:0:7634:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbf41c1f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787338564.202316:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211999488 00000100:00100000:0.0:1787338564.202324:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211999488 00000100:00100000:0.0:1787338564.202455:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787338564.202466:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbde807c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+11:7634:x1874160211999488:12345-0@lo:101: 00010000:00010000:0.0:1787338564.202480:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787338564.202496:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90bbc0030c00/0x83671231080c12fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x83671231080c12f7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338564.202524:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bbc0030c00/0x83671231080c12fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x83671231080c12f7 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338564.202535:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90bbc0030c00/0x83671231080c12fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c12f7 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338564.202545:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbc0030c00, rc 0) 00000100:00100000:0.0:1787338564.202594:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbde807c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+12:7634:x1874160211999488:12345-0@lo:101: Request processed in 131us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338564.202611:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787338564.202676:0:7634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc91dd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d79243c8-b367-45ff-8d76-fbaa4be8becb:7634:1874160211999488:0@lo:101: 00010000:00010000:2.0:1787338564.202691:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.153@tcp lock: ffff90bc021c9200/0x83671231080c12f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x83671231080c12fe expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338564.202699:0:7634:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.153@tcp lock: ffff90bc021c9200/0x83671231080c12f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x83671231080c12fe expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338564.202819:0:7634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc91dd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d79243c8-b367-45ff-8d76-fbaa4be8becb:7634:1874160211999616:0@lo:501: 00000100:00100000:2.0:1787338564.202905:0:7634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338564.212201:0:7634:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbf41c1f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787338564.212537:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211999616 00000100:00100000:1.0:1787338564.212549:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211999616 00000100:00100000:1.0:1787338564.212629:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787338564.212639:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbde805850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+12:7634:x1874160211999616:12345-0@lo:501: 00000100:00100000:1.0:1787338564.215662:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbde805850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+12:7634:x1874160211999616:12345-0@lo:501: Request processed in 3016us (12782us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787338564.215675:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787338564.216096:0:7634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc91dd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d79243c8-b367-45ff-8d76-fbaa4be8becb:7634:1874160211999616:0@lo:501: 10000000:01000000:2.0:1787338564.216123:0:7634:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.153@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787338564.216169:0:7634:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.153@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787338564.216194:0:7634:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bc021c9200/0x83671231080c12f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x83671231080c12fe expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338564.216214:0:7634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bc021c9200/0x83671231080c12f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x83671231080c12fe expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338564.216220:0:7634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.153@tcp lock: ffff90bc021c9200/0x83671231080c12f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x83671231080c12fe expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338564.216236:0:7634:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787338564.216270:0:7634:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff90bbff941800 10000000:01000000:2.0:1787338564.216276:0:7634:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787338564.216282:0:7634:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787338564.216285:0:7634:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787338564.216289:0:7634:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1787338564.216292:0:7634:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1787338564.216325:0:7634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bc021c8c00/0x83671231080c1305 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338564.216333:0:7634:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.153@tcp lock: ffff90bc021c8c00/0x83671231080c1305 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338564.216342:0:7634:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.153@tcp lock: ffff90bc021c8c00/0x83671231080c1305 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338564.216360:0:7634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc91dd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d79243c8-b367-45ff-8d76-fbaa4be8becb:7634:1874160211999744:0@lo:101: 00000100:00100000:2.0:1787338564.216399:0:7634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338564.216441:0:7634:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbf41c13c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787338564.216637:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211999744 00000100:00100000:0.0:1787338564.216646:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211999744 00000100:00100000:0.0:1787338564.216692:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787338564.216702:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbde807850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+12:7634:x1874160211999744:12345-0@lo:101: 00010000:00010000:0.0:1787338564.216715:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787338564.216728:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90bbc0031800/0x83671231080c130c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x83671231080c1305 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338564.216751:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bbc0031800/0x83671231080c130c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x83671231080c1305 expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338564.216762:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90bbc0031800/0x83671231080c130c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c1305 expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338564.216772:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbc0031800, rc 0) 00000100:00100000:0.0:1787338564.216808:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbde807850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+13:7634:x1874160211999744:12345-0@lo:101: Request processed in 107us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338564.216814:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00010000:1.0:1787338564.216954:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787338564.216974:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.153@tcp lock: ffff90bc021c9200/0x83671231080c12f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x83671231080c12fe expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338564.216981:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bc021c9200 already unused, calling callback (ffffffffc1b2ec20) 10000000:00010000:1.0:1787338564.216985:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.153@tcp lock: ffff90bc021c9200/0x83671231080c12f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x83671231080c12fe expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338564.216993:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.153@tcp lock: ffff90bc021c9200/0x83671231080c12f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x83671231080c12fe expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787338564.217000:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.153@tcp lock: ffff90bc021c9200/0x83671231080c12f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x83671231080c12fe expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787338564.217005:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787338564.217026:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.153@tcp lock: ffff90bc021c9200/0x83671231080c12f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x83671231080c12fe expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338564.217032:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787338564.217057:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.153@tcp lock: ffff90bc021c9200/0x83671231080c12f7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x83671231080c12fe expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338564.217064:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.153@tcp lock: ffff90bc021c9200/0x83671231080c12f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x83671231080c12fe expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338564.217091:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338564.217093:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338564.217095:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787338564.217428:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee44f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d79243c8-b367-45ff-8d76-fbaa4be8becb:3317:1874160211999872:0@lo:103: 00000100:00100000:0.0:1787338564.217465:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338564.217607:0:7634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc91dd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d79243c8-b367-45ff-8d76-fbaa4be8becb:7634:1874160211999744:0@lo:101: 00010000:00010000:2.0:1787338564.217624:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.153@tcp lock: ffff90bc021c8c00/0x83671231080c1305 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c130c expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338564.217646:0:7634:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.153@tcp lock: ffff90bc021c8c00/0x83671231080c1305 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x83671231080c130c expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338564.217735:0:7634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc91dd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d79243c8-b367-45ff-8d76-fbaa4be8becb:7634:1874160212000000:0@lo:501: 00000100:00100000:2.0:1787338564.217763:0:7634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338564.217842:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160211999872 00000100:00100000:1.0:1787338564.217849:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160211999872 00000100:00100000:1.0:1787338564.217935:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787338564.217943:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbed9c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d79243c8-b367-45ff-8d76-fbaa4be8becb+13:3317:x1874160211999872:12345-0@lo:103: 00010000:00010000:1.0:1787338564.217954:0:6704:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787338564.217979:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90bbc0030c00/0x83671231080c12fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x83671231080c12f7 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338564.217991:0:6704:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787338564.218026:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbed9c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d79243c8-b367-45ff-8d76-fbaa4be8becb+12:3317:x1874160211999872:12345-0@lo:103: Request processed in 83us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338564.218032:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787338564.218233:0:7634:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbf41c13c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787338564.218459:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212000000 00000100:00100000:3.0:1787338564.218464:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212000000 00000100:00100000:1.0:1787338564.231004:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee44f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d79243c8-b367-45ff-8d76-fbaa4be8becb:3317:1874160211999872:0@lo:103: 00000100:00100000:0.0:1787338564.234794:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787338564.234821:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbde804c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+12:7634:x1874160212000000:12345-0@lo:501: 00000100:00100000:0.0:1787338564.235198:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbde804c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+12:7634:x1874160212000000:12345-0@lo:501: Request processed in 390us (17432us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338564.235206:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787338564.235573:0:7634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc91dd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d79243c8-b367-45ff-8d76-fbaa4be8becb:7634:1874160212000000:0@lo:501: 00000100:00100000:2.0:1787338564.235626:0:7634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc91dd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d79243c8-b367-45ff-8d76-fbaa4be8becb:7634:1874160212000128:0@lo:503: 00000100:00100000:2.0:1787338564.235674:0:7634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338564.235716:0:7634:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbf41c13c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787338564.236524:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212000128 00000100:00100000:2.0:1787338564.236532:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212000128 00000100:00100000:2.0:1787338564.236572:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787338564.236581:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbde805c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+12:7634:x1874160212000128:12345-0@lo:503: 00000100:00100000:2.0:1787338564.236811:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbde805c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+12:7634:x1874160212000128:12345-0@lo:503: Request processed in 230us (1136us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338564.236819:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787338564.236940:0:7634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc91dd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d79243c8-b367-45ff-8d76-fbaa4be8becb:7634:1874160212000128:0@lo:503: 00000040:00080000:3.0:1787338564.237423:0:7634:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787338564.243556:0:7634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc91dd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d79243c8-b367-45ff-8d76-fbaa4be8becb:7634:1874160212000256:0@lo:502: 00000100:00100000:2.0:1787338564.243639:0:7634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338564.243692:0:7634:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbf41c1300 going to sleep for 11 seconds 00000100:00100000:3.0:1787338564.247943:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212000256 00000100:00100000:3.0:1787338564.247960:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212000256 00000100:00100000:3.0:1787338564.248050:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787338564.248062:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc7da4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+12:7634:x1874160212000256:12345-0@lo:502: 00000100:00100000:3.0:1787338564.248413:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc7da4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+12:7634:x1874160212000256:12345-0@lo:502: Request processed in 353us (4772us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338564.248421:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787338564.248538:0:7634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc91dd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d79243c8-b367-45ff-8d76-fbaa4be8becb:7634:1874160212000256:0@lo:502: 00000040:00080000:2.0:1787338564.248846:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1787338564.248937:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1787338564.248971:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1787338564.249017:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1787338564.249062:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1787338564.249095:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1787338564.249132:0:7634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc91dd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d79243c8-b367-45ff-8d76-fbaa4be8becb:7634:1874160212000384:0@lo:502: 00000100:00100000:2.0:1787338564.249190:0:7634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338564.249228:0:7634:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbf41c1300 going to sleep for 11 seconds 00000100:00100000:1.0:1787338564.249283:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212000384 00000100:00100000:1.0:1787338564.249291:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212000384 00000100:00100000:1.0:1787338564.251304:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787338564.251334:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc7da4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+12:7634:x1874160212000384:12345-0@lo:502: 00000100:00100000:1.0:1787338564.252462:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc7da4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+12:7634:x1874160212000384:12345-0@lo:502: Request processed in 1139us (3266us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338564.252473:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787338564.268427:0:7634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc91dd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d79243c8-b367-45ff-8d76-fbaa4be8becb:7634:1874160212000384:0@lo:502: 00000040:00080000:3.0:1787338564.270737:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1787338564.270765:0:7634:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:3.0:1787338564.273434:0:7641:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787338564.273445:0:7641:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1787338564.273451:0:7641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787338564.273454:0:7641:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1787338564.273459:0:7641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787338564.273489:0:7641:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff90bbfc248000) 00000020:00000080:3.0:1787338564.273512:0:7641:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787338564.273518:0:7641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787338564.273575:0:7641:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90bbff941800 from lustre-OST0001, refs=2 00080000:01000000:3.0:1787338564.273583:0:7641:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787338564.273589:0:7641:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x83671231080c131a 00010000:00010000:3.0:1787338564.280492:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787338564.282783:0:7641:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:0.0:1787338564.283120:0:7641:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:1.0:1787338564.293121:0:7641:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1787338564.293467:0:7641:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:1.0:1787338564.300296:0:7641:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1787338564.300784:0:7641:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1787338564.312051:0:7641:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1787338564.312065:0:7641:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787338564.312071:0:7641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787338564.312073:0:7641:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1787338564.312077:0:7641:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787338564.312080:0:7641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787338564.312081:0:7641:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787338564.312084:0:7641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787338564.312086:0:7641:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787338564.312146:0:7641:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787338564.312150:0:7641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787338564.312151:0:7641:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787338564.312154:0:7641:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1787338564.318736:0:7634:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:3.0:1787338564.318785:0:7634:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.153@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1787338564.318809:0:7634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bc021c8c00/0x83671231080c1305 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c130c expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338564.318839:0:7634:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.153@tcp lock: ffff90bc021c8c00/0x83671231080c1305 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c130c expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787338564.318848:0:7634:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90bbff941800 from 1 10000000:01000000:3.0:1787338564.318851:0:7634:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787338564.318916:0:7634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbc14a8a00/0x83671231080c1321 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338564.318925:0:7634:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.153@tcp lock: ffff90bbc14a8a00/0x83671231080c1321 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338564.318935:0:7634:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.153@tcp lock: ffff90bbc14a8a00/0x83671231080c1321 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338564.318958:0:7634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee560a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d79243c8-b367-45ff-8d76-fbaa4be8becb:7634:1874160212000512:0@lo:101: 00000100:00100000:3.0:1787338564.319021:0:7634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338564.319062:0:7634:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbfc209180 going to sleep for 11 seconds 00000100:00100000:2.0:1787338564.319203:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212000512 00000100:00100000:2.0:1787338564.319210:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212000512 00000100:00100000:2.0:1787338564.319263:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787338564.319274:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc7da4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+12:7634:x1874160212000512:12345-0@lo:101: 00010000:00010000:2.0:1787338564.319288:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787338564.319302:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90bc021c8800/0x83671231080c1328 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x83671231080c1321 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338564.319324:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bc021c8800/0x83671231080c1328 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x83671231080c1321 expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338564.319334:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90bc021c8800/0x83671231080c1328 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c1321 expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338564.319356:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bc021c8800, rc 0) 00000100:00100000:2.0:1787338564.319397:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc7da4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+13:7634:x1874160212000512:12345-0@lo:101: Request processed in 124us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338564.319403:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787338564.319445:0:7634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee560a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d79243c8-b367-45ff-8d76-fbaa4be8becb:7634:1874160212000512:0@lo:101: 00010000:00010000:2.0:1787338564.319457:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.153@tcp lock: ffff90bbc14a8a00/0x83671231080c1321 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c1328 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338564.319466:0:7634:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.153@tcp lock: ffff90bbc14a8a00/0x83671231080c1321 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x83671231080c1328 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338564.319555:0:7634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc91dce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d79243c8-b367-45ff-8d76-fbaa4be8becb:7634:1874160212000640:0@lo:501: 00000100:00100000:2.0:1787338564.319578:0:7634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338564.319599:0:7634:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbf41c1300 going to sleep for 11 seconds 00000100:00100000:2.0:1787338564.319613:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212000640 00000100:00100000:2.0:1787338564.319616:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212000640 00000100:00100000:2.0:1787338564.319641:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787338564.319646:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc7da7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+13:7634:x1874160212000640:12345-0@lo:501: 00000100:00100000:2.0:1787338564.319891:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc7da7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+13:7634:x1874160212000640:12345-0@lo:501: Request processed in 224us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338564.319900:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787338564.319931:0:7634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc91dce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d79243c8-b367-45ff-8d76-fbaa4be8becb:7634:1874160212000640:0@lo:501: 00000100:00100000:2.0:1787338564.319956:0:7634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc91dce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d79243c8-b367-45ff-8d76-fbaa4be8becb:7634:1874160212000768:0@lo:503: 00000100:00100000:2.0:1787338564.319991:0:7634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338564.320009:0:7634:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbf41c1300 going to sleep for 11 seconds 00000100:00100000:2.0:1787338564.320026:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212000768 00000100:00100000:2.0:1787338564.320029:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212000768 00000100:00100000:2.0:1787338564.320046:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787338564.320052:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc7da7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+13:7634:x1874160212000768:12345-0@lo:503: 00000100:00100000:2.0:1787338564.320358:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc7da7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+13:7634:x1874160212000768:12345-0@lo:503: Request processed in 305us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338564.320366:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787338564.320404:0:7634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc91dce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d79243c8-b367-45ff-8d76-fbaa4be8becb:7634:1874160212000768:0@lo:503: 00000040:00080000:2.0:1787338564.320672:0:7634:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787338564.320724:0:7634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc91dce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d79243c8-b367-45ff-8d76-fbaa4be8becb:7634:1874160212000896:0@lo:502: 00000100:00100000:2.0:1787338564.320758:0:7634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338564.320775:0:7634:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbf41c1300 going to sleep for 11 seconds 00000100:00100000:2.0:1787338564.320791:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212000896 00000100:00100000:2.0:1787338564.320794:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212000896 00000100:00100000:2.0:1787338564.320813:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787338564.320820:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc7da6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+13:7634:x1874160212000896:12345-0@lo:502: 00000100:00100000:2.0:1787338564.320993:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc7da6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+13:7634:x1874160212000896:12345-0@lo:502: Request processed in 173us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338564.321001:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787338564.321045:0:7634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc91dce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d79243c8-b367-45ff-8d76-fbaa4be8becb:7634:1874160212000896:0@lo:502: 00000040:00080000:2.0:1787338564.321284:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1787338564.321329:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1787338564.321351:0:7634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc91dce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d79243c8-b367-45ff-8d76-fbaa4be8becb:7634:1874160212001024:0@lo:502: 00000100:00100000:2.0:1787338564.321382:0:7634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338564.321404:0:7634:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbf41c1300 going to sleep for 11 seconds 00000100:00100000:2.0:1787338564.321417:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212001024 00000100:00100000:2.0:1787338564.321420:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212001024 00000100:00100000:2.0:1787338564.321443:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787338564.321448:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc7da7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+13:7634:x1874160212001024:12345-0@lo:502: 00000100:00100000:2.0:1787338564.321554:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc7da7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+13:7634:x1874160212001024:12345-0@lo:502: Request processed in 104us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338564.321560:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787338564.321599:0:7634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc91dce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d79243c8-b367-45ff-8d76-fbaa4be8becb:7634:1874160212001024:0@lo:502: 00000040:00080000:2.0:1787338564.321681:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1787338564.321691:0:7634:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1787338564.321990:0:7644:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787338564.322000:0:7644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787338564.322002:0:7644:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787338564.322008:0:7644:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90bbff941800 00000020:00000080:2.0:1787338564.322010:0:7644:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787338564.322029:0:7644:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787338564.322032:0:7644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787338564.322034:0:7644:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1787338564.322037:0:7644:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1787338564.322067:0:7634:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1787338564.322084:0:7634:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787338564.322093:0:7634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbc14a8a00/0x83671231080c1321 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c1328 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338564.322104:0:7634:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.153@tcp lock: ffff90bbc14a8a00/0x83671231080c1321 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c1328 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787338564.322164:0:7634:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787338564.322182:0:7634:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff90bbff941800 10000000:01000000:2.0:1787338564.322185:0:7634:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff90bbff941800 10000000:01000000:2.0:1787338564.322189:0:7634:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787338564.322194:0:7634:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90bbff941800 from 1 10000000:01000000:2.0:1787338564.322202:0:7634:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787338564.322228:0:7634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bc021c8a00/0x83671231080c132f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338564.322235:0:7634:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.153@tcp lock: ffff90bc021c8a00/0x83671231080c132f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338564.322244:0:7634:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.153@tcp lock: ffff90bc021c8a00/0x83671231080c132f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338564.334436:0:7634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc91dce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d79243c8-b367-45ff-8d76-fbaa4be8becb:7634:1874160212001152:0@lo:101: 00000100:00100000:2.0:1787338564.334512:0:7634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338564.334562:0:7634:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbf41c13c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787338564.334691:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212001152 00000100:00100000:0.0:1787338564.334699:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212001152 00000100:00100000:0.0:1787338564.334754:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787338564.334764:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc7da5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+13:7634:x1874160212001152:12345-0@lo:101: 00010000:00010000:0.0:1787338564.334780:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787338564.334799:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90bbc0031c00/0x83671231080c1336 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x83671231080c132f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338564.334836:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bbc0031c00/0x83671231080c1336 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x83671231080c132f expref: 14 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338564.334848:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90bbc0031c00/0x83671231080c1336 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c132f expref: 14 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338564.334858:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbc0031c00, rc 0) 00000100:00100000:0.0:1787338564.334932:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc7da5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+14:7634:x1874160212001152:12345-0@lo:101: Request processed in 169us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338564.334939:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787338564.335093:0:7634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc91dce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d79243c8-b367-45ff-8d76-fbaa4be8becb:7634:1874160212001152:0@lo:101: 00010000:00010000:3.0:1787338564.335109:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.153@tcp lock: ffff90bc021c8a00/0x83671231080c132f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c1336 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338564.335118:0:7634:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.153@tcp lock: ffff90bc021c8a00/0x83671231080c132f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x83671231080c1336 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338564.335242:0:7634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee561880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d79243c8-b367-45ff-8d76-fbaa4be8becb:7634:1874160212001280:0@lo:501: 00000100:00100000:3.0:1787338564.335301:0:7634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338564.335327:0:7634:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbfc209b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787338564.335606:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212001280 00000100:00100000:0.0:1787338564.335611:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212001280 00000100:00100000:0.0:1787338564.335636:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787338564.335643:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc7da7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+14:7634:x1874160212001280:12345-0@lo:501: 00000100:00100000:0.0:1787338564.335902:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc7da7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+14:7634:x1874160212001280:12345-0@lo:501: Request processed in 258us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338564.335909:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787338564.336040:0:7634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee561880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d79243c8-b367-45ff-8d76-fbaa4be8becb:7634:1874160212001280:0@lo:501: 00000100:00100000:3.0:1787338564.336069:0:7634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee561880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d79243c8-b367-45ff-8d76-fbaa4be8becb:7634:1874160212001408:0@lo:503: 00000100:00100000:3.0:1787338564.336107:0:7634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338564.336130:0:7634:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbfc209b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787338564.336170:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212001408 00000100:00100000:0.0:1787338564.336174:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212001408 00000100:00100000:0.0:1787338564.336205:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787338564.336219:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc7da4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+14:7634:x1874160212001408:12345-0@lo:503: 00000100:00100000:0.0:1787338564.336379:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc7da4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+14:7634:x1874160212001408:12345-0@lo:503: Request processed in 161us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338564.336386:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787338564.336517:0:7634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee561880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d79243c8-b367-45ff-8d76-fbaa4be8becb:7634:1874160212001408:0@lo:503: 00000040:00080000:3.0:1787338564.336766:0:7634:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787338564.336842:0:7634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee561880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d79243c8-b367-45ff-8d76-fbaa4be8becb:7634:1874160212001536:0@lo:502: 00000100:00100000:3.0:1787338564.336907:0:7634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338564.336932:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212001536 00000100:00100000:3.0:1787338564.336937:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212001536 00000100:00100000:3.0:1787338564.336959:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787338564.336966:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc7da5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+14:7634:x1874160212001536:12345-0@lo:502: 00000100:00100000:3.0:1787338564.337117:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc7da5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+14:7634:x1874160212001536:12345-0@lo:502: Request processed in 151us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338564.337124:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787338564.337156:0:7634:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbfc209b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787338564.337169:0:7634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee561880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d79243c8-b367-45ff-8d76-fbaa4be8becb:7634:1874160212001536:0@lo:502: 00000040:00080000:3.0:1787338564.337413:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1787338564.337453:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1787338564.337482:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1787338564.337523:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1787338564.337557:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1787338564.337609:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1787338564.337646:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1787338564.337676:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1787338564.337717:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1787338564.337749:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1787338564.337796:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1787338564.337835:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1787338564.337867:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1787338564.337922:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1787338564.337967:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1787338564.338000:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1787338564.338027:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1787338564.338085:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1787338564.338118:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1787338564.338145:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1787338564.338184:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1787338564.338217:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1787338564.338259:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1787338564.338306:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1787338564.338338:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1787338564.338369:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1787338564.338427:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1787338564.338461:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:3.0:1787338564.338493:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1787338564.338546:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:3.0:1787338564.338582:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:3.0:1787338564.338616:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:3.0:1787338564.338647:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:3.0:1787338564.338691:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:3.0:1787338564.338726:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:3.0:1787338564.338770:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:3.0:1787338564.338800:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:3.0:1787338564.338836:0:7634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee561880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d79243c8-b367-45ff-8d76-fbaa4be8becb:7634:1874160212001664:0@lo:502: 00000100:00100000:3.0:1787338564.338919:0:7634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338564.338967:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212001664 00000100:00100000:3.0:1787338564.338973:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212001664 00000100:00100000:3.0:1787338564.339006:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787338564.339021:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc7da5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+14:7634:x1874160212001664:12345-0@lo:502: 00000100:00100000:3.0:1787338564.339206:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc7da5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+14:7634:x1874160212001664:12345-0@lo:502: Request processed in 186us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338564.339213:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787338564.339268:0:7634:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbfc209b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787338564.339286:0:7634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee561880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d79243c8-b367-45ff-8d76-fbaa4be8becb:7634:1874160212001664:0@lo:502: 00000040:00080000:3.0:1787338564.339353:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:3.0:1787338564.339363:0:7634:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1787338564.354059:0:7646:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1787338564.354079:0:7646:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff90bbfc24cd28) 00000020:00000080:3.0:1787338564.354123:0:7646:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:3.0:1787338564.354382:0:7646:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90bbff941800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787338564.354387:0:7646:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90bbff941800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787338564.354390:0:7646:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90bbff941800 3 00010000:00080000:3.0:1787338564.354421:0:7646:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90bbf41a4000@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.153@tcp at head 00010000:00010000:2.0:1787338564.369559:0:7646:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:2.0:1787338564.370101:0:7646:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1787338564.370145:0:7646:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787338564.370158:0:7646:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x83671231080c1344 00000100:00080000:2.0:1787338564.370168:0:7646:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787338564.370174:0:7646:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff90bbf41a4000 using connection 192.168.201.153@tcp/0@lo 00000100:00100000:2.0:1787338564.370325:0:7646:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90bbc91dce00 x1874160212001792/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787338564.370377:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc91dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3313:1874160212001792:0@lo:38: 00000100:00100000:3.0:1787338564.370460:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338564.370568:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212001792 00000100:00100000:1.0:1787338564.370576:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212001792 00000100:00100000:1.0:1787338564.370616:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787338564.370624:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee561880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3313:x1874160212001792:12345-0@lo:38: 00010000:00080000:1.0:1787338564.370650:0:5839:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 217 last 0 00000020:00000080:1.0:1787338564.370681:0:5839:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x83671231080c134b 00000004:00100000:1.0:1787338564.370697:0:5839:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787338564.370728:0:5839:0:(import.c:65:import_set_state_nolock()) ffff90bbfc17a000 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1787338564.370859:0:7646:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787338564.370982:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc91dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874160212001920:0@lo:400: 00000100:00100000:2.0:1787338564.371013:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338564.371038:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787338564.371045:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc91dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1874160212002048:0@lo:400: 00000100:00100000:2.0:1787338564.371091:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338564.371123:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc91ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874160212002176:0@lo:400: 00000100:00100000:2.0:1787338564.371159:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338564.371449:0:5841:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1787338564.371459:0:5841:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1787338564.371476:0:5840:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1787338564.371484:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212001920 00000100:00100000:2.0:1787338564.371488:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212001920 00000100:00100000:2.0:1787338564.371512:0:5840:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1787338564.371516:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212002048 00000100:00100000:2.0:1787338564.371518:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212002048 00000100:00100000:2.0:1787338564.371540:0:5840:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1787338564.371545:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787338564.371551:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc91df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874160212001920:12345-0@lo:400: 00000100:00100000:2.0:1787338564.371591:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc91df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874160212001920:12345-0@lo:400: Request processed in 40us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338564.371598:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787338564.371611:0:5840:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1787338564.371617:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787338564.371623:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf46f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874160212002048:12345-0@lo:400: 00000100:00100000:2.0:1787338564.371648:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf46f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874160212002048:12345-0@lo:400: Request processed in 26us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338564.371654:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787338564.371671:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212002176 00000100:00100000:2.0:1787338564.371674:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212002176 00000100:00100000:2.0:1787338564.371697:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787338564.371703:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf46f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1874160212002176:12345-0@lo:400: 00000100:00100000:2.0:1787338564.371731:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf46f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1874160212002176:12345-0@lo:400: Request processed in 28us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338564.371736:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1787338564.371900:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787338564.371909:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787338564.371941:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90bbc91dd180 x1874160212002048/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787338580 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787338564.371955:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc91dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1874160212002048:0@lo:400: 00010000:00080000:2.0:1787338564.371977:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90bbc91dd500 x1874160212001920/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787338580 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787338564.371986:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc91dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874160212001920:0@lo:400: 00010000:00080000:2.0:1787338564.372014:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90bbc91ded80 x1874160212002176/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787338580 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787338564.372024:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc91ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874160212002176:0@lo:400: 00000040:00080000:2.0:1787338564.378058:0:7646:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00080000:2.0:1787338564.378664:0:7648:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff90bbf46f9c00 x1874160212002304/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787338564.378677:0:7648:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbf41c1300 going to sleep for 0 seconds 00000020:01000000:2.0:1787338564.386045:0:7634:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:2.0:1787338564.386089:0:7634:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787338564.386115:0:7634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bc021c8a00/0x83671231080c132f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c1336 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338564.386128:0:7634:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.153@tcp lock: ffff90bc021c8a00/0x83671231080c132f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c1336 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787338564.390478:0:7634:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787338564.390483:0:7634:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787338564.390485:0:7634:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787338564.390486:0:7634:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787338564.390487:0:7634:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787338564.390490:0:7634:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787338564.390498:0:7634:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787338564.390499:0:7634:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787338564.390500:0:7634:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787338564.390502:0:7634:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787338564.390503:0:7634:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787338564.390507:0:7634:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1787338564.390510:0:7634:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787338564.390511:0:7634:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787338564.390512:0:7634:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787338564.390513:0:7634:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787338564.390513:0:7634:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787338564.390514:0:7634:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787338564.390515:0:7634:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787338564.390516:0:7634:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787338564.390517:0:7634:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787338564.390517:0:7634:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787338564.390518:0:7634:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787338564.390547:0:7634:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787338564.390568:0:7634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf46f9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d79243c8-b367-45ff-8d76-fbaa4be8becb:7634:1874160212002432:0@lo:253: 00000100:00100000:2.0:1787338564.390647:0:7634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338564.390702:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212002432 00000100:00100000:2.0:1787338564.390709:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212002432 00000100:00100000:2.0:1787338564.390755:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787338564.390764:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc7da6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+14:7634:x1874160212002432:12345-0@lo:253: 20000000:01000000:2.0:1787338564.390802:0:5834:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1787338564.392027:0:5834:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1787338564.392346:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee561880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874160212001792:12345-0@lo:38: Request processed in 21717us (21881us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338564.392359:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1787338564.392516:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90bbc91dce00 x1874160212001792/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787338574 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787338564.392529:0:3313:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787338564.392538:0:3313:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1787338564.392546:0:3313:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787338564.392551:0:3313:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787338564.392555:0:3313:0:(import.c:65:import_set_state_nolock()) ffff90bbf41a4000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1787338564.392562:0:3313:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000bc75512e): req@ffff90bbf46f9c00 x1874160212002304/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787338564.392583:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc91dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3313:1874160212001792:0@lo:38: 00000100:00100000:3.0:1787338564.392754:0:7634:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbfaccc000 going to sleep for 11 seconds 00000100:00100000:2.0:1787338564.393187:0:7648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338564.393216:0:7648:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbf41c1300 going to sleep for 11 seconds 00000100:00100000:1.0:1787338564.393347:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212002304 00000100:00100000:1.0:1787338564.393354:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212002304 00000100:00100000:1.0:1787338564.393406:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787338564.393416:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf46fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7648:x1874160212002304:12345-0@lo:901: 00000100:00100000:1.0:1787338564.393721:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf46fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7648:x1874160212002304:12345-0@lo:901: Request processed in 306us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338564.393728:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1787338564.393972:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787338564.393998:0:7648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90bbf46f9c00 x1874160212002304/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1787338580 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787338564.394009:0:7648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf46f9c00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7648:1874160212002304:0@lo:901: 20000000:01000000:0.0:1787338564.447729:0:5834:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787338564.447750:0:5834:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1787338564.447820:0:5855:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787338564.447825:0:5855:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787338564.447859:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90bc021c9c00/0x83671231080c1352 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338564.447917:0:5855:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90bbc14a8200/0x83671231080c12a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c129c expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338564.447927:0:5855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90bc021c9c00/0x83671231080c1352 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338564.447965:0:5855:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90bbc14a8200/0x83671231080c12a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x83671231080c129c expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338564.447980:0:5855:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90bbc14a8200/0x83671231080c12a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x83671231080c129c expref: 14 pid: 5834 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338564.447994:0:5855:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf46f9c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5855:1874160212002560:0@lo:104: 00000100:00100000:2.0:1787338564.448059:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338564.448105:0:5855:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbfaccc180 going to sleep for 11 seconds 00000100:00100000:0.0:1787338564.448218:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212002560 00000100:00100000:0.0:1787338564.448226:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212002560 00000100:00100000:0.0:1787338564.448290:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787338564.448301:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf46fb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d79243c8-b367-45ff-8d76-fbaa4be8becb+3:5855:x1874160212002560:12345-0@lo:104: 00010000:00010000:0.0:1787338564.448314:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.153@tcp lock: ffff90bc02045800/0x83671231080c129c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x83671231080c12a3 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338564.448363:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787338564.448369:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf46fb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d79243c8-b367-45ff-8d76-fbaa4be8becb+3:5855:x1874160212002560:12345-0@lo:104: Request processed in 71us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338564.448376:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1787338564.448515:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787338564.448522:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.153@tcp lock: ffff90bc02045800/0x83671231080c129c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x83671231080c12a3 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338564.448531:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bc02045800 already unused, calling callback (ffffffffc1b2ec20) 10000000:00010000:1.0:1787338564.448534:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.153@tcp lock: ffff90bc02045800/0x83671231080c129c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x83671231080c12a3 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338564.448543:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.153@tcp lock: ffff90bc02045800/0x83671231080c129c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x83671231080c12a3 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787338564.448558:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.153@tcp lock: ffff90bc02045800/0x83671231080c129c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x83671231080c12a3 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787338564.448564:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787338564.448599:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.153@tcp lock: ffff90bc02045800/0x83671231080c129c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c12a3 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338564.448606:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787338564.448624:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.153@tcp lock: ffff90bc02045800/0x83671231080c129c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c12a3 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338564.448631:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.153@tcp lock: ffff90bc02045800/0x83671231080c129c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c12a3 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338564.448649:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338564.448651:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338564.448653:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787338564.448665:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee44f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d79243c8-b367-45ff-8d76-fbaa4be8becb:3317:1874160212002688:0@lo:103: 00000100:00100000:1.0:1787338564.448698:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338564.448735:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212002688 00000100:00100000:1.0:1787338564.448739:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212002688 00010000:00010000:1.0:1787338564.448757:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90bbc14a8200/0x83671231080c12a3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x83671231080c129c expref: 15 pid: 5834 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338564.448780:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787338564.448787:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc7c21050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d79243c8-b367-45ff-8d76-fbaa4be8becb+15:3317:x1874160212002688:12345-0@lo:103: 00010000:00010000:1.0:1787338564.448798:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787338564.448804:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90bbc14a8200/0x83671231080c12a3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x83671231080c129c expref: 15 pid: 5834 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338564.455511:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90bbc14a8200/0x83671231080c12a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x83671231080c129c expref: 15 pid: 5834 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338564.455534:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90bc021c9c00/0x83671231080c1352 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338564.455543:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bc021c9c00/0x83671231080c1352 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787338564.455562:0:5825:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007736695s 00010000:00010000:1.0:1787338564.455567:0:5825:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90bc021c9c00/0x83671231080c1352 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338564.455573:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90bc021c9c00/0x83671231080c1352 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338564.455579:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90bc021c9c00/0x83671231080c1352 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338564.455586:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90bc021c9c00/0x83671231080c1352 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338564.455592:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bc021c9c00 already unused, calling callback (ffffffffc1546230) 00010000:00010000:1.0:1787338564.455597:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90bc021c9c00/0x83671231080c1352 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338564.455604:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90bc021c9c00/0x83671231080c1352 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338564.455614:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90bc021c9c00/0x83671231080c1352 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338564.455643:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787338564.455718:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc7c21050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d79243c8-b367-45ff-8d76-fbaa4be8becb+15:3317:x1874160212002688:12345-0@lo:103: Request processed in 6930us (7018us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338564.455727:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787338564.455830:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee44f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d79243c8-b367-45ff-8d76-fbaa4be8becb:3317:1874160212002688:0@lo:103: 00010000:00010000:2.0:1787338564.456206:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90bbc14a8200/0x83671231080c12a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x83671231080c129c expref: 14 pid: 5834 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338564.456220:0:5855:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf46f9c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5855:1874160212002560:0@lo:104: 00010000:00010000:2.0:1787338564.456263:0:5855:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90bc021c9c00/0x83671231080c1352 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338564.456273:0:5855:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90bc021c9c00/0x83671231080c1352 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338564.456279:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90bc021c9c00/0x83671231080c1352 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338564.456297:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90bc021c9c00/0x83671231080c1352 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338564.465390:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc7da6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+13:7634:x1874160212002432:12345-0@lo:253: Request processed in 74616us (74731us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338564.465405:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787338564.465520:0:7634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf46f9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d79243c8-b367-45ff-8d76-fbaa4be8becb:7634:1874160212002432:0@lo:253: 10000000:01000000:3.0:1787338564.465534:0:7634:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1787338564.465538:0:7634:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787338564.465539:0:7634:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787338564.465540:0:7634:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787338564.465541:0:7634:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787338564.465542:0:7634:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787338564.465544:0:7634:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787338564.465545:0:7634:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787338564.465547:0:7634:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787338564.465548:0:7634:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787338564.465550:0:7634:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787338564.465552:0:7634:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787338564.465578:0:7634:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1787338564.477311:0:7634:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1787338564.477508:0:7634:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1787338564.477712:0:7634:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1787338564.480383:0:7634:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1787338564.480721:0:7634:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1787338564.481192:0:7634:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1787338564.484660:0:7634:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1787338564.811420:0:7634:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1787338564.811426:0:7634:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1787338564.811455:0:7634:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787338564.811507:0:7634:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.153@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787338564.811522:0:7634:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1787338564.811550:0:7634:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1787338565.302176:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787338565.750075:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787338565.750102:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf46f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874160212002816:0@lo:13: 00000100:00100000:1.0:1787338565.750186:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338565.750351:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212002816 00000100:00100000:2.0:1787338565.750360:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212002816 00000100:00100000:2.0:1787338565.750415:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787338565.750426:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee44f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874160212002816:12345-0@lo:13: 00002000:00000024:2.0:1787338565.750464:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787338565.750521:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee44f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874160212002816:12345-0@lo:13: Request processed in 97us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338565.750529:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1787338565.752021:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbf46f9c00 x1874160212002816/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787338581 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787338565.752052:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf46f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874160212002816:0@lo:13: 00010000:00010000:1.0:1787338566.338054:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338567.352768:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338568.374847:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338569.402413:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787338569.846179:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf46f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874160212003328:0@lo:400: 00000100:00100000:2.0:1787338569.846261:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338569.846349:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787338569.846356:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf46fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d79243c8-b367-45ff-8d76-fbaa4be8becb:3314:1874160212002944:0@lo:400: 00000100:00100000:2.0:1787338569.846384:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338569.846407:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf46fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1874160212003456:0@lo:400: 00000100:00100000:2.0:1787338569.846440:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338569.846465:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf46f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874160212003072:0@lo:400: 00000100:00100000:2.0:1787338569.846486:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338569.846500:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787338569.846505:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf46f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874160212003200:0@lo:400: 00000100:00100000:2.0:1787338569.846521:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338569.846555:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212003328 00000100:00100000:2.0:1787338569.846562:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212003328 00000100:00100000:2.0:1787338569.846624:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787338569.846653:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf46f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1874160212003328:12345-0@lo:400: 00000100:00100000:2.0:1787338569.846714:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf46f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1874160212003328:12345-0@lo:400: Request processed in 63us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338569.846851:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787338569.846906:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212002944 00000100:00100000:2.0:1787338569.846911:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212002944 00000100:00100000:2.0:1787338569.846943:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787338569.846949:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc7da5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+13:3314:x1874160212002944:12345-0@lo:400: 00000100:00100000:2.0:1787338569.846982:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc7da5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+13:3314:x1874160212002944:12345-0@lo:400: Request processed in 33us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338569.846989:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787338569.847018:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212003456 00000100:00100000:2.0:1787338569.847021:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212003456 00000100:00100000:2.0:1787338569.847048:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212003072 00000100:00100000:2.0:1787338569.847050:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212003072 00000100:00100000:2.0:1787338569.847060:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212003200 00000100:00100000:2.0:1787338569.847062:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212003200 00000100:00100000:2.0:1787338569.847074:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787338569.847079:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf46fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874160212003456:12345-0@lo:400: 00000100:00100000:2.0:1787338569.847106:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf46fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874160212003456:12345-0@lo:400: Request processed in 27us (666us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338569.847112:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787338569.847121:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787338569.847126:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf46f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874160212003072:12345-0@lo:400: 00000100:00100000:2.0:1787338569.847159:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf46f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874160212003072:12345-0@lo:400: Request processed in 23us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338569.847166:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787338569.847175:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787338569.847187:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf46fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874160212003200:12345-0@lo:400: 00000100:00100000:2.0:1787338569.847210:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf46fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874160212003200:12345-0@lo:400: Request processed in 24us (689us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338569.847216:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1787338569.847232:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787338569.847237:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787338569.847263:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbf46f8380 x1874160212003200/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787338585 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787338569.847277:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf46f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874160212003200:0@lo:400: 00010000:00080000:2.0:1787338569.847286:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbf46f8a80 x1874160212003072/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787338585 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787338569.847295:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf46f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874160212003072:0@lo:400: 00000100:00100000:2.0:1787338569.847320:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf46fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d79243c8-b367-45ff-8d76-fbaa4be8becb:3314:1874160212002944:0@lo:400: 00010000:00080000:2.0:1787338569.847329:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbf46fb480 x1874160212003456/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787338585 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787338569.847337:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf46fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1874160212003456:0@lo:400: 00010000:00080000:2.0:1787338569.847347:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbf46f9180 x1874160212003328/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787338585 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787338569.847355:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf46f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874160212003328:0@lo:400: 00010000:00010000:1.0:1787338570.434682:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787338570.870451:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787338570.870479:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf46f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874160212003584:0@lo:13: 00000100:00100000:2.0:1787338570.870547:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338570.870609:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212003584 00000100:00100000:2.0:1787338570.870617:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212003584 00000100:00100000:2.0:1787338570.870675:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787338570.870684:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf46fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874160212003584:12345-0@lo:13: 00002000:00000024:2.0:1787338570.870735:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787338570.870782:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf46fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874160212003584:12345-0@lo:13: Request processed in 98us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338570.870790:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1787338570.870833:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbf46f9180 x1874160212003584/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787338586 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787338570.870851:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf46f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874160212003584:0@lo:13: 10000000:01000000:1.0:1787338571.400847:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787338571.400855:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90bbc9632800 from 30 10000000:01000000:1.0:1787338571.400860:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787338571.400914:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bc02045600/0x83671231080c1359 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338571.400925:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.153@tcp lock: ffff90bc02045600/0x83671231080c1359 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338571.400936:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.153@tcp lock: ffff90bc02045600/0x83671231080c1359 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338571.400972:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee44c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212003712:0@lo:101: 00000100:00100000:1.0:1787338571.401037:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338571.401083:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212003712 00000100:00100000:1.0:1787338571.401089:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212003712 00000100:00100000:1.0:1787338571.401145:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787338571.401154:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc7da6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+13:5836:x1874160212003712:12345-0@lo:101: 00010000:00010000:1.0:1787338571.401165:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787338571.401177:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90bc02044a00/0x83671231080c1360 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x83671231080c1359 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338571.401196:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bc02044a00/0x83671231080c1360 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x83671231080c1359 expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338571.401205:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90bc02044a00/0x83671231080c1360 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c1359 expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338571.401214:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bc02044a00, rc 0) 00000100:00100000:1.0:1787338571.401243:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc7da6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+14:5836:x1874160212003712:12345-0@lo:101: Request processed in 90us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338571.401250:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787338571.401302:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbd1b79480 going to sleep for 11 seconds 00000100:00100000:1.0:1787338571.401319:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee44c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212003712:0@lo:101: 00010000:00010000:1.0:1787338571.401331:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.153@tcp lock: ffff90bc02045600/0x83671231080c1359 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c1360 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338571.404727:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.153@tcp lock: ffff90bc02045600/0x83671231080c1359 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x83671231080c1360 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338571.404838:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee44c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212003840:0@lo:501: 00000100:00100000:1.0:1787338571.404914:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338571.404958:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbd1b79480 going to sleep for 11 seconds 00000100:00100000:3.0:1787338571.405092:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212003840 00000100:00100000:3.0:1787338571.405100:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212003840 00000100:00100000:3.0:1787338571.405154:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787338571.405164:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc7da6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+14:5836:x1874160212003840:12345-0@lo:501: 00000100:00100000:3.0:1787338571.407143:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc7da6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+14:5836:x1874160212003840:12345-0@lo:501: Request processed in 1973us (2222us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338571.407154:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787338571.407377:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee44c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212003840:0@lo:501: 00000100:00100000:1.0:1787338571.407426:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee44c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212003968:0@lo:503: 00000100:00100000:1.0:1787338571.407477:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338571.407652:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212003968 00000100:00100000:2.0:1787338571.407659:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212003968 00000100:00100000:2.0:1787338571.407701:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787338571.407711:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc408b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+14:5836:x1874160212003968:12345-0@lo:503: 00000100:00100000:2.0:1787338571.408354:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc408b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+14:5836:x1874160212003968:12345-0@lo:503: Request processed in 642us (873us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338571.408362:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787338571.408471:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbd1b79480 going to sleep for 11 seconds 00000100:00100000:1.0:1787338571.408487:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee44c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212003968:0@lo:503: 00000100:00100000:3.0:1787338571.412919:0:7943:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee560700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d79243c8-b367-45ff-8d76-fbaa4be8becb:7943:1874160212004096:0@lo:502: 00000100:00100000:3.0:1787338571.413003:0:7943:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338571.413040:0:7943:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbf7e2e600 going to sleep for 11 seconds 00000100:00100000:1.0:1787338571.413097:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212004096 00000100:00100000:1.0:1787338571.413105:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212004096 00000100:00100000:1.0:1787338571.413163:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787338571.413173:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc408b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+14:7943:x1874160212004096:12345-0@lo:502: 00000100:00100000:1.0:1787338571.413486:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc408b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+14:7943:x1874160212004096:12345-0@lo:502: Request processed in 314us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338571.413494:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787338571.413723:0:7943:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee560700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d79243c8-b367-45ff-8d76-fbaa4be8becb:7943:1874160212004096:0@lo:502: 00000100:00100000:0.0:1787338571.418978:0:7943:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbed9ca680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d79243c8-b367-45ff-8d76-fbaa4be8becb:7943:1874160212004224:0@lo:502: 00000100:00100000:0.0:1787338571.419064:0:7943:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338571.419101:0:7943:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbfbcd86c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787338571.419188:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212004224 00000100:00100000:3.0:1787338571.419196:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212004224 00000100:00100000:3.0:1787338571.419249:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787338571.419259:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc408a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+14:7943:x1874160212004224:12345-0@lo:502: 00000100:00100000:3.0:1787338571.419508:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc408a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+14:7943:x1874160212004224:12345-0@lo:502: Request processed in 249us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338571.419531:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787338571.419786:0:7943:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbed9ca680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d79243c8-b367-45ff-8d76-fbaa4be8becb:7943:1874160212004224:0@lo:502: 00000040:00080000:0.0:1787338571.419809:0:7943:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1787338571.420309:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1787338571.420326:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787338571.420347:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bc02045600/0x83671231080c1359 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c1360 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338571.420359:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.153@tcp lock: ffff90bc02045600/0x83671231080c1359 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c1360 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787338571.420369:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1787338571.420372:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:3.0:1787338571.420375:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787338571.420401:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbc14a8c00/0x83671231080c1367 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338571.420410:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.153@tcp lock: ffff90bbc14a8c00/0x83671231080c1367 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338571.420418:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.153@tcp lock: ffff90bbc14a8c00/0x83671231080c1367 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338571.420431:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee560700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212004352:0@lo:101: 00000100:00100000:3.0:1787338571.420463:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338571.420494:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbf7e2e900 going to sleep for 11 seconds 00000100:00100000:0.0:1787338571.420684:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212004352 00000100:00100000:0.0:1787338571.420690:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212004352 00000100:00100000:0.0:1787338571.420730:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787338571.420738:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc408bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+14:5836:x1874160212004352:12345-0@lo:101: 00010000:00010000:0.0:1787338571.420748:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787338571.420761:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90bbc0030800/0x83671231080c136e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x83671231080c1367 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338571.420784:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bbc0030800/0x83671231080c136e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x83671231080c1367 expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338571.420794:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90bbc0030800/0x83671231080c136e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c1367 expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338571.420803:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbc0030800, rc 0) 00000100:00100000:0.0:1787338571.420841:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc408bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+15:5836:x1874160212004352:12345-0@lo:101: Request processed in 104us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338571.420848:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787338571.420907:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee560700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212004352:0@lo:101: 00010000:00010000:0.0:1787338571.420920:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.153@tcp lock: ffff90bbc14a8c00/0x83671231080c1367 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c136e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338571.420929:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.153@tcp lock: ffff90bbc14a8c00/0x83671231080c1367 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x83671231080c136e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338571.420986:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbed9ca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212004480:0@lo:501: 00000100:00100000:0.0:1787338571.421012:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338571.421030:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212004480 00000100:00100000:0.0:1787338571.421034:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212004480 00000100:00100000:0.0:1787338571.421053:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787338571.421059:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4089850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+15:5836:x1874160212004480:12345-0@lo:501: 00000100:00100000:0.0:1787338571.421273:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4089850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+15:5836:x1874160212004480:12345-0@lo:501: Request processed in 213us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338571.421280:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787338571.421301:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbfbcd8480 going to sleep for 11 seconds 00000100:00100000:0.0:1787338571.421312:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbed9ca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212004480:0@lo:501: 00000100:00100000:0.0:1787338571.421349:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbed9ca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212004608:0@lo:503: 00000100:00100000:0.0:1787338571.421385:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338571.421403:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212004608 00000100:00100000:0.0:1787338571.421406:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212004608 00000100:00100000:0.0:1787338571.421424:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787338571.421430:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc408b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+15:5836:x1874160212004608:12345-0@lo:503: 00000100:00100000:0.0:1787338571.421868:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc408b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+15:5836:x1874160212004608:12345-0@lo:503: Request processed in 437us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338571.421895:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787338571.421925:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbfbcd8480 going to sleep for 11 seconds 00000100:00100000:0.0:1787338571.421937:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbed9ca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212004608:0@lo:503: 00000100:00100000:3.0:1787338571.424694:0:7944:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee563800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d79243c8-b367-45ff-8d76-fbaa4be8becb:7944:1874160212004736:0@lo:502: 00000100:00100000:3.0:1787338571.424768:0:7944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338571.424810:0:7944:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbf7e2e900 going to sleep for 11 seconds 00000100:00100000:3.0:1787338571.426683:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212004736 00000100:00100000:3.0:1787338571.426693:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212004736 00000100:00100000:3.0:1787338571.426741:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787338571.426750:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4088c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+15:7944:x1874160212004736:12345-0@lo:502: 00000100:00100000:3.0:1787338571.427055:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4088c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+15:7944:x1874160212004736:12345-0@lo:502: Request processed in 306us (2287us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338571.427064:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787338571.427121:0:7944:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee563800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d79243c8-b367-45ff-8d76-fbaa4be8becb:7944:1874160212004736:0@lo:502: 00000020:01000000:3.0:1787338571.427164:0:7944:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787338571.427173:0:7944:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787338571.427175:0:7944:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787338571.427180:0:7944:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787338571.427182:0:7944:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1787338571.427207:0:7944:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee563800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d79243c8-b367-45ff-8d76-fbaa4be8becb:7944:1874160212004864:0@lo:502: 00000100:00100000:3.0:1787338571.427246:0:7944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338571.427272:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212004864 00000100:00100000:3.0:1787338571.427276:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212004864 00000100:00100000:3.0:1787338571.427298:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787338571.427304:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4089c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+15:7944:x1874160212004864:12345-0@lo:502: 00000100:00100000:3.0:1787338571.427425:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4089c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+15:7944:x1874160212004864:12345-0@lo:502: Request processed in 120us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338571.427432:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787338571.427469:0:7944:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbf7e2e900 going to sleep for 11 seconds 00000100:00100000:3.0:1787338571.427481:0:7944:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee563800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d79243c8-b367-45ff-8d76-fbaa4be8becb:7944:1874160212004864:0@lo:502: 00000020:01000000:3.0:1787338571.427502:0:7944:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787338571.427506:0:7944:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787338571.427507:0:7944:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787338571.429891:0:7944:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:0.0:1787338571.432163:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:0.0:1787338571.432192:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.153@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787338571.432210:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbc14a8c00/0x83671231080c1367 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c136e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338571.432222:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.153@tcp lock: ffff90bbc14a8c00/0x83671231080c1367 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c136e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787338571.432232:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787338571.432235:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90bbd0622000 from 30 10000000:01000000:0.0:1787338571.432238:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787338571.432273:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbc0030c00/0x83671231080c1375 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338571.432281:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.153@tcp lock: ffff90bbc0030c00/0x83671231080c1375 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338571.432292:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.153@tcp lock: ffff90bbc0030c00/0x83671231080c1375 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338571.432315:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbed9ca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212004992:0@lo:101: 00000100:00100000:1.0:1787338571.434893:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338571.434938:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbfbcd8480 going to sleep for 11 seconds 00000100:00100000:0.0:1787338571.436040:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212004992 00000100:00100000:0.0:1787338571.436050:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212004992 00000100:00100000:0.0:1787338571.436110:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787338571.436121:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4089450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+15:5836:x1874160212004992:12345-0@lo:101: 00010000:00010000:0.0:1787338571.436152:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787338571.436169:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90bbc0030200/0x83671231080c137c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x83671231080c1375 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338571.436194:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bbc0030200/0x83671231080c137c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x83671231080c1375 expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338571.436219:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90bbc0030200/0x83671231080c137c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c1375 expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338571.436228:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbc0030200, rc 0) 00000100:00100000:0.0:1787338571.436284:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4089450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+16:5836:x1874160212004992:12345-0@lo:101: Request processed in 164us (1414us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338571.436290:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787338571.436688:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbed9ca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212004992:0@lo:101: 00010000:00010000:1.0:1787338571.436707:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.153@tcp lock: ffff90bbc0030c00/0x83671231080c1375 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c137c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338571.436717:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.153@tcp lock: ffff90bbc0030c00/0x83671231080c1375 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x83671231080c137c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338571.436783:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee44c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212005120:0@lo:501: 00000100:00100000:1.0:1787338571.436836:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338571.436870:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbde22db40 going to sleep for 11 seconds 00000100:00100000:0.0:1787338571.436999:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212005120 00000100:00100000:0.0:1787338571.437004:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212005120 00000100:00100000:0.0:1787338571.437038:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787338571.437045:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc408a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+16:5836:x1874160212005120:12345-0@lo:501: 00000100:00100000:0.0:1787338571.437292:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc408a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+16:5836:x1874160212005120:12345-0@lo:501: Request processed in 247us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338571.437300:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787338571.437657:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee44c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212005120:0@lo:501: 00000100:00100000:1.0:1787338571.437687:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee44c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212005248:0@lo:503: 00000100:00100000:1.0:1787338571.437724:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338571.437756:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbde22db40 going to sleep for 11 seconds 00000100:00100000:0.0:1787338571.437910:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212005248 00000100:00100000:0.0:1787338571.437915:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212005248 00000100:00100000:0.0:1787338571.437942:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787338571.437949:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4089050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+16:5836:x1874160212005248:12345-0@lo:503: 00000100:00100000:0.0:1787338571.438083:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4089050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+16:5836:x1874160212005248:12345-0@lo:503: Request processed in 133us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338571.438089:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787338571.438175:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee44c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212005248:0@lo:503: 00000100:00100000:2.0:1787338571.445748:0:7947:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf46f9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d79243c8-b367-45ff-8d76-fbaa4be8becb:7947:1874160212005376:0@lo:502: 00000100:00100000:2.0:1787338571.445829:0:7947:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338571.445891:0:7947:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc41126c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787338571.445960:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212005376 00000100:00100000:3.0:1787338571.445967:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212005376 00000100:00100000:3.0:1787338571.446017:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787338571.446027:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc408ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+16:7947:x1874160212005376:12345-0@lo:502: 00000100:00100000:3.0:1787338571.446275:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc408ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+16:7947:x1874160212005376:12345-0@lo:502: Request processed in 249us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338571.446284:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787338571.446372:0:7947:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf46f9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d79243c8-b367-45ff-8d76-fbaa4be8becb:7947:1874160212005376:0@lo:502: 00000100:00100000:2.0:1787338571.446416:0:7947:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf46f9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d79243c8-b367-45ff-8d76-fbaa4be8becb:7947:1874160212005504:0@lo:502: 00000100:00100000:2.0:1787338571.446449:0:7947:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338571.446479:0:7947:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc41126c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787338571.446904:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212005504 00000100:00100000:3.0:1787338571.446909:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212005504 00000100:00100000:3.0:1787338571.446940:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787338571.446947:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc408a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+16:7947:x1874160212005504:12345-0@lo:502: 00000100:00100000:3.0:1787338571.447092:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc408a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+16:7947:x1874160212005504:12345-0@lo:502: Request processed in 145us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338571.447099:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787338571.447198:0:7947:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf46f9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d79243c8-b367-45ff-8d76-fbaa4be8becb:7947:1874160212005504:0@lo:502: 00000040:00080000:2.0:1787338571.447217:0:7947:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1787338571.447363:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1787338571.447382:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787338571.447390:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbc0030c00/0x83671231080c1375 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c137c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338571.447401:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.153@tcp lock: ffff90bbc0030c00/0x83671231080c1375 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c137c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787338571.447410:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787338571.447413:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90bbd0622000 from 5 10000000:01000000:3.0:1787338571.447416:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787338571.447447:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbc14a9400/0x83671231080c1383 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338571.447456:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.153@tcp lock: ffff90bbc14a9400/0x83671231080c1383 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338571.447465:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.153@tcp lock: ffff90bbc14a9400/0x83671231080c1383 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338571.447477:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee563800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212005632:0@lo:101: 00000100:00100000:3.0:1787338571.447504:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338571.447543:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbde5ea9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787338571.447669:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212005632 00000100:00100000:2.0:1787338571.447674:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212005632 00000100:00100000:2.0:1787338571.447706:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787338571.447714:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4088850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+16:5836:x1874160212005632:12345-0@lo:101: 00010000:00010000:2.0:1787338571.447723:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787338571.447736:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90bc021c9c00/0x83671231080c138a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x83671231080c1383 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338571.447755:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bc021c9c00/0x83671231080c138a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x83671231080c1383 expref: 17 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338571.447766:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90bc021c9c00/0x83671231080c138a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c1383 expref: 17 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338571.447775:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bc021c9c00, rc 0) 00000100:00100000:2.0:1787338571.447803:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4088850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+17:5836:x1874160212005632:12345-0@lo:101: Request processed in 90us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338571.447810:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00010000:00010000:2.0:1787338571.448173:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787338571.448661:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee563800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212005632:0@lo:101: 00010000:00010000:3.0:1787338571.448676:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.153@tcp lock: ffff90bbc14a9400/0x83671231080c1383 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c138a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338571.448686:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.153@tcp lock: ffff90bbc14a9400/0x83671231080c1383 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x83671231080c138a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338571.448731:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee563800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212005760:0@lo:256: 00000100:00100000:3.0:1787338571.448767:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338571.448796:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbde5ea9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787338571.448837:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212005760 00000100:00100000:2.0:1787338571.448842:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212005760 00000100:00100000:2.0:1787338571.448906:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787338571.448914:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4088050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+17:5836:x1874160212005760:12345-0@lo:256: 20000000:01000000:2.0:1787338571.448930:0:5833:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787338571.448947:0:5833:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787338571.448950:0:5833:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1787338571.449019:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4088050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+17:5836:x1874160212005760:12345-0@lo:256: Request processed in 105us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338571.449026:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787338571.449230:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee563800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212005760:0@lo:256: 10000000:01000000:3.0:1787338571.449271:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.153@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787338571.449278:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbc14a9400/0x83671231080c1383 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c138a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338571.449285:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.153@tcp lock: ffff90bbc14a9400/0x83671231080c1383 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c138a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787338571.449299:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1787338571.449301:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:3.0:1787338571.449304:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787338571.449323:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbc14a8200/0x83671231080c1391 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338571.449331:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.153@tcp lock: ffff90bbc14a8200/0x83671231080c1391 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338571.449350:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.153@tcp lock: ffff90bbc14a8200/0x83671231080c1391 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338571.449362:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee563800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212005888:0@lo:101: 00000100:00100000:3.0:1787338571.449386:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338571.449412:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbde5ea9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787338571.449926:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212005888 00000100:00100000:2.0:1787338571.449932:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212005888 00000100:00100000:2.0:1787338571.449962:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787338571.449970:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4088450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+17:5836:x1874160212005888:12345-0@lo:101: 00010000:00010000:2.0:1787338571.449979:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787338571.449991:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90bc021c8200/0x83671231080c1398 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x83671231080c1391 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338571.450010:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bc021c8200/0x83671231080c1398 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x83671231080c1391 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338571.450020:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90bc021c8200/0x83671231080c1398 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c1391 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338571.450028:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bc021c8200, rc 0) 00000100:00100000:2.0:1787338571.450060:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4088450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+18:5836:x1874160212005888:12345-0@lo:101: Request processed in 91us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338571.450066:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787338571.450350:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee563800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212005888:0@lo:101: 00010000:00010000:3.0:1787338571.450363:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.153@tcp lock: ffff90bbc14a8200/0x83671231080c1391 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c1398 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338571.450371:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.153@tcp lock: ffff90bbc14a8200/0x83671231080c1391 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x83671231080c1398 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338571.450415:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee563800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212006016:0@lo:501: 00000100:00100000:3.0:1787338571.450441:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338571.450471:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbde5ea9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787338571.450522:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212006016 00000100:00100000:0.0:1787338571.450526:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212006016 00000100:00100000:0.0:1787338571.450557:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787338571.450564:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4012050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+18:5836:x1874160212006016:12345-0@lo:501: 00000100:00100000:0.0:1787338571.450801:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4012050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+18:5836:x1874160212006016:12345-0@lo:501: Request processed in 237us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338571.450825:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787338571.451309:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee563800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212006016:0@lo:501: 00000100:00100000:3.0:1787338571.451347:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee563800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212006144:0@lo:503: 00000100:00100000:3.0:1787338571.451393:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338571.451423:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbde5ea9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787338571.451462:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212006144 00000100:00100000:2.0:1787338571.451467:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212006144 00000100:00100000:2.0:1787338571.451499:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787338571.451507:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4011050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+18:5836:x1874160212006144:12345-0@lo:503: 00000100:00100000:2.0:1787338571.451846:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4011050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+18:5836:x1874160212006144:12345-0@lo:503: Request processed in 339us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338571.451853:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787338571.452212:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee563800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212006144:0@lo:503: 00000100:00100000:3.0:1787338571.462078:0:7948:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee563800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d79243c8-b367-45ff-8d76-fbaa4be8becb:7948:1874160212006272:0@lo:502: 00000100:00100000:3.0:1787338571.462182:0:7948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338571.462234:0:7948:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbde5eae40 going to sleep for 11 seconds 00000100:00100000:2.0:1787338571.462285:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212006272 00000100:00100000:2.0:1787338571.462293:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212006272 00000100:00100000:2.0:1787338571.462353:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787338571.462363:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4012c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+18:7948:x1874160212006272:12345-0@lo:502: 00000100:00100000:2.0:1787338571.462697:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4012c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+18:7948:x1874160212006272:12345-0@lo:502: Request processed in 335us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338571.462706:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787338571.463162:0:7948:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee563800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d79243c8-b367-45ff-8d76-fbaa4be8becb:7948:1874160212006272:0@lo:502: 00000020:01000000:3.0:1787338571.463193:0:7948:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787338571.463202:0:7948:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1787338571.463209:0:7948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787338571.463211:0:7948:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1787338571.463217:0:7948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787338571.463221:0:7948:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.153@tcp to nid 0x20000c0a8c999 (192.168.201.153@tcp) 00000020:01000000:3.0:1787338571.463244:0:7948:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787338571.463247:0:7948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787338571.463261:0:7948:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff90bbfc2499b8) 00000020:00000080:3.0:1787338571.463283:0:7948:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1787338571.463288:0:7948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787338571.463385:0:7948:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1787338571.463390:0:7948:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:3.0:1787338571.463398:0:7948:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x83671231080c13a6 00010000:00080000:3.0:1787338571.463423:0:7948:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90bac1f18000@lustre-OST0001-osc-MDT0000: add connection 192.168.201.153@tcp at head 00010000:00010000:3.0:1787338571.463647:0:7948:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:3.0:1787338571.464010:0:7948:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1787338571.464023:0:7948:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1787338571.465246:0:7948:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787338571.465470:0:7948:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787338571.472424:0:7948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1787338571.472610:0:7948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:0.0:1787338571.475538:0:7951:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787338571.475546:0:7951:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1787338571.477097:0:7948:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787338571.477110:0:7948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787338571.477154:0:7948:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1787338571.477177:0:7948:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x83671231080c13ad 00000100:00080000:3.0:1787338571.477187:0:7948:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787338571.477193:0:7948:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff90bac1f18000 using connection 192.168.201.153@tcp/0@lo 00000100:00100000:3.0:1787338571.477228:0:7948:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90bbee563800 x1874160212006400/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787338571.477250:0:7948:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1787338571.477302:0:7948:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787338571.477306:0:7948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787338571.477308:0:7948:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1787338571.477311:0:7948:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787338571.477315:0:7948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787338571.477316:0:7948:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787338571.477319:0:7948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787338571.477320:0:7948:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1787338571.477715:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee44c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874160212006656:0@lo:400: 00000100:00100000:1.0:1787338571.477775:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338571.477819:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787338571.477826:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee44f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1874160212007040:0@lo:400: 00000100:00100000:1.0:1787338571.477853:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338571.477896:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee44c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1874160212006784:0@lo:400: 00000100:00100000:1.0:1787338571.477917:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338571.477935:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787338571.477939:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee44df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874160212006912:0@lo:400: 00000100:00100000:1.0:1787338571.477959:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338571.477987:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212006656 00000100:00100000:1.0:1787338571.477993:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212006656 00000100:00100000:1.0:1787338571.478028:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212007040 00000100:00100000:1.0:1787338571.478031:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212007040 00000100:00100000:1.0:1787338571.478049:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212006784 00000100:00100000:1.0:1787338571.478052:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212006784 00000100:00100000:1.0:1787338571.478066:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787338571.478074:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee44d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874160212006656:12345-0@lo:400: 00000100:00100000:1.0:1787338571.478118:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee44d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874160212006656:12345-0@lo:400: Request processed in 45us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338571.478147:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787338571.478163:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787338571.478169:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee44e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1874160212007040:12345-0@lo:400: 00000100:00100000:1.0:1787338571.478197:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee44e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1874160212007040:12345-0@lo:400: Request processed in 29us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338571.478202:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787338571.478213:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787338571.478218:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee44e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874160212006784:12345-0@lo:400: 00000100:00100000:1.0:1787338571.478245:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee44e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874160212006784:12345-0@lo:400: Request processed in 27us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338571.478250:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787338571.478273:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212006912 00000100:00100000:1.0:1787338571.478276:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212006912 00000100:00100000:1.0:1787338571.478302:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787338571.478308:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee44ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874160212006912:12345-0@lo:400: 00000100:00100000:1.0:1787338571.478347:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee44ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874160212006912:12345-0@lo:400: Request processed in 29us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338571.478352:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1787338571.478370:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787338571.478374:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787338571.478399:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbee44df80 x1874160212006912/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787338587 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787338571.478412:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee44df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874160212006912:0@lo:400: 00010000:00080000:1.0:1787338571.478421:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbee44c000 x1874160212006784/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787338587 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787338571.478442:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee44c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1874160212006784:0@lo:400: 00010000:00080000:1.0:1787338571.478468:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbee44f480 x1874160212007040/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787338587 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787338571.478475:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee44f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1874160212007040:0@lo:400: 00010000:00080000:1.0:1787338571.478484:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbee44c700 x1874160212006656/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787338587 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787338571.478490:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee44c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874160212006656:0@lo:400: 00000100:00100000:3.0:1787338571.478748:0:7948:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee561f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d79243c8-b367-45ff-8d76-fbaa4be8becb:7948:1874160212006528:0@lo:502: 00000100:00100000:3.0:1787338571.478792:0:7948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338571.478896:0:7948:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc7c77240 going to sleep for 11 seconds 00000100:00100000:0.0:1787338571.479018:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee563800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1874160212006400:0@lo:8: 00000100:00100000:0.0:1787338571.479060:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338571.479132:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212006400 00000100:00100000:3.0:1787338571.479137:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212006400 00000100:00100000:1.0:1787338571.480555:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212006528 00000100:00100000:1.0:1787338571.480565:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212006528 00000100:00100000:1.0:1787338571.480615:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787338571.480625:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787338571.480625:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4012450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+18:7948:x1874160212006528:12345-0@lo:502: 00000100:00100000:3.0:1787338571.480631:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbed9cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3313:x1874160212006400:12345-0@lo:8: 00010000:00080000:3.0:1787338571.480657:0:6690:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 224 last 0 00000020:00000080:3.0:1787338571.480686:0:6690:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x83671231080c13b4 00002000:00100000:3.0:1787338571.480701:0:6690:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff90bac1f1c800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211392c ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1787338571.480705:0:6690:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:3.0:1787338571.480716:0:6690:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1787338571.480833:0:6690:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:1.0:1787338571.480915:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4012450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+18:7948:x1874160212006528:12345-0@lo:502: Request processed in 292us (2122us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338571.480923:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00002000:00080000:3.0:1787338571.480999:0:6690:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787338571.481024:0:6690:0:(import.c:65:import_set_state_nolock()) ffff90bac1f1d800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787338571.481083:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbed9cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3313:x1874160212006400:12345-0@lo:8: Request processed in 450us (2022us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338571.481089:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1787338571.481367:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbee563800 x1874160212006400/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787338581 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787338571.481378:0:3313:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787338571.481386:0:3313:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1787338571.481393:0:3313:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787338571.481397:0:3313:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1787338571.481400:0:3313:0:(import.c:65:import_set_state_nolock()) ffff90bac1f18000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787338571.481414:0:3313:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787338571.481420:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee563800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1874160212006400:0@lo:8: 00000004:00080000:1.0:1787338571.484679:0:7951:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787338571.484922:0:7951:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 224326047501ns, next at 0ns, rc = 0 00000100:00100000:2.0:1787338571.498599:0:7948:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee561f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d79243c8-b367-45ff-8d76-fbaa4be8becb:7948:1874160212006528:0@lo:502: 00000020:01000000:2.0:1787338571.498647:0:7948:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787338571.498654:0:7948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787338571.498656:0:7948:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787338571.498661:0:7948:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:2.0:1787338571.498736:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:2.0:1787338571.498753:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.153@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787338571.498762:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbc14a8200/0x83671231080c1391 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c1398 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338571.498774:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.153@tcp lock: ffff90bbc14a8200/0x83671231080c1391 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c1398 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787338571.498784:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1787338571.498787:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff90bbde3e99b8 from 1 10000000:01000000:2.0:1787338571.498789:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787338571.498832:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bc021c9200/0x83671231080c13bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338571.498840:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.153@tcp lock: ffff90bc021c9200/0x83671231080c13bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338571.498848:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.153@tcp lock: ffff90bc021c9200/0x83671231080c13bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338571.498866:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf46f9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212007168:0@lo:101: 00000100:00100000:2.0:1787338571.498949:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338571.498985:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc4e24540 going to sleep for 11 seconds 00000100:00100000:2.0:1787338571.499004:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212007168 00000100:00100000:2.0:1787338571.499010:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212007168 00000100:00100000:2.0:1787338571.499055:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787338571.499065:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4010850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+18:5836:x1874160212007168:12345-0@lo:101: 00010000:00010000:2.0:1787338571.499077:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787338571.499100:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90bbf40e3c00/0x83671231080c13c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x83671231080c13bb expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338571.499135:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bbf40e3c00/0x83671231080c13c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x83671231080c13bb expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338571.499146:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90bbf40e3c00/0x83671231080c13c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c13bb expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338571.499155:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf40e3c00, rc 0) 00000100:00100000:2.0:1787338571.499190:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4010850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+19:5836:x1874160212007168:12345-0@lo:101: Request processed in 126us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338571.499197:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787338571.499229:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf46f9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212007168:0@lo:101: 00010000:00010000:2.0:1787338571.499240:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.153@tcp lock: ffff90bc021c9200/0x83671231080c13bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c13c2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338571.499248:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.153@tcp lock: ffff90bc021c9200/0x83671231080c13bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x83671231080c13c2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338571.499287:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf46f9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212007296:0@lo:501: 00000100:00100000:2.0:1787338571.499319:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338571.499333:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc4e24540 going to sleep for 11 seconds 00000100:00100000:1.0:1787338571.499681:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212007296 00000100:00100000:1.0:1787338571.499687:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212007296 00000100:00100000:1.0:1787338571.499712:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787338571.499719:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4010050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+19:5836:x1874160212007296:12345-0@lo:501: 00000100:00100000:1.0:1787338571.501655:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4010050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+19:5836:x1874160212007296:12345-0@lo:501: Request processed in 1929us (2329us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787338571.501668:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787338571.502597:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf46f9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212007296:0@lo:501: 10000000:01000000:2.0:1787338571.502639:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.153@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787338571.502649:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bc021c9200/0x83671231080c13bb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c13c2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338571.502660:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.153@tcp lock: ffff90bc021c9200/0x83671231080c13bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c13c2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787338571.592372:0:7952:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:0.0:1787338571.592406:0:7952:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbed9cb480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7952:1874160212007552:0@lo:7: 00000100:00100000:0.0:1787338571.592471:0:7952:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338571.592528:0:7952:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc7c77240 going to sleep for 11 seconds 00000100:00100000:0.0:1787338571.592561:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbed9c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874160212007424:0@lo:13: 00000100:00100000:0.0:1787338571.592585:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338571.592624:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212007552 00000100:00100000:0.0:1787338571.592631:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212007552 00000100:00100000:0.0:1787338571.592681:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787338571.593398:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbed9c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7952:x1874160212007552:12345-0@lo:7: 00000100:00100000:1.0:1787338571.600063:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212007424 00000100:00100000:1.0:1787338571.600077:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212007424 00000100:00100000:1.0:1787338571.600160:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787338571.600184:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbed9cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3317:x1874160212007424:12345-0@lo:13: 00002000:00000024:1.0:1787338571.600224:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1787338571.600323:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbed9cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3317:x1874160212007424:12345-0@lo:13: Request processed in 140us (7736us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338571.600331:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1787338571.601954:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787338571.602182:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbed9c9880 x1874160212007424/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787338587 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787338571.602209:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbed9c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874160212007424:0@lo:13: 00002000:00080000:2.0:1787338571.606392:0:6691:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:2.0:1787338571.606401:0:6691:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:2.0:1787338571.606493:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbed9c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7952:x1874160212007552:12345-0@lo:7: Request processed in 13799us (14017us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338571.606503:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1787338571.611597:0:7952:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbed9cb480 x1874160212007552/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787338587 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787338571.611616:0:7952:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbed9cb480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7952:1874160212007552:0@lo:7: 00000004:00080000:1.0:1787338571.611631:0:7952:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:1.0:1787338571.611683:0:7952:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee44c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7952:1874160212007680:0@lo:5: 00000100:00100000:1.0:1787338571.611742:0:7952:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338571.612084:0:7952:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbef160d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787338571.612272:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212007680 00000100:00100000:3.0:1787338571.612280:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212007680 00000100:00100000:3.0:1787338571.612328:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787338571.612347:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee44f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7952:x1874160212007680:12345-0@lo:5: 00002000:00080000:3.0:1787338571.612377:0:6690:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1787338571.612382:0:6690:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1787338571.617161:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee44f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:7952:x1874160212007680:12345-0@lo:5: Request processed in 4811us (5406us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1787338571.617176:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1787338571.617240:0:7952:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbee44c700 x1874160212007680/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787338587 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787338571.617257:0:7952:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee44c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7952:1874160212007680:0@lo:5: 00000004:00080000:3.0:1787338571.617272:0:7952:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:3.0:1787338571.617313:0:7952:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee561f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7952:1874160212007808:0@lo:700: 00000100:00100000:3.0:1787338571.617347:0:7952:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338571.617378:0:7952:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc56eaa80 going to sleep for 11 seconds 00000100:00100000:3.0:1787338571.617396:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212007808 00000100:00100000:3.0:1787338571.617402:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212007808 00000100:00100000:3.0:1787338571.617441:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787338571.617451:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee563800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7952:x1874160212007808:12345-0@lo:700: 00000100:00100000:3.0:1787338571.617500:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee560700 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6697:1874160212007936:0@lo:700: 00000100:00100000:3.0:1787338571.617541:0:6697:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338571.617559:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbef160d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787338571.617576:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212007936 00000100:00100000:3.0:1787338571.617579:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212007936 00000100:00100000:3.0:1787338571.617606:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787338571.617613:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee561180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6697:x1874160212007936:12345-0@lo:700: 00000004:00080000:3.0:1787338571.661578:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 40000000:02000000:0.0:1787338571.732623:0:5846:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:1.0:1787338571.750321:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee561180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6697:x1874160212007936:12345-0@lo:700: Request processed in 132698us (132769us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338571.750340:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787338571.750364:0:6697:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbee560700 x1874160212007936/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787338587 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787338571.750389:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee560700 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6697:1874160212007936:0@lo:700: 40000000:02000000:0.0:1787338571.750403:0:6697:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000100:00100000:3.0:1787338571.851850:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee563800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7952:x1874160212007808:12345-0@lo:700: Request processed in 234391us (234493us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338571.851864:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000001:00080000:3.0:1787338571.851928:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:3.0:1787338571.851936:0:7651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00080000:1.0:1787338571.852657:0:7952:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbee561f80 x1874160212007808/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787338587 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787338571.852675:0:7952:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee561f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7952:1874160212007808:0@lo:700: 00000004:02000040:0.0:1787338571.901978:0:7952:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:0.0:1787338571.913957:0:7952:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbed9c9880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7952:1874160212008064:0@lo:5: 00000100:00100000:0.0:1787338571.914022:0:7952:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338571.914088:0:7952:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc61b8780 going to sleep for 11 seconds 00000100:00100000:2.0:1787338571.919127:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212008064 00000100:00100000:2.0:1787338571.919140:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212008064 00000100:00100000:2.0:1787338571.919205:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787338571.919215:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbed9c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:7952:x1874160212008064:12345-0@lo:5: 00002000:00080000:1.0:1787338571.929833:0:6691:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1787338571.929855:0:6691:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:1.0:1787338571.935419:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbed9c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7952:x1874160212008064:12345-0@lo:5: Request processed in 16198us (21389us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1787338571.935432:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1787338571.937866:0:7952:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbed9c9880 x1874160212008064/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787338587 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787338571.937922:0:7952:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1787338571.937944:0:7952:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff90bbed9c9880 x1874160212008064/t4294967298(4294967298) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787338587 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787338571.937956:0:7952:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbed9c9880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7952:1874160212008064:0@lo:5: 00000004:00080000:0.0:1787338571.937971:0:7952:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000001:02000400:1.0:1787338572.338760:0:7999:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg153-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787338572.475530:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787338573.494052:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338574.519940:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787338575.547814:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787338575.995145:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee44c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874160212008192:0@lo:13: 00000100:00100000:1.0:1787338575.995219:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338575.995293:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212008192 00000100:00100000:1.0:1787338575.995300:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212008192 00000100:00100000:1.0:1787338575.995353:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787338575.995362:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee44df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874160212008192:12345-0@lo:13: 00002000:00000024:1.0:1787338575.995396:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787338575.995436:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee44df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874160212008192:12345-0@lo:13: Request processed in 75us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338575.995444:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1787338575.995463:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787338575.995487:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbee44c000 x1874160212008192/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787338591 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787338575.995504:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee44c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874160212008192:0@lo:13: 00000100:00100000:3.0:1787338576.502126:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee563480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874160212008448:0@lo:400: 00000100:00100000:3.0:1787338576.502210:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338576.502263:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee560700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874160212008960:0@lo:400: 00000100:00100000:3.0:1787338576.502287:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338576.502318:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787338576.502323:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee562a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874160212008576:0@lo:400: 00000100:00100000:3.0:1787338576.502342:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338576.502375:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212008448 00000100:00100000:3.0:1787338576.502383:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212008448 00000100:00100000:3.0:1787338576.502423:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212008576 00000100:00100000:3.0:1787338576.502425:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212008576 00000100:00100000:3.0:1787338576.502456:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787338576.502466:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbedcb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874160212008448:12345-0@lo:400: 00000100:00100000:3.0:1787338576.502518:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbedcb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874160212008448:12345-0@lo:400: Request processed in 52us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338576.502531:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787338576.502549:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787338576.502555:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbedcb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874160212008576:12345-0@lo:400: 00000100:00100000:3.0:1787338576.502585:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbedcb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874160212008576:12345-0@lo:400: Request processed in 30us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338576.502590:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787338576.502624:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212008960 00000100:00100000:3.0:1787338576.502627:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212008960 00000100:00100000:3.0:1787338576.502659:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787338576.502666:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbedcb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3316:x1874160212008960:12345-0@lo:400: 00000100:00100000:3.0:1787338576.502697:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbedcb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3316:x1874160212008960:12345-0@lo:400: Request processed in 32us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338576.502704:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1787338576.502727:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787338576.502732:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787338576.502764:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbee562a00 x1874160212008576/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787338592 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787338576.502779:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee562a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874160212008576:0@lo:400: 00010000:00080000:3.0:1787338576.502790:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbee563480 x1874160212008448/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787338592 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787338576.502799:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee563480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874160212008448:0@lo:400: 00010000:00080000:3.0:1787338576.502808:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbee560700 x1874160212008960/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787338592 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787338576.502817:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee560700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874160212008960:0@lo:400: 00000100:00100000:1.0:1787338576.503046:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee560a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d79243c8-b367-45ff-8d76-fbaa4be8becb:3315:1874160212008320:0@lo:400: 00000100:00100000:1.0:1787338576.503087:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338576.503124:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee561f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1874160212008832:0@lo:400: 00000100:00100000:1.0:1787338576.503146:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338576.503163:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787338576.503168:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee561c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874160212008704:0@lo:400: 00000100:00100000:1.0:1787338576.503188:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338576.503214:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212008704 00000100:00100000:1.0:1787338576.503218:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212008704 00000100:00100000:1.0:1787338576.503243:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787338576.503249:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee44ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1874160212008704:12345-0@lo:400: 00000100:00100000:1.0:1787338576.503284:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee44ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1874160212008704:12345-0@lo:400: Request processed in 35us (95us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338576.503290:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1787338576.503582:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbee561c00 x1874160212008704/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787338592 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787338576.503593:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee561c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874160212008704:0@lo:400: 00000100:00100000:3.0:1787338576.503695:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212008320 00000100:00100000:3.0:1787338576.503705:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212008320 00000100:00100000:3.0:1787338576.503733:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787338576.503739:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4010450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+19:3315:x1874160212008320:12345-0@lo:400: 00000100:00100000:3.0:1787338576.503772:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4010450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+19:3315:x1874160212008320:12345-0@lo:400: Request processed in 34us (685us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338576.503778:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787338576.503807:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212008832 00000100:00100000:3.0:1787338576.503811:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212008832 00000100:00100000:3.0:1787338576.503836:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787338576.503843:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee44c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874160212008832:12345-0@lo:400: 00000100:00100000:3.0:1787338576.503904:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee44c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874160212008832:12345-0@lo:400: Request processed in 62us (757us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338576.503910:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:3.0:1787338576.503926:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787338576.504062:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee560a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d79243c8-b367-45ff-8d76-fbaa4be8becb:3315:1874160212008320:0@lo:400: 00010000:00080000:1.0:1787338576.504072:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbee561f80 x1874160212008832/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787338592 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787338576.504081:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee561f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1874160212008832:0@lo:400: 00010000:00010000:1.0:1787338576.572049:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787338576.887106:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:1.0:1787338577.017781:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee44ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874160212009088:0@lo:13: 00000100:00100000:1.0:1787338577.017845:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338577.017930:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212009088 00000100:00100000:1.0:1787338577.017937:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212009088 00000100:00100000:1.0:1787338577.017986:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787338577.017995:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee44c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874160212009088:12345-0@lo:13: 00002000:00000024:1.0:1787338577.018038:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787338577.018081:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee44c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874160212009088:12345-0@lo:13: Request processed in 87us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338577.018088:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1787338577.018129:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbee44ed80 x1874160212009088/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787338593 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787338577.018141:0:3317:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1787338577.018161:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee44ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874160212009088:0@lo:13: 00000100:00100000:2.0:1787338577.518249:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338577.518344:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192061568 00000100:00100000:0.0:1787338577.518353:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192061568 00000100:00100000:0.0:1787338577.518492:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 113 00000100:00100000:0.0:1787338577.518549:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4013450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2355:x1874160192061568:12345-192.168.201.53@tcp:250: 00010000:00080000:0.0:1787338577.518579:0:5833:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 7a12c8ed-039c-40f4-9fb4-eae17c6a12e4@192.168.201.53@tcp t0 exp 0000000000000000 cur 230 last 0 00000020:00000080:0.0:1787338577.518620:0:5833:0:(genops.c:1385:class_connect()) connect: client 7a12c8ed-039c-40f4-9fb4-eae17c6a12e4, cookie 0x83671231080c13c9 00000100:00080000:0.0:1787338577.518734:0:5833:0:(import.c:65:import_set_state_nolock()) ffff90bbfc171800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787338577.518808:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4013450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+5:2355:x1874160192061568:12345-192.168.201.53@tcp:250: Request processed in 306us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338577.518815:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 113 00000100:00100000:0.0:1787338577.558577:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338577.558639:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192061696 00000100:00100000:2.0:1787338577.558648:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192061696 00000100:00100000:2.0:1787338577.558696:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 114 00000100:00100000:2.0:1787338577.558705:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4013050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+5:5584:x1874160192061696:12345-192.168.201.53@tcp:101: 00010000:00010000:2.0:1787338577.558721:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787338577.558737:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90bbf40e2800/0x83671231080c13d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab56a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338577.558770:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bbf40e2800/0x83671231080c13d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab56a expref: 6 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338577.558778:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90bbf40e2800/0x83671231080c13d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab56a expref: 6 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338577.558786:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf40e2800, rc 0) 00000100:00100000:2.0:1787338577.558866:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4013050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+6:5584:x1874160192061696:12345-192.168.201.53@tcp:101: Request processed in 162us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338577.558889:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 114 00000100:00100000:3.0:1787338577.563107:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338577.563335:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192061824 00000100:00100000:2.0:1787338577.563346:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192061824 00000100:00100000:2.0:1787338577.563389:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 115 00000100:00100000:2.0:1787338577.563399:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4012850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+6:5584:x1874160192061824:12345-192.168.201.53@tcp:501: 00000100:00100000:2.0:1787338577.563665:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4012850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+6:5584:x1874160192061824:12345-192.168.201.53@tcp:501: Request processed in 267us (567us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787338577.563671:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 115 00000100:00100000:3.0:1787338577.566344:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338577.566704:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192061952 00000100:00100000:1.0:1787338577.566713:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192061952 00000100:00100000:1.0:1787338577.566802:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 116 00000100:00100000:1.0:1787338577.566814:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4013c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+6:5584:x1874160192061952:12345-192.168.201.53@tcp:101: 00010000:00010000:1.0:1787338577.566831:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787338577.566848:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90bc02045800/0x83671231080c13d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab571 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338577.566897:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bc02045800/0x83671231080c13d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab571 expref: 7 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338577.566910:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90bc02045800/0x83671231080c13d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab571 expref: 7 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338577.566922:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bc02045800, rc 0) 00000100:00100000:0.0:1787338577.567011:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4013c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+7:5584:x1874160192061952:12345-192.168.201.53@tcp:101: Request processed in 198us (672us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338577.567031:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 116 00000100:00100000:0.0:1787338577.568399:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338577.568460:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192062080 00000100:00100000:2.0:1787338577.568467:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192062080 00000100:00100000:2.0:1787338577.568509:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 117 00000100:00100000:2.0:1787338577.568517:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4011850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+7:5584:x1874160192062080:12345-192.168.201.53@tcp:501: 00000100:00100000:2.0:1787338577.568764:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4011850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+8:5584:x1874160192062080:12345-192.168.201.53@tcp:501: Request processed in 246us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338577.568772:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 117 00000100:00100000:3.0:1787338577.569913:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338577.569949:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192062208 00000100:00100000:0.0:1787338577.569955:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192062208 00000100:00100000:0.0:1787338577.569991:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 118 00000100:00100000:0.0:1787338577.569999:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4013850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+8:5584:x1874160192062208:12345-192.168.201.53@tcp:503: 00000100:00100000:0.0:1787338577.570377:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4013850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+8:5584:x1874160192062208:12345-192.168.201.53@tcp:503: Request processed in 378us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338577.570383:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 118 00000100:00100000:2.0:1787338577.573146:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338577.573266:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192062336 00000100:00100000:3.0:1787338577.573274:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192062336 00000100:00100000:3.0:1787338577.573324:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 119 00000100:00100000:3.0:1787338577.573335:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4010c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+8:5603:x1874160192062336:12345-192.168.201.53@tcp:502: 00000100:00100000:3.0:1787338577.573608:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4010c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+8:5603:x1874160192062336:12345-192.168.201.53@tcp:502: Request processed in 274us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338577.573616:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 119 00010000:00010000:1.0:1787338577.590077:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787338577.591351:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338577.591399:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192062464 00000100:00100000:0.0:1787338577.591408:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192062464 00000100:00100000:0.0:1787338577.591557:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 120 00000100:00100000:0.0:1787338577.591567:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4011c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+8:5603:x1874160192062464:12345-192.168.201.53@tcp:502: 00000100:00100000:0.0:1787338577.591803:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4011c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+8:5603:x1874160192062464:12345-192.168.201.53@tcp:502: Request processed in 238us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338577.591809:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 120 00000100:00100000:3.0:1787338577.593427:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338577.593711:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192062592 00000100:00100000:0.0:1787338577.593718:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192062592 00000100:00100000:0.0:1787338577.593781:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 121 00000100:00100000:0.0:1787338577.593787:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4011450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+8:5584:x1874160192062592:12345-192.168.201.53@tcp:101: 00010000:00010000:0.0:1787338577.593797:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787338577.593812:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90bbc0031200/0x83671231080c13de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab59b expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338577.593831:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bbc0031200/0x83671231080c13de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab59b expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338577.593838:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90bbc0031200/0x83671231080c13de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab59b expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338577.593858:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbc0031200, rc 0) 00000100:00100000:0.0:1787338577.593906:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4011450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+9:5584:x1874160192062592:12345-192.168.201.53@tcp:101: Request processed in 118us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338577.593910:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 121 00000100:00100000:1.0:1787338577.600299:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338577.600360:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192062720 00000100:00100000:0.0:1787338577.600383:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192062720 00000100:00100000:0.0:1787338577.600528:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 122 00000100:00100000:0.0:1787338577.600537:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc414f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+9:5584:x1874160192062720:12345-192.168.201.53@tcp:256: 20000000:01000000:0.0:1787338577.600559:0:5834:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1787338577.600574:0:5834:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787338577.600576:0:5834:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787338577.600579:0:5834:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1787338577.600580:0:5834:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1787338577.602804:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc414f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+9:5584:x1874160192062720:12345-192.168.201.53@tcp:256: Request processed in 2252us (2499us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338577.602827:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 122 00000100:00100000:1.0:1787338577.608595:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338577.608669:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192062848 00000100:00100000:0.0:1787338577.608678:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192062848 00000100:00100000:0.0:1787338577.608720:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 123 00000100:00100000:0.0:1787338577.608728:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc414e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+9:5584:x1874160192062848:12345-192.168.201.53@tcp:101: 00010000:00010000:0.0:1787338577.608740:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787338577.608753:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90bbc0031000/0x83671231080c13e5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab5a2 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338577.608774:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bbc0031000/0x83671231080c13e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab5a2 expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338577.608781:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90bbc0031000/0x83671231080c13e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab5a2 expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338577.608799:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbc0031000, rc 0) 00000100:00100000:0.0:1787338577.608844:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc414e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+10:5584:x1874160192062848:12345-192.168.201.53@tcp:101: Request processed in 117us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338577.608850:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 123 00000100:00100000:1.0:1787338577.610176:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338577.610254:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192062976 00000100:00100000:3.0:1787338577.610262:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192062976 00000100:00100000:3.0:1787338577.610306:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 124 00000100:00100000:3.0:1787338577.610315:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc414fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+10:5584:x1874160192062976:12345-192.168.201.53@tcp:501: 00000100:00100000:3.0:1787338577.610544:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc414fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+10:5584:x1874160192062976:12345-192.168.201.53@tcp:501: Request processed in 230us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338577.610551:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 124 00000100:00100000:1.0:1787338577.612124:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338577.612210:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192063104 00000100:00100000:3.0:1787338577.612217:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192063104 00000100:00100000:3.0:1787338577.612260:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 125 00000100:00100000:3.0:1787338577.612270:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc414d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+10:5584:x1874160192063104:12345-192.168.201.53@tcp:503: 00000100:00100000:3.0:1787338577.612536:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc414d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+10:5584:x1874160192063104:12345-192.168.201.53@tcp:503: Request processed in 268us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338577.612541:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 125 00000100:00100000:1.0:1787338577.614307:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338577.614343:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192063232 00000100:00100000:0.0:1787338577.614350:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192063232 00000100:00100000:0.0:1787338577.614390:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 126 00000100:00100000:0.0:1787338577.614399:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc414f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+10:5606:x1874160192063232:12345-192.168.201.53@tcp:502: 00000100:00100000:0.0:1787338577.614622:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc414f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+10:5606:x1874160192063232:12345-192.168.201.53@tcp:502: Request processed in 223us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338577.614630:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 126 00000100:00100000:1.0:1787338577.615903:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338577.615932:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192063360 00000100:00100000:3.0:1787338577.615942:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192063360 00000100:00100000:0.0:1787338577.616035:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 127 00000100:00100000:0.0:1787338577.616046:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc414cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+10:5606:x1874160192063360:12345-192.168.201.53@tcp:502: 00000100:00100000:0.0:1787338577.616314:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc414cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+10:5606:x1874160192063360:12345-192.168.201.53@tcp:502: Request processed in 272us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338577.616320:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 127 00000100:00100000:1.0:1787338577.618406:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338577.618557:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192063488 00000100:00100000:3.0:1787338577.618565:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192063488 00000100:00100000:3.0:1787338577.618607:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 4 00000100:00100000:3.0:1787338577.618615:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee44ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2355:x1874160192063488:12345-192.168.201.53@tcp:38: 00010000:00080000:3.0:1787338577.618641:0:5839:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 83642291-0761-4205-9531-7fd25bc2d48e@192.168.201.53@tcp t0 exp 0000000000000000 cur 230 last 0 00000020:00000080:3.0:1787338577.618680:0:5839:0:(genops.c:1385:class_connect()) connect: client 83642291-0761-4205-9531-7fd25bc2d48e, cookie 0x83671231080c13ec 00000004:00100000:3.0:1787338577.618706:0:5839:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1787338577.618711:0:5839:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:3.0:1787338577.632339:0:5839:0:(import.c:65:import_set_state_nolock()) ffff90bac1f18800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787338577.632438:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee44ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+6:2355:x1874160192063488:12345-192.168.201.53@tcp:38: Request processed in 13820us (14037us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338577.632450:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 4 00010000:00010000:1.0:1787338578.614221:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787338578.647441:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338578.647488:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338578.647564:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192063744 00000100:00100000:3.0:1787338578.647582:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192063744 00000100:00100000:3.0:1787338578.647652:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192063616 00000100:00100000:3.0:1787338578.647655:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192063616 00000100:00100000:3.0:1787338578.647680:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 5 00000100:00100000:3.0:1787338578.647690:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf41b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+7:5584:x1874160192063744:12345-192.168.201.53@tcp:41: 00000100:00100000:1.0:1787338578.647857:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 6 00000100:00100000:1.0:1787338578.647866:0:7647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf41b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+7:0:x1874160192063616:12345-192.168.201.53@tcp:41: 00000100:00080000:0.0:1787338578.648058:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:3.0:1787338578.648127:0:5840:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1787338578.648247:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf41b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+7:5584:x1874160192063744:12345-192.168.201.53@tcp:41: Request processed in 557us (814us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338578.648256:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 5 00000004:00000024:1.0:1787338578.648527:0:7647:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1787338578.648556:0:7647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf41b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+6:0:x1874160192063616:12345-192.168.201.53@tcp:41: Request processed in 692us (1067us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338578.648574:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 6 00000100:00100000:0.0:1787338578.654991:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338578.660089:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192063872 00000100:00100000:1.0:1787338578.660105:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192063872 00000100:00100000:1.0:1787338578.660189:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 7 00000100:00100000:1.0:1787338578.660202:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbed9c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+6:5584:x1874160192063872:12345-192.168.201.53@tcp:40: 00000100:00100000:1.0:1787338578.660309:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbed9c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+6:5584:x1874160192063872:12345-192.168.201.53@tcp:40: Request processed in 109us (5327us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338578.660316:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 7 00000100:00100000:0.0:1787338578.675221:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338578.675275:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338578.675309:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338578.675342:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338578.675460:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192064256 00000100:00100000:2.0:1787338578.675470:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192064256 00000100:00100000:2.0:1787338578.675530:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 0 00000100:00100000:2.0:1787338578.675541:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbed9caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:83642291-0761-4205-9531-7fd25bc2d48e+6:5584:x1874160192064256:12345-192.168.201.53@tcp:33: 00000100:00100000:3.0:1787338578.675729:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192064000 00000100:00100000:3.0:1787338578.675735:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192064000 00000100:00100000:3.0:1787338578.675761:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192064128 00000100:00100000:3.0:1787338578.675765:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192064128 00000100:00100000:3.0:1787338578.675778:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 8 00000100:00100000:3.0:1787338578.675784:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbed9ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2355:x1874160192064000:12345-192.168.201.53@tcp:8: 00010000:00080000:3.0:1787338578.675807:0:6689:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 83642291-0761-4205-9531-7fd25bc2d48e@192.168.201.53@tcp t0 exp 0000000000000000 cur 231 last 0 00000020:00000080:3.0:1787338578.675837:0:6689:0:(genops.c:1385:class_connect()) connect: client 83642291-0761-4205-9531-7fd25bc2d48e, cookie 0x83671231080c13f3 00002000:00100000:3.0:1787338578.675849:0:6689:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 83642291-0761-4205-9531-7fd25bc2d48e/ffff90bac1f1f000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787338578.675891:0:6689:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787338578.676652:0:6689:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787338578.676685:0:6689:0:(import.c:65:import_set_state_nolock()) ffff90bac1f1d000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787338578.676765:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbed9ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:83642291-0761-4205-9531-7fd25bc2d48e+6:2355:x1874160192064000:12345-192.168.201.53@tcp:8: Request processed in 978us (1453us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338578.676779:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 8 00000100:00100000:3.0:1787338578.676800:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 9 00000100:00100000:3.0:1787338578.676805:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbed9cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2355:x1874160192064128:12345-192.168.201.53@tcp:8: 00010000:00080000:3.0:1787338578.676824:0:6689:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 83642291-0761-4205-9531-7fd25bc2d48e@192.168.201.53@tcp t0 exp 0000000000000000 cur 231 last 0 00000020:00000080:3.0:1787338578.676842:0:6689:0:(genops.c:1385:class_connect()) connect: client 83642291-0761-4205-9531-7fd25bc2d48e, cookie 0x83671231080c13fa 00002000:00100000:3.0:1787338578.676849:0:6689:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 83642291-0761-4205-9531-7fd25bc2d48e/ffff90bac1f1c000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787338578.676863:0:6689:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787338578.679240:0:6689:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787338578.679286:0:6689:0:(import.c:65:import_set_state_nolock()) ffff90bac1f1f800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787338578.679583:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192064384 00000100:00100000:1.0:1787338578.679592:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192064384 00000100:00100000:1.0:1787338578.679636:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 128 00000100:00100000:1.0:1787338578.679646:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbde804050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+10:2358:x1874160192064384:12345-192.168.201.53@tcp:400: 00000100:00100000:3.0:1787338578.679715:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbed9cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:83642291-0761-4205-9531-7fd25bc2d48e+6:2355:x1874160192064128:12345-192.168.201.53@tcp:8: Request processed in 2908us (4371us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338578.679724:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 9 00000100:00100000:1.0:1787338578.690237:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbde804050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+10:2358:x1874160192064384:12345-192.168.201.53@tcp:400: Request processed in 10579us (14948us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338578.690253:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 128 00000004:00080000:2.0:1787338578.714826:0:5842:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 39215us 00000004:00200000:3.0:1787338578.744093:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:3.0:1787338578.744277:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbed9caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:83642291-0761-4205-9531-7fd25bc2d48e+6:5584:x1874160192064256:12345-192.168.201.53@tcp:33: Request processed in 68732us (69061us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338578.744293:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 0 00000100:00100000:2.0:1787338579.011657:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338579.011896:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192064512 00000100:00100000:3.0:1787338579.011907:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192064512 00000100:00100000:3.0:1787338579.011972:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 8 00000100:00100000:3.0:1787338579.011983:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf46f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+6:5623:x1874160192064512:12345-192.168.201.53@tcp:101: 00010000:00010000:3.0:1787338579.012017:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787338579.012090:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc14a9a00/0x83671231080c1401 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab5cc expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338579.012163:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc14a9e00/0x83671231080c1408 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338579.012192:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc14a9e00/0x83671231080c1408 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338579.012207:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc14a9e00/0x83671231080c1408 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787338579.012395:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1787338579.012399:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787338579.012468:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc14a9e00/0x83671231080c1408 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338579.012494:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc14a9a00/0x83671231080c1401 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab5cc expref: 8 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338579.012512:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc14a9e00/0x83671231080c1408 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab5cc expref: 7 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338579.012522:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90bbd38d6b00) 00010000:00010000:3.0:1787338579.012524:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787338579.012528:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbc14a9e00, rc 0) 00000100:00100000:3.0:1787338579.013089:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf46f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+7:5623:x1874160192064512:12345-192.168.201.53@tcp:101: Request processed in 1106us (1451us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338579.013097:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 8 00010000:00010000:1.0:1787338579.638138:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338580.663016:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787338581.110754:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787338581.110779:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf41b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874160212009216:0@lo:13: 00000100:00100000:0.0:1787338581.110866:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338581.113440:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212009216 00000100:00100000:1.0:1787338581.113469:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212009216 00000100:00100000:1.0:1787338581.113559:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787338581.113570:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbed9c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874160212009216:12345-0@lo:13: 00002000:00000024:1.0:1787338581.113609:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787338581.113699:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbed9c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874160212009216:12345-0@lo:13: Request processed in 131us (2834us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338581.113706:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1787338581.113924:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbf41b6300 x1874160212009216/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787338597 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787338581.113943:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf41b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874160212009216:0@lo:13: 00000100:00080000:0.0:1787338581.119855:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787338581.290232:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338581.290995:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192064640 00000100:00100000:1.0:1787338581.291005:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192064640 00000100:00100000:1.0:1787338581.291072:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 9 00000100:00100000:1.0:1787338581.291082:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbedcb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+7:5676:x1874160192064640:12345-192.168.201.53@tcp:41: 00000004:00000024:1.0:1787338581.291127:0:5839:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1787338581.291190:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbedcb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+7:5676:x1874160192064640:12345-192.168.201.53@tcp:41: Request processed in 111us (978us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338581.291196:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 9 00000100:00080000:0.0:1787338581.291264:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787338581.295004:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338581.295588:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192064768 00000100:00100000:2.0:1787338581.295600:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192064768 00000100:00100000:2.0:1787338581.295684:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 9 00000100:00100000:2.0:1787338581.295694:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf41b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:83642291-0761-4205-9531-7fd25bc2d48e+6:5676:x1874160192064768:12345-192.168.201.53@tcp:13: 00002000:00000024:2.0:1787338581.295721:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787338581.295793:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf41b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:83642291-0761-4205-9531-7fd25bc2d48e+6:5676:x1874160192064768:12345-192.168.201.53@tcp:13: Request processed in 100us (798us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338581.295801:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 9 00000100:00080000:0.0:1787338581.295907:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787338581.305428:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338581.305510:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192064896 00000100:00100000:1.0:1787338581.305528:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192064896 00000100:00100000:1.0:1787338581.305620:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 10 00000100:00100000:1.0:1787338581.305632:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf46fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:83642291-0761-4205-9531-7fd25bc2d48e+6:5676:x1874160192064896:12345-192.168.201.53@tcp:13: 00002000:00000024:1.0:1787338581.305701:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1787338581.305707:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787338581.305790:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf46fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:83642291-0761-4205-9531-7fd25bc2d48e+6:5676:x1874160192064896:12345-192.168.201.53@tcp:13: Request processed in 160us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338581.305808:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 10 00000100:00100000:3.0:1787338581.622251:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf46f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d79243c8-b367-45ff-8d76-fbaa4be8becb:3315:1874160212009344:0@lo:400: 00000100:00100000:3.0:1787338581.622351:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338581.622411:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf46f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1874160212009856:0@lo:400: 00000100:00100000:3.0:1787338581.622439:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338581.622462:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787338581.622467:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf46faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874160212009728:0@lo:400: 00000100:00100000:3.0:1787338581.622491:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338581.622525:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212009728 00000100:00100000:3.0:1787338581.622533:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212009728 00000100:00100000:3.0:1787338581.622575:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787338581.622584:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbedcb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1874160212009728:12345-0@lo:400: 00000100:00100000:3.0:1787338581.622633:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbedcb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1874160212009728:12345-0@lo:400: Request processed in 50us (139us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338581.622640:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1787338581.622675:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbf46faa00 x1874160212009728/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787338597 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787338581.622688:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf46faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874160212009728:0@lo:400: 00000100:00100000:0.0:1787338581.622787:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf46f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874160212009472:0@lo:400: 00000100:00100000:0.0:1787338581.622823:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338581.622856:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf46f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874160212009984:0@lo:400: 00000100:00100000:2.0:1787338581.622897:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212009344 00000100:00100000:2.0:1787338581.622903:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212009344 00000100:00100000:0.0:1787338581.622910:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338581.622936:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787338581.622941:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1787338581.622954:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf46fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874160212009600:0@lo:400: 00000100:00100000:2.0:1787338581.622963:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbde804450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+19:3315:x1874160212009344:12345-0@lo:400: 00000100:00100000:0.0:1787338581.622998:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338581.623011:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbde804450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+19:3315:x1874160212009344:12345-0@lo:400: Request processed in 51us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338581.623019:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1787338581.623333:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212009984 00000100:00100000:1.0:1787338581.623347:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212009984 00000100:00100000:3.0:1787338581.623362:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212009856 00000100:00100000:3.0:1787338581.623368:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212009856 00000100:00100000:1.0:1787338581.623505:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787338581.623513:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbed9ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1874160212009984:12345-0@lo:400: 00000100:00100000:1.0:1787338581.623556:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbed9ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1874160212009984:12345-0@lo:400: Request processed in 45us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338581.623563:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787338581.623589:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212009472 00000100:00100000:1.0:1787338581.623593:0:7647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212009472 00000100:00100000:1.0:1787338581.623614:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212009600 00000100:00100000:1.0:1787338581.623617:0:7647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212009600 00000100:00100000:3.0:1787338581.625490:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787338581.625504:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbed9cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874160212009472:12345-0@lo:400: 00000100:00100000:3.0:1787338581.625582:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbed9cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874160212009472:12345-0@lo:400: Request processed in 81us (2758us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338581.625589:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787338581.625608:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787338581.625615:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbedcb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874160212009856:12345-0@lo:400: 00000100:00100000:3.0:1787338581.625646:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbedcb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874160212009856:12345-0@lo:400: Request processed in 32us (3206us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338581.625668:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787338581.625754:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf46f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d79243c8-b367-45ff-8d76-fbaa4be8becb:3315:1874160212009344:0@lo:400: 00000100:00100000:2.0:1787338581.625766:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf46f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874160212009472:0@lo:400: 00000100:00100000:3.0:1787338581.625775:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf46f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1874160212009856:0@lo:400: 00010000:00080000:2.0:1787338581.625794:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbf46f9c00 x1874160212009984/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787338597 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787338581.625810:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf46f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874160212009984:0@lo:400: 00000100:00080000:0.0:1787338581.627608:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787338581.627618:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787338581.630168:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787338581.630186:0:7647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbed9c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874160212009600:12345-0@lo:400: 00000100:00100000:1.0:1787338581.630293:0:7647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbed9c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874160212009600:12345-0@lo:400: Request processed in 112us (7294us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338581.630300:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787338581.630442:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf46fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874160212009600:0@lo:400: 00010000:00010000:1.0:1787338581.686068:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787338582.139899:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787338582.139926:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbed9c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874160212010112:0@lo:13: 00000100:00100000:0.0:1787338582.140010:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338582.140096:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212010112 00000100:00100000:0.0:1787338582.140103:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212010112 00000100:00100000:0.0:1787338582.140149:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787338582.140159:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbed9c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874160212010112:12345-0@lo:13: 00002000:00000024:0.0:1787338582.140179:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787338582.140223:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbed9c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874160212010112:12345-0@lo:13: Request processed in 66us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338582.140470:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1787338582.140526:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbed9c9c00 x1874160212010112/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787338598 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787338582.140545:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbed9c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874160212010112:0@lo:13: 00010000:00010000:1.0:1787338582.711356:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787338582.717582:0:5861:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 83642291-0761-4205-9531-7fd25bc2d48e 00000001:00100000:0.0:1787338582.738182:0:6714:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 83642291-0761-4205-9531-7fd25bc2d48e 00000001:00100000:3.0:1787338582.738865:0:7651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 83642291-0761-4205-9531-7fd25bc2d48e 00010000:00010000:3.0:1787338583.739893:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787338583.877240:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338583.877279:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338583.877342:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192065280 00000100:00100000:2.0:1787338583.877352:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192065280 00000100:00080000:0.0:1787338583.877394:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787338583.877420:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 9 00000100:00100000:2.0:1787338583.877429:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbedcb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:83642291-0761-4205-9531-7fd25bc2d48e+5:2359:x1874160192065280:12345-192.168.201.53@tcp:400: 00000100:00100000:1.0:1787338583.877535:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192065024 00000100:00100000:1.0:1787338583.877538:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192065024 00000100:00100000:1.0:1787338583.877566:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 130 00000100:00100000:1.0:1787338583.877574:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbde807450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+10:2359:x1874160192065024:12345-192.168.201.53@tcp:400: 00000100:00100000:2.0:1787338583.877748:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbedcb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:83642291-0761-4205-9531-7fd25bc2d48e+5:2359:x1874160192065280:12345-192.168.201.53@tcp:400: Request processed in 318us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338583.877756:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 9 00000100:00100000:1.0:1787338583.877809:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbde807450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+10:2359:x1874160192065024:12345-192.168.201.53@tcp:400: Request processed in 235us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338583.877829:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 130 00000100:00100000:2.0:1787338583.894595:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338583.894651:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192065152 00000100:00100000:3.0:1787338583.894660:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192065152 00000100:00100000:3.0:1787338583.894734:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 25 00000100:00100000:3.0:1787338583.894745:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf46fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+6:2359:x1874160192065152:12345-192.168.201.53@tcp:400: 00000100:00100000:3.0:1787338583.894819:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf46fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+6:2359:x1874160192065152:12345-192.168.201.53@tcp:400: Request processed in 77us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338583.894827:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 25 00000100:00080000:0.0:1787338583.895033:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787338583.896586:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338583.896687:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192065408 00000100:00100000:3.0:1787338583.896695:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192065408 00000100:00100000:3.0:1787338583.896780:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 10 00000100:00100000:3.0:1787338583.896789:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbed9c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:83642291-0761-4205-9531-7fd25bc2d48e+5:2359:x1874160192065408:12345-192.168.201.53@tcp:400: 00000100:00100000:3.0:1787338583.896854:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbed9c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:83642291-0761-4205-9531-7fd25bc2d48e+5:2359:x1874160192065408:12345-192.168.201.53@tcp:400: Request processed in 65us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338583.896860:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 10 00000100:00080000:0.0:1787338583.897030:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:02000400:1.0:1787338584.008201:0:8304:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1787338584.759173:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338585.786856:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787338586.233136:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf41b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874160212010240:0@lo:13: 00000100:00100000:0.0:1787338586.233301:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338586.235270:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212010240 00000100:00100000:1.0:1787338586.235282:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212010240 00000100:00100000:1.0:1787338586.235353:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787338586.235366:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc281880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874160212010240:12345-0@lo:13: 00002000:00000024:1.0:1787338586.235408:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787338586.235503:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc281880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874160212010240:12345-0@lo:13: Request processed in 140us (2200us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338586.235511:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1787338586.235536:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787338586.236633:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbf41b5500 x1874160212010240/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787338602 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787338586.236655:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf41b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874160212010240:0@lo:13: 00000100:00100000:3.0:1787338586.743102:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf46f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d79243c8-b367-45ff-8d76-fbaa4be8becb:3315:1874160212010368:0@lo:400: 00000100:00100000:3.0:1787338586.743181:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338586.743281:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212010368 00000100:00100000:0.0:1787338586.743290:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212010368 00000100:00100000:0.0:1787338586.743338:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1787338586.743346:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbde807050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+19:3315:x1874160212010368:12345-0@lo:400: 00000100:00100000:0.0:1787338586.743462:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbde807050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+19:3315:x1874160212010368:12345-0@lo:400: Request processed in 116us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338586.743468:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1787338586.744270:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf46f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1874160212010752:0@lo:400: 00000100:00100000:2.0:1787338586.744300:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338586.744351:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787338586.744355:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf46f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874160212010880:0@lo:400: 00000100:00100000:2.0:1787338586.744374:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338586.744407:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf46f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874160212010496:0@lo:400: 00000100:00100000:1.0:1787338586.744418:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212010880 00000100:00100000:1.0:1787338586.744423:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212010880 00000100:00100000:2.0:1787338586.744430:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338586.744467:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787338586.744475:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc91dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1874160212010880:12345-0@lo:400: 00000100:00100000:3.0:1787338586.744485:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf46f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d79243c8-b367-45ff-8d76-fbaa4be8becb:3315:1874160212010368:0@lo:400: 00000100:00100000:1.0:1787338586.744518:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc91dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1874160212010880:12345-0@lo:400: Request processed in 44us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338586.744524:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787338586.744525:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf46f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1874160212010624:0@lo:400: 00000100:00080000:1.0:1787338586.744545:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787338586.744569:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbf46f8a80 x1874160212010880/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787338602 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787338586.744580:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf46f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874160212010880:0@lo:400: 00000100:00100000:0.0:1787338586.744947:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212010752 00000100:00100000:0.0:1787338586.744952:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212010752 00000100:00100000:0.0:1787338586.744985:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212010496 00000100:00100000:0.0:1787338586.744989:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212010496 00000100:00100000:0.0:1787338586.745007:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787338586.745013:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf46faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874160212010752:12345-0@lo:400: 00000100:00100000:0.0:1787338586.745055:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf46faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874160212010752:12345-0@lo:400: Request processed in 42us (754us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338586.745061:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787338586.745073:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787338586.745078:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc91ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874160212010496:12345-0@lo:400: 00000100:00100000:0.0:1787338586.745105:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc91ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874160212010496:12345-0@lo:400: Request processed in 26us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338586.745116:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787338586.745145:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf46f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1874160212010752:0@lo:400: 00000100:00100000:2.0:1787338586.745210:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf46f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874160212010496:0@lo:400: 00000100:00080000:2.0:1787338586.745227:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787338586.745291:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338586.745374:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212010624 00000100:00100000:0.0:1787338586.745379:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212010624 00000100:00100000:0.0:1787338586.745460:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787338586.745467:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbedcb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874160212010624:12345-0@lo:400: 00000100:00100000:0.0:1787338586.745499:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbedcb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874160212010624:12345-0@lo:400: Request processed in 32us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338586.745505:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787338586.745574:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf46f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1874160212010624:0@lo:400: 00000100:00080000:2.0:1787338586.745663:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787338586.806119:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787338587.254072:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc282680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874160212011008:0@lo:13: 00000100:00100000:2.0:1787338587.254148:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338587.254277:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212011008 00000100:00100000:1.0:1787338587.254287:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212011008 00000100:00100000:1.0:1787338587.254341:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787338587.254351:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc91ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874160212011008:12345-0@lo:13: 00002000:00000024:1.0:1787338587.254383:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787338587.254446:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc91ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874160212011008:12345-0@lo:13: Request processed in 96us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338587.254454:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1787338587.254580:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbfc282680 x1874160212011008/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787338603 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787338587.254598:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc282680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874160212011008:0@lo:13: 00000020:00000080:0.0:1787338587.644166:0:8451:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff18b6aee0 20000000:00000080:0.0:1787338587.644185:0:8451:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff90bbff90d800 uarg=0000000000000000 20000000:01000000:0.0:1787338587.644222:0:8451:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:0.0:1787338587.644224:0:8451:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:0.0:1787338587.644227:0:8451:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:0.0:1787338587.644231:0:8451:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:0.0:1787338587.644236:0:8451:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:0.0:1787338587.644249:0:8451:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1787338587.644251:0:8451:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1787338587.644425:0:8451:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1787338587.644428:0:8451:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1787338587.645229:0:8452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:0.0:1787338587.645653:0:8451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:0.0:1787338587.645703:0:8451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:0.0:1787338587.645737:0:8451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:0.0:1787338587.645749:0:8451:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1787338587.645751:0:8451:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1787338587.646549:0:8453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:0.0:1787338587.647039:0:8451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:0.0:1787338587.647106:0:8451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:0.0:1787338587.647144:0:8451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:0.0:1787338587.647155:0:8451:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1787338587.647163:0:8451:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1787338587.647859:0:8454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:0.0:1787338587.648332:0:8451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:0.0:1787338587.648383:0:8451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:0.0:1787338587.648433:0:8451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:0.0:1787338587.648447:0:8451:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1787338587.648449:0:8451:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1787338587.649820:0:8455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:0.0:1787338587.650310:0:8451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:0.0:1787338587.650373:0:8451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:0.0:1787338587.650414:0:8451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 10000000:01000000:0.0:1787338587.650430:0:8451:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787338587.650653:0:8451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90bbc0030a00/0x83671231080c140f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338587.650671:0:8451:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90bbc0031800/0x83671231080c130c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c1305 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338587.650679:0:8451:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90bbc0031c00/0x83671231080c1336 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c132f expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338587.650684:0:8451:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90bc02044a00/0x83671231080c1360 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c1359 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338587.650689:0:8451:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90bbc0030800/0x83671231080c136e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c1367 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338587.650695:0:8451:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90bbc0030200/0x83671231080c137c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c1375 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338587.650702:0:8451:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90bc021c8200/0x83671231080c1398 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c1391 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338587.650709:0:8451:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90bbf40e3c00/0x83671231080c13c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c13bb expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338587.650726:0:8451:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90bbf40e2800/0x83671231080c13d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab56a expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338587.650734:0:8451:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90bc02045800/0x83671231080c13d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab571 expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338587.650740:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90bbc0030a00/0x83671231080c140f lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338587.650780:0:8451:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90bc02045800/0x83671231080c13d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab571 expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338587.650796:0:8451:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90bc02045800/0x83671231080c13d7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab571 expref: 9 pid: 5834 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338587.650810:0:8451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc280700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8451:1874160212011136:192.168.201.53@tcp:104: 00010000:00010000:0.0:1787338587.651060:0:8451:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90bbf40e2800/0x83671231080c13d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab56a expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338587.651070:0:8451:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90bbf40e2800/0x83671231080c13d0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab56a expref: 9 pid: 5834 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338587.651079:0:8451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc283100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8451:1874160212011264:192.168.201.53@tcp:104: 00010000:00010000:0.0:1787338587.651111:0:8451:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90bbf40e3c00/0x83671231080c13c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x83671231080c13bb expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338587.651119:0:8451:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90bbf40e3c00/0x83671231080c13c2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x83671231080c13bb expref: 18 pid: 5833 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338587.651141:0:8451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc282300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8451:1874160212011392:0@lo:104: 00000100:00100000:0.0:1787338587.651182:0:8451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787338587.651263:0:8451:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90bc021c8200/0x83671231080c1398 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x83671231080c1391 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338587.651271:0:8451:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90bc021c8200/0x83671231080c1398 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x83671231080c1391 expref: 18 pid: 5834 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338587.651280:0:8451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc281500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8451:1874160212011520:0@lo:104: 00000100:00100000:0.0:1787338587.651304:0:8451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787338587.651499:0:8451:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90bbc0030200/0x83671231080c137c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x83671231080c1375 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338587.651508:0:8451:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90bbc0030200/0x83671231080c137c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x83671231080c1375 expref: 18 pid: 5833 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338587.651516:0:8451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc280e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8451:1874160212011648:0@lo:104: 00010000:00010000:0.0:1787338587.651541:0:8451:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90bbc0030800/0x83671231080c136e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x83671231080c1367 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338587.651549:0:8451:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90bbc0030800/0x83671231080c136e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x83671231080c1367 expref: 18 pid: 5834 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338587.651557:0:8451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc280000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8451:1874160212011776:0@lo:104: 00010000:00010000:0.0:1787338587.651580:0:8451:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90bc02044a00/0x83671231080c1360 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x83671231080c1359 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338587.651587:0:8451:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90bc02044a00/0x83671231080c1360 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x83671231080c1359 expref: 18 pid: 5834 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338587.651603:0:8451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc281c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8451:1874160212011904:0@lo:104: 00010000:00010000:0.0:1787338587.651644:0:8451:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90bbc0031c00/0x83671231080c1336 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x83671231080c132f expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338587.651652:0:8451:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90bbc0031c00/0x83671231080c1336 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x83671231080c132f expref: 18 pid: 5833 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338587.651660:0:8451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc281f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8451:1874160212012032:0@lo:104: 00010000:00010000:0.0:1787338587.651686:0:8451:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90bbc0031800/0x83671231080c130c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x83671231080c1305 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338587.651693:0:8451:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90bbc0031800/0x83671231080c130c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x83671231080c1305 expref: 18 pid: 5832 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338587.651700:0:8451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc283b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8451:1874160212012160:0@lo:104: 00000100:00100000:0.0:1787338587.651718:0:8451:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc6748180 going to sleep for 11 seconds 00000100:00100000:2.0:1787338587.651998:0:5821:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787338587.652023:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338587.652038:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338587.652047:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338587.652055:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338587.652063:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338587.652073:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212011392 00000100:00100000:2.0:1787338587.652080:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212011392 00000100:00100000:2.0:1787338587.652118:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212011520 00000100:00100000:2.0:1787338587.652122:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212011520 00000100:00100000:2.0:1787338587.652133:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212011648 00000100:00100000:2.0:1787338587.652136:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212011648 00000100:00100000:2.0:1787338587.652146:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212011776 00000100:00100000:2.0:1787338587.652148:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212011776 00000100:00100000:2.0:1787338587.652156:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212011904 00000100:00100000:2.0:1787338587.652159:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212011904 00000100:00100000:2.0:1787338587.652167:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212012032 00000100:00100000:2.0:1787338587.652169:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212012032 00000100:00100000:2.0:1787338587.652176:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212012160 00000100:00100000:2.0:1787338587.652178:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212012160 00000100:00100000:2.0:1787338587.652189:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787338587.652198:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc282a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d79243c8-b367-45ff-8d76-fbaa4be8becb+9:8451:x1874160212011392:12345-0@lo:104: 00010000:00010000:2.0:1787338587.652211:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.153@tcp lock: ffff90bc021c9200/0x83671231080c13bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x83671231080c13c2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338587.652314:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787338587.652321:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc282a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d79243c8-b367-45ff-8d76-fbaa4be8becb+9:8451:x1874160212011392:12345-0@lo:104: Request processed in 124us (1139us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338587.652328:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787338587.652345:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787338587.652351:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf7e47450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d79243c8-b367-45ff-8d76-fbaa4be8becb+8:8451:x1874160212011520:12345-0@lo:104: 00010000:00010000:2.0:1787338587.652359:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.153@tcp lock: ffff90bbc14a8200/0x83671231080c1391 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x83671231080c1398 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338587.652399:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787338587.652404:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf7e47450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d79243c8-b367-45ff-8d76-fbaa4be8becb+8:8451:x1874160212011520:12345-0@lo:104: Request processed in 54us (1100us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338587.652410:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787338587.652457:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787338587.652463:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc91dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d79243c8-b367-45ff-8d76-fbaa4be8becb+7:8451:x1874160212011648:12345-0@lo:104: 00010000:00010000:2.0:1787338587.652470:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.153@tcp lock: ffff90bbc0030c00/0x83671231080c1375 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x83671231080c137c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338587.652493:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787338587.652498:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc91dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d79243c8-b367-45ff-8d76-fbaa4be8becb+7:8451:x1874160212011648:12345-0@lo:104: Request processed in 36us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338587.652515:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787338587.652529:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787338587.652535:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc91dce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d79243c8-b367-45ff-8d76-fbaa4be8becb+6:8451:x1874160212011776:12345-0@lo:104: 00010000:00010000:2.0:1787338587.652541:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.153@tcp lock: ffff90bbc14a8c00/0x83671231080c1367 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x83671231080c136e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338587.652566:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1787338587.652576:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc91dce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d79243c8-b367-45ff-8d76-fbaa4be8becb+6:8451:x1874160212011776:12345-0@lo:104: Request processed in 41us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338587.652582:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787338587.652595:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787338587.652601:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc91ded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d79243c8-b367-45ff-8d76-fbaa4be8becb+5:8451:x1874160212011904:12345-0@lo:104: 00010000:00010000:2.0:1787338587.652607:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.153@tcp lock: ffff90bc02045600/0x83671231080c1359 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x83671231080c1360 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338587.652639:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1787338587.652644:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc91ded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d79243c8-b367-45ff-8d76-fbaa4be8becb+5:8451:x1874160212011904:12345-0@lo:104: Request processed in 44us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338587.652650:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787338587.652662:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787338587.652667:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc91dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d79243c8-b367-45ff-8d76-fbaa4be8becb+4:8451:x1874160212012032:12345-0@lo:104: 00010000:00010000:2.0:1787338587.652674:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.153@tcp lock: ffff90bc021c8a00/0x83671231080c132f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x83671231080c1336 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338587.652698:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:2.0:1787338587.652702:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc91dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d79243c8-b367-45ff-8d76-fbaa4be8becb+4:8451:x1874160212012032:12345-0@lo:104: Request processed in 36us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338587.652708:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787338587.652719:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787338587.652724:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc91dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d79243c8-b367-45ff-8d76-fbaa4be8becb+3:8451:x1874160212012160:12345-0@lo:104: 00010000:00010000:2.0:1787338587.652731:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.153@tcp lock: ffff90bc021c8c00/0x83671231080c1305 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x83671231080c130c expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338587.652755:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:2.0:1787338587.652760:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc91dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d79243c8-b367-45ff-8d76-fbaa4be8becb+3:8451:x1874160212012160:12345-0@lo:104: Request processed in 36us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338587.652765:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:1.0:1787338587.652838:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1787338587.652856:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.153@tcp lock: ffff90bc021c9200/0x83671231080c13bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x83671231080c13c2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338587.652863:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bc021c9200 already unused, calling callback (ffffffffc1b2ec20) 10000000:00010000:1.0:1787338587.652866:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.153@tcp lock: ffff90bc021c9200/0x83671231080c13bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x83671231080c13c2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338587.652904:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.153@tcp lock: ffff90bc021c9200/0x83671231080c13bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x83671231080c13c2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787338587.652912:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.153@tcp lock: ffff90bc021c9200/0x83671231080c13bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x83671231080c13c2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787338587.652917:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787338587.652949:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.153@tcp lock: ffff90bc021c9200/0x83671231080c13bb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c13c2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338587.652955:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787338587.652971:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.153@tcp lock: ffff90bc021c9200/0x83671231080c13bb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c13c2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338587.652988:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.153@tcp lock: ffff90bc021c9200/0x83671231080c13bb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c13c2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338587.653000:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1787338587.653003:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.153@tcp lock: ffff90bbc14a8200/0x83671231080c1391 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x83671231080c1398 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338587.653009:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbc14a8200 already unused, calling callback (ffffffffc1b2ec20) 10000000:00010000:1.0:1787338587.653012:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.153@tcp lock: ffff90bbc14a8200/0x83671231080c1391 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x83671231080c1398 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338587.653018:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.153@tcp lock: ffff90bbc14a8200/0x83671231080c1391 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x83671231080c1398 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787338587.653025:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.153@tcp lock: ffff90bbc14a8200/0x83671231080c1391 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x83671231080c1398 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787338587.653029:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787338587.653043:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.153@tcp lock: ffff90bbc14a8200/0x83671231080c1391 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c1398 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338587.653048:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787338587.653064:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.153@tcp lock: ffff90bbc14a8200/0x83671231080c1391 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c1398 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338587.653071:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.153@tcp lock: ffff90bbc14a8200/0x83671231080c1391 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c1398 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338587.653082:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1787338587.653090:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.153@tcp lock: ffff90bbc0030c00/0x83671231080c1375 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x83671231080c137c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338587.653096:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbc0030c00 already unused, calling callback (ffffffffc1b2ec20) 10000000:00010000:1.0:1787338587.653099:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.153@tcp lock: ffff90bbc0030c00/0x83671231080c1375 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x83671231080c137c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338587.653105:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.153@tcp lock: ffff90bbc0030c00/0x83671231080c1375 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x83671231080c137c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787338587.653111:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.153@tcp lock: ffff90bbc0030c00/0x83671231080c1375 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x83671231080c137c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787338587.653116:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787338587.653129:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.153@tcp lock: ffff90bbc0030c00/0x83671231080c1375 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c137c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338587.653134:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787338587.653140:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.153@tcp lock: ffff90bbc0030c00/0x83671231080c1375 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c137c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338587.653146:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.153@tcp lock: ffff90bbc0030c00/0x83671231080c1375 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c137c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338587.653155:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1787338587.653158:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.153@tcp lock: ffff90bbc14a8c00/0x83671231080c1367 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x83671231080c136e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338587.653163:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbc14a8c00 already unused, calling callback (ffffffffc1b2ec20) 10000000:00010000:1.0:1787338587.653166:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.153@tcp lock: ffff90bbc14a8c00/0x83671231080c1367 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x83671231080c136e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338587.653181:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.153@tcp lock: ffff90bbc14a8c00/0x83671231080c1367 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x83671231080c136e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787338587.653187:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.153@tcp lock: ffff90bbc14a8c00/0x83671231080c1367 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x83671231080c136e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787338587.653192:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787338587.653204:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.153@tcp lock: ffff90bbc14a8c00/0x83671231080c1367 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c136e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338587.653209:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787338587.653214:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.153@tcp lock: ffff90bbc14a8c00/0x83671231080c1367 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c136e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338587.653219:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.153@tcp lock: ffff90bbc14a8c00/0x83671231080c1367 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c136e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338587.653228:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787338587.653231:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.153@tcp lock: ffff90bc02045600/0x83671231080c1359 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x83671231080c1360 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338587.653236:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bc02045600 already unused, calling callback (ffffffffc1b2ec20) 10000000:00010000:1.0:1787338587.653239:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.153@tcp lock: ffff90bc02045600/0x83671231080c1359 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x83671231080c1360 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338587.653245:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.153@tcp lock: ffff90bc02045600/0x83671231080c1359 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x83671231080c1360 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787338587.653265:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.153@tcp lock: ffff90bc02045600/0x83671231080c1359 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x83671231080c1360 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787338587.653275:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787338587.653289:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.153@tcp lock: ffff90bc02045600/0x83671231080c1359 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c1360 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338587.653294:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787338587.653300:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.153@tcp lock: ffff90bc02045600/0x83671231080c1359 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c1360 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338587.653305:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.153@tcp lock: ffff90bc02045600/0x83671231080c1359 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c1360 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338587.653314:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787338587.653316:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.153@tcp lock: ffff90bc021c8a00/0x83671231080c132f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x83671231080c1336 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338587.653321:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bc021c8a00 already unused, calling callback (ffffffffc1b2ec20) 10000000:00010000:1.0:1787338587.653324:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.153@tcp lock: ffff90bc021c8a00/0x83671231080c132f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x83671231080c1336 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338587.653330:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.153@tcp lock: ffff90bc021c8a00/0x83671231080c132f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x83671231080c1336 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787338587.653336:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.153@tcp lock: ffff90bc021c8a00/0x83671231080c132f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x83671231080c1336 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787338587.653341:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787338587.653350:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.153@tcp lock: ffff90bc021c8a00/0x83671231080c132f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c1336 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338587.653355:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787338587.653370:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.153@tcp lock: ffff90bc021c8a00/0x83671231080c132f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c1336 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338587.653375:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.153@tcp lock: ffff90bc021c8a00/0x83671231080c132f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c1336 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338587.653382:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787338587.653385:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.153@tcp lock: ffff90bc021c8c00/0x83671231080c1305 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x83671231080c130c expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338587.653389:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bc021c8c00 already unused, calling callback (ffffffffc1b2ec20) 10000000:00010000:1.0:1787338587.653392:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.153@tcp lock: ffff90bc021c8c00/0x83671231080c1305 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x83671231080c130c expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338587.653397:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.153@tcp lock: ffff90bc021c8c00/0x83671231080c1305 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x83671231080c130c expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787338587.653402:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.153@tcp lock: ffff90bc021c8c00/0x83671231080c1305 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x83671231080c130c expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787338587.653407:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787338587.653418:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.153@tcp lock: ffff90bc021c8c00/0x83671231080c1305 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c130c expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338587.653423:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787338587.653427:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.153@tcp lock: ffff90bc021c8c00/0x83671231080c1305 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c130c expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338587.653433:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.153@tcp lock: ffff90bc021c8c00/0x83671231080c1305 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c130c expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338587.653445:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338587.653453:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338587.653455:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338587.653462:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787338587.653475:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf41b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d79243c8-b367-45ff-8d76-fbaa4be8becb:3316:1874160212012672:0@lo:103: 00000100:00100000:1.0:1787338587.653510:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338587.653547:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787338587.653552:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf41b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d79243c8-b367-45ff-8d76-fbaa4be8becb:3316:1874160212012288:0@lo:103: 00000100:00100000:1.0:1787338587.653570:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338587.653583:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf41b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d79243c8-b367-45ff-8d76-fbaa4be8becb:3316:1874160212012800:0@lo:103: 00000100:00100000:1.0:1787338587.653597:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338587.653616:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf41b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d79243c8-b367-45ff-8d76-fbaa4be8becb:3314:1874160212012416:0@lo:103: 00000100:00100000:1.0:1787338587.653633:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338587.653649:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf41b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d79243c8-b367-45ff-8d76-fbaa4be8becb:3314:1874160212012928:0@lo:103: 00000100:00100000:1.0:1787338587.653667:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338587.653676:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787338587.653680:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf41b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d79243c8-b367-45ff-8d76-fbaa4be8becb:3314:1874160212012544:0@lo:103: 00000100:00100000:1.0:1787338587.653696:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338587.653704:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf41b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d79243c8-b367-45ff-8d76-fbaa4be8becb:3314:1874160212013056:0@lo:103: 00000100:00100000:1.0:1787338587.653724:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338587.653749:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212012672 00000100:00100000:1.0:1787338587.653756:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212012672 00010000:00010000:1.0:1787338587.653776:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90bbc0030800/0x83671231080c136e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x83671231080c1367 expref: 19 pid: 5834 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338587.653792:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212012288 00000100:00100000:1.0:1787338587.653794:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212012288 00010000:00010000:1.0:1787338587.653804:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90bbf40e3c00/0x83671231080c13c2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x83671231080c13bb expref: 20 pid: 5833 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338587.653826:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212012800 00000100:00100000:1.0:1787338587.653829:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212012800 00010000:00010000:1.0:1787338587.653852:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90bc02044a00/0x83671231080c1360 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x83671231080c1359 expref: 21 pid: 5834 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338587.653863:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212012416 00000100:00100000:1.0:1787338587.653866:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212012416 00010000:00010000:1.0:1787338587.653897:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90bc021c8200/0x83671231080c1398 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x83671231080c1391 expref: 22 pid: 5834 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338587.653908:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212012928 00000100:00100000:1.0:1787338587.653911:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212012928 00010000:00010000:1.0:1787338587.653921:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90bbc0031c00/0x83671231080c1336 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x83671231080c132f expref: 23 pid: 5833 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338587.653929:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212012544 00000100:00100000:1.0:1787338587.653931:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212012544 00010000:00010000:1.0:1787338587.653939:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90bbc0030200/0x83671231080c137c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x83671231080c1375 expref: 24 pid: 5833 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338587.653947:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212013056 00000100:00100000:1.0:1787338587.653949:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212013056 00010000:00010000:1.0:1787338587.653958:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90bbc0031800/0x83671231080c130c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x83671231080c1305 expref: 25 pid: 5832 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338587.653969:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787338587.653976:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf41b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d79243c8-b367-45ff-8d76-fbaa4be8becb+25:3316:x1874160212012672:12345-0@lo:103: 00010000:00010000:1.0:1787338587.653987:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787338587.653992:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90bbc0030800/0x83671231080c136e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x83671231080c1367 expref: 25 pid: 5834 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338587.654010:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90bbc0030800/0x83671231080c136e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x83671231080c1367 expref: 25 pid: 5834 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338587.654026:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787338587.654056:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf41b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d79243c8-b367-45ff-8d76-fbaa4be8becb+25:3316:x1874160212012672:12345-0@lo:103: Request processed in 80us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338587.654062:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787338587.654076:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787338587.654082:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf41b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d79243c8-b367-45ff-8d76-fbaa4be8becb+24:3316:x1874160212012288:12345-0@lo:103: 00010000:00010000:1.0:1787338587.654089:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787338587.654094:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90bbf40e3c00/0x83671231080c13c2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x83671231080c13bb expref: 24 pid: 5833 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338587.654102:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90bbf40e3c00/0x83671231080c13c2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x83671231080c13bb expref: 24 pid: 5833 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338587.654111:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787338587.654130:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf41b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d79243c8-b367-45ff-8d76-fbaa4be8becb+24:3316:x1874160212012288:12345-0@lo:103: Request processed in 49us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338587.654136:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787338587.654148:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787338587.654154:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf41b4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d79243c8-b367-45ff-8d76-fbaa4be8becb+23:3316:x1874160212012800:12345-0@lo:103: 00010000:00010000:1.0:1787338587.654161:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787338587.654165:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90bc02044a00/0x83671231080c1360 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x83671231080c1359 expref: 23 pid: 5834 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338587.654174:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90bc02044a00/0x83671231080c1360 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x83671231080c1359 expref: 23 pid: 5834 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338587.654189:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787338587.654210:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf41b4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d79243c8-b367-45ff-8d76-fbaa4be8becb+23:3316:x1874160212012800:12345-0@lo:103: Request processed in 56us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338587.654216:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787338587.654229:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787338587.654234:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf41b5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d79243c8-b367-45ff-8d76-fbaa4be8becb+22:3314:x1874160212012416:12345-0@lo:103: 00010000:00010000:1.0:1787338587.654241:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787338587.654245:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90bc021c8200/0x83671231080c1398 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x83671231080c1391 expref: 22 pid: 5834 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338587.654252:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90bc021c8200/0x83671231080c1398 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x83671231080c1391 expref: 22 pid: 5834 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338587.654260:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787338587.654284:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf41b5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d79243c8-b367-45ff-8d76-fbaa4be8becb+22:3314:x1874160212012416:12345-0@lo:103: Request processed in 49us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338587.654290:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787338587.654303:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787338587.654308:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf41b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d79243c8-b367-45ff-8d76-fbaa4be8becb+21:3314:x1874160212012928:12345-0@lo:103: 00010000:00010000:1.0:1787338587.654315:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787338587.654319:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90bbc0031c00/0x83671231080c1336 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x83671231080c132f expref: 21 pid: 5833 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338587.654327:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90bbc0031c00/0x83671231080c1336 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x83671231080c132f expref: 21 pid: 5833 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338587.654335:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787338587.654361:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf41b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d79243c8-b367-45ff-8d76-fbaa4be8becb+21:3314:x1874160212012928:12345-0@lo:103: Request processed in 53us (693us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338587.654367:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787338587.654381:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787338587.654386:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf41b5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d79243c8-b367-45ff-8d76-fbaa4be8becb+20:3314:x1874160212012544:12345-0@lo:103: 00010000:00010000:1.0:1787338587.654393:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787338587.654397:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90bbc0030200/0x83671231080c137c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x83671231080c1375 expref: 20 pid: 5833 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338587.654404:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90bbc0030200/0x83671231080c137c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x83671231080c1375 expref: 20 pid: 5833 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338587.654413:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787338587.654432:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf41b5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d79243c8-b367-45ff-8d76-fbaa4be8becb+20:3314:x1874160212012544:12345-0@lo:103: Request processed in 46us (735us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338587.654438:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787338587.654451:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787338587.654456:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc7c22c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d79243c8-b367-45ff-8d76-fbaa4be8becb+19:3314:x1874160212013056:12345-0@lo:103: 00010000:00010000:1.0:1787338587.654463:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787338587.654467:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90bbc0031800/0x83671231080c130c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x83671231080c1305 expref: 19 pid: 5832 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338587.654474:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90bbc0031800/0x83671231080c130c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x83671231080c1305 expref: 19 pid: 5832 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338587.654482:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787338587.654502:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc7c22c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d79243c8-b367-45ff-8d76-fbaa4be8becb+19:3314:x1874160212013056:12345-0@lo:103: Request processed in 46us (777us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338587.654508:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787338587.654571:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf41b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d79243c8-b367-45ff-8d76-fbaa4be8becb:3314:1874160212012544:0@lo:103: 00000100:00100000:1.0:1787338587.654579:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf41b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d79243c8-b367-45ff-8d76-fbaa4be8becb:3314:1874160212013056:0@lo:103: 00000100:00100000:1.0:1787338587.654585:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf41b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d79243c8-b367-45ff-8d76-fbaa4be8becb:3314:1874160212012416:0@lo:103: 00000100:00100000:1.0:1787338587.654591:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf41b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d79243c8-b367-45ff-8d76-fbaa4be8becb:3314:1874160212012928:0@lo:103: 00000100:00100000:1.0:1787338587.654615:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf41b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d79243c8-b367-45ff-8d76-fbaa4be8becb:3316:1874160212012288:0@lo:103: 00000100:00100000:1.0:1787338587.654622:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf41b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d79243c8-b367-45ff-8d76-fbaa4be8becb:3316:1874160212012800:0@lo:103: 00000100:00100000:1.0:1787338587.654628:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf41b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d79243c8-b367-45ff-8d76-fbaa4be8becb:3316:1874160212012672:0@lo:103: 00000100:00100000:3.0:1787338587.654971:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/1 left), rc = 0 00010000:00010000:0.0:1787338587.655720:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90bbf40e3c00/0x83671231080c13c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x83671231080c13bb expref: 18 pid: 5833 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338587.655734:0:8451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc282300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8451:1874160212011392:0@lo:104: 00010000:00010000:1.0:1787338587.655811:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90bc021c8200/0x83671231080c1398 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x83671231080c1391 expref: 17 pid: 5834 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338587.655822:0:8451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc281500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8451:1874160212011520:0@lo:104: 00010000:00010000:1.0:1787338587.655832:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90bbc0030200/0x83671231080c137c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x83671231080c1375 expref: 16 pid: 5833 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338587.655849:0:8451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc280e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8451:1874160212011648:0@lo:104: 00010000:00010000:1.0:1787338587.655859:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90bbc0030800/0x83671231080c136e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x83671231080c1367 expref: 15 pid: 5834 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338587.655868:0:8451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc280000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8451:1874160212011776:0@lo:104: 00010000:00010000:1.0:1787338587.655903:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90bc02044a00/0x83671231080c1360 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x83671231080c1359 expref: 14 pid: 5834 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338587.655911:0:8451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc281c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8451:1874160212011904:0@lo:104: 00010000:00010000:1.0:1787338587.655921:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90bbc0031c00/0x83671231080c1336 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x83671231080c132f expref: 13 pid: 5833 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338587.655940:0:8451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc281f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8451:1874160212012032:0@lo:104: 00010000:00010000:1.0:1787338587.655951:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90bbc0031800/0x83671231080c130c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x83671231080c1305 expref: 12 pid: 5832 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338587.655959:0:8451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc283b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8451:1874160212012160:0@lo:104: 00000100:00100000:0.0:1787338587.661509:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338587.661582:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338587.661695:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192065664 00000100:00100000:3.0:1787338587.661707:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192065664 00010000:00010000:3.0:1787338587.661749:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90bbf40e2800/0x83671231080c13d0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab56a expref: 10 pid: 5834 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338587.661788:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192065536 00000100:00100000:3.0:1787338587.661791:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192065536 00010000:00010000:3.0:1787338587.661803:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90bc02045800/0x83671231080c13d7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab571 expref: 11 pid: 5834 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338587.661824:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 19 00000100:00100000:3.0:1787338587.661833:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc283800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+11:2358:x1874160192065664:12345-192.168.201.53@tcp:103: 00010000:00010000:3.0:1787338587.661855:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787338587.661861:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90bbf40e2800/0x83671231080c13d0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab56a expref: 11 pid: 5834 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338587.661895:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90bbf40e2800/0x83671231080c13d0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab56a expref: 11 pid: 5834 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338587.661917:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787338587.661979:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc283800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+11:2358:x1874160192065664:12345-192.168.201.53@tcp:103: Request processed in 146us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338587.661987:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 19 00000100:00100000:3.0:1787338587.662006:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 20 00000100:00100000:3.0:1787338587.662081:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc282d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+10:2358:x1874160192065536:12345-192.168.201.53@tcp:103: 00010000:00010000:3.0:1787338587.662090:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787338587.662760:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90bc02045800/0x83671231080c13d7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab571 expref: 10 pid: 5834 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338587.662775:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90bc02045800/0x83671231080c13d7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab571 expref: 10 pid: 5834 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338587.662792:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90bbc0030a00/0x83671231080c140f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338587.662801:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bbc0030a00/0x83671231080c140f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338587.662819:0:5825:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90bbc0030a00/0x83671231080c140f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338587.662826:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90bbc0030a00/0x83671231080c140f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338587.662833:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90bbc0030a00/0x83671231080c140f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338587.663858:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90bbc0030a00/0x83671231080c140f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338587.664198:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbc0030a00 already unused, calling callback (ffffffffc1546230) 00010000:00010000:3.0:1787338587.664218:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90bbc0030a00/0x83671231080c140f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338587.664227:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90bbc0030a00/0x83671231080c140f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338587.664239:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90bbc0030a00/0x83671231080c140f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338587.664252:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787338587.664308:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc282d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+10:2358:x1874160192065536:12345-192.168.201.53@tcp:103: Request processed in 2291us (2722us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338587.664317:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 20 00010000:00010000:1.0:1787338587.664771:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90bc02045800/0x83671231080c13d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab571 expref: 9 pid: 5834 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338587.664785:0:8451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc280700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8451:1874160212011136:192.168.201.53@tcp:104: 00010000:00010000:1.0:1787338587.664798:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90bbf40e2800/0x83671231080c13d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab56a expref: 8 pid: 5834 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338587.664807:0:8451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc283100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8451:1874160212011264:192.168.201.53@tcp:104: 00010000:00010000:1.0:1787338587.664860:0:8451:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90bbc0030a00/0x83671231080c140f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338587.664870:0:8451:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90bbc0030a00/0x83671231080c140f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338587.664900:0:8451:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90bbc0030a00/0x83671231080c140f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338587.664906:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90bbc0030a00/0x83671231080c140f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338587.762571:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338587.762730:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192065792 00000100:00100000:1.0:1787338587.762741:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192065792 00000100:00100000:1.0:1787338587.762797:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 132 00000100:00100000:1.0:1787338587.762819:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbde806850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+8:5598:x1874160192065792:12345-192.168.201.53@tcp:101: 00010000:00010000:1.0:1787338587.762836:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787338587.762866:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90bc02045800/0x83671231080c1416 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab5d3 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338587.762913:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bc02045800/0x83671231080c1416 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab5d3 expref: 9 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338587.762925:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90bc02045800/0x83671231080c1416 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab5d3 expref: 9 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338587.762935:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bc02045800, rc 0) 00000100:00100000:1.0:1787338587.762992:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbde806850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+9:5598:x1874160192065792:12345-192.168.201.53@tcp:101: Request processed in 174us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338587.763000:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 132 00000100:00100000:3.0:1787338587.769732:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338587.772250:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192065920 00000100:00100000:1.0:1787338587.772265:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192065920 00000100:00100000:1.0:1787338587.772323:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 133 00000100:00100000:1.0:1787338587.772334:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbde807c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+9:5598:x1874160192065920:12345-192.168.201.53@tcp:501: 00000100:00100000:1.0:1787338587.772622:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbde807c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+9:5598:x1874160192065920:12345-192.168.201.53@tcp:501: Request processed in 288us (2898us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338587.772630:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 133 00000100:00100000:0.0:1787338587.795754:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338587.795836:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192066048 00000100:00100000:3.0:1787338587.795861:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192066048 00000100:00100000:3.0:1787338587.795948:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 134 00000100:00100000:3.0:1787338587.795960:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbde805850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+9:5598:x1874160192066048:12345-192.168.201.53@tcp:503: 00000100:00100000:3.0:1787338587.796718:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbde805850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+9:5598:x1874160192066048:12345-192.168.201.53@tcp:503: Request processed in 756us (972us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338587.796728:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 134 00000100:00100000:2.0:1787338587.829350:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338587.829402:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192066176 00000100:00100000:3.0:1787338587.829413:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192066176 00000100:00100000:3.0:1787338587.829509:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 135 00000100:00100000:3.0:1787338587.829519:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbde807850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+9:6064:x1874160192066176:12345-192.168.201.53@tcp:502: 00000100:00100000:3.0:1787338587.829756:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbde807850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+9:6064:x1874160192066176:12345-192.168.201.53@tcp:502: Request processed in 238us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338587.829774:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 135 00010000:00010000:1.0:1787338587.830284:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787338587.834702:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338587.834813:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192066304 00000100:00100000:1.0:1787338587.834822:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192066304 00000100:00100000:1.0:1787338587.834903:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 136 00000100:00100000:1.0:1787338587.834914:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbde804c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+9:6064:x1874160192066304:12345-192.168.201.53@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787338587.835156:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbde804c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+9:6064:x1874160192066304:12345-192.168.201.53@tcp:502:llog_process_th.0 Request processed in 243us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338587.835166:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 136 00000100:00100000:2.0:1787338587.837515:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338587.837608:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192066432 00000100:00100000:3.0:1787338587.837616:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192066432 00000100:00100000:3.0:1787338587.837905:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 137 00000100:00100000:3.0:1787338587.837919:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbde805c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+9:5598:x1874160192066432:12345-192.168.201.53@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787338587.837936:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787338587.837954:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90bbf7ea5600/0x83671231080c141d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab5da expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338587.837998:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bbf7ea5600/0x83671231080c141d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab5da expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338587.838011:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90bbf7ea5600/0x83671231080c141d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab5da expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338587.838021:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf7ea5600, rc 0) 00000100:00100000:3.0:1787338587.838088:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbde805c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+10:5598:x1874160192066432:12345-192.168.201.53@tcp:101:ll_cfg_requeue.0 Request processed in 173us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338587.838095:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 137 00000100:00100000:2.0:1787338587.848276:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338587.848365:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192066560 00000100:00100000:1.0:1787338587.848374:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192066560 00000100:00100000:1.0:1787338587.848658:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 138 00000100:00100000:1.0:1787338587.848671:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc7da4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+10:5598:x1874160192066560:12345-192.168.201.53@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787338587.849019:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc7da4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+10:5598:x1874160192066560:12345-192.168.201.53@tcp:501:ll_cfg_requeue.0 Request processed in 350us (748us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787338587.849028:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 138 00010000:00010000:1.0:1787338588.856072:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787338588.999033:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338588.999064:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338588.999094:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338588.999130:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338588.999160:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192066816 00000100:00100000:1.0:1787338588.999171:0:7647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192066816 00000100:00100000:1.0:1787338588.999262:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 29 00000100:00100000:1.0:1787338588.999274:0:7647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf41b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+6:2357:x1874160192066816:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:1.0:1787338588.999343:0:7647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf41b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+6:2357:x1874160192066816:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 72us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338588.999348:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 29 00000100:00100000:1.0:1787338588.999366:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192066944 00000100:00100000:1.0:1787338588.999369:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192066944 00000100:00100000:1.0:1787338588.999385:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192067072 00000100:00100000:1.0:1787338588.999387:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192067072 00000100:00100000:0.0:1787338588.999491:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192066688 00000100:00100000:0.0:1787338588.999494:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192066688 00000100:00100000:0.0:1787338588.999517:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 139 00000100:00100000:0.0:1787338588.999522:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc7da4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+10:2357:x1874160192066688:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:0.0:1787338588.999548:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc7da4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+10:2357:x1874160192066688:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 26us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338588.999553:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 139 00000100:00080000:0.0:1787338588.999663:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787338588.999667:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787338588.999797:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 12 00000100:00100000:0.0:1787338588.999806:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf41b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:83642291-0761-4205-9531-7fd25bc2d48e+5:2357:x1874160192066944:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:0.0:1787338588.999850:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf41b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:83642291-0761-4205-9531-7fd25bc2d48e+5:2357:x1874160192066944:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 45us (784us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338588.999857:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 12 00000100:00100000:1.0:1787338589.000149:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 13 00000100:00100000:1.0:1787338589.000156:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf41b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:83642291-0761-4205-9531-7fd25bc2d48e+5:2357:x1874160192067072:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:1.0:1787338589.000187:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf41b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:83642291-0761-4205-9531-7fd25bc2d48e+5:2357:x1874160192067072:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 32us (1058us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338589.000194:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 13 00000100:00080000:0.0:1787338589.005833:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000080:1.0:1787338589.408161:0:8504:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff05336f70 20000000:00000080:1.0:1787338589.408175:0:8504:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff90bbfbfeb400 uarg=0000000000000000 20000000:01000000:1.0:1787338589.408206:0:8504:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787338589.408213:0:8504:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787338589.408219:0:8504:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1787338589.408849:0:8505:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:2.0:1787338589.408991:0:8504:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:2.0:1787338589.411498:0:8504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:2.0:1787338589.411533:0:8504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:2.0:1787338589.411563:0:8504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:2.0:1787338589.411577:0:8504:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787338589.411593:0:8504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90bbf40e2600/0x83671231080c1424 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338589.411607:0:8504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90bc021c9800/0x83671231080c11fb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c11f4 expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338589.411613:0:8504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90bbc0031a00/0x83671231080c125d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c1256 expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338589.411617:0:8504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90bc021c8800/0x83671231080c1328 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c1321 expref: 11 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338589.411623:0:8504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90bbc0031000/0x83671231080c13e5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab5a2 expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338589.411627:0:8504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90bbf40e2600/0x83671231080c1424 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338589.411659:0:8504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90bbc0031000/0x83671231080c13e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab5a2 expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338589.411670:0:8504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90bbc0031000/0x83671231080c13e5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab5a2 expref: 9 pid: 5833 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338589.411681:0:8504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc91dc700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8504:1874160212013184:192.168.201.53@tcp:104: 00010000:00010000:2.0:1787338589.411901:0:8504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90bc021c8800/0x83671231080c1328 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x83671231080c1321 expref: 11 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338589.411923:0:8504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90bc021c8800/0x83671231080c1328 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x83671231080c1321 expref: 11 pid: 5833 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338589.411933:0:8504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc91df100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8504:1874160212013312:0@lo:104: 00000100:00100000:2.0:1787338589.411973:0:8504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338589.412011:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212013312 00000100:00100000:2.0:1787338589.412018:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212013312 00000100:00100000:2.0:1787338589.412054:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787338589.412062:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc91de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d79243c8-b367-45ff-8d76-fbaa4be8becb+3:8504:x1874160212013312:12345-0@lo:104: 00010000:00010000:2.0:1787338589.412073:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.153@tcp lock: ffff90bbc14a8a00/0x83671231080c1321 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x83671231080c1328 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338589.412113:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787338589.412118:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc91de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d79243c8-b367-45ff-8d76-fbaa4be8becb+3:8504:x1874160212013312:12345-0@lo:104: Request processed in 57us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338589.412124:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:2.0:1787338589.412929:0:8504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90bbc0031a00/0x83671231080c125d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x83671231080c1256 expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338589.412941:0:8504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90bbc0031a00/0x83671231080c125d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x83671231080c1256 expref: 11 pid: 5834 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338589.412952:0:8504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc91dea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8504:1874160212013440:0@lo:104: 00000100:00100000:2.0:1787338589.412985:0:8504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787338589.413085:0:8504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90bc021c9800/0x83671231080c11fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x83671231080c11f4 expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338589.413094:0:8504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90bc021c9800/0x83671231080c11fb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x83671231080c11f4 expref: 11 pid: 5834 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338589.413108:0:8504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc2d30a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8504:1874160212013568:0@lo:104: 00000100:00100000:2.0:1787338589.413128:0:8504:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc67a6d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787338589.413148:0:8504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc91df100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8504:1874160212013312:0@lo:104: 00000100:00100000:3.0:1787338589.413195:0:5821:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787338589.413283:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338589.413401:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212013440 00000100:00100000:3.0:1787338589.413407:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212013440 00000100:00100000:2.0:1787338589.413447:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212013568 00000100:00100000:2.0:1787338589.413451:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212013568 00000100:00100000:2.0:1787338589.413471:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787338589.413478:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbedc97c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d79243c8-b367-45ff-8d76-fbaa4be8becb+4:8504:x1874160212013440:12345-0@lo:104: 00010000:00010000:2.0:1787338589.413487:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.153@tcp lock: ffff90bbc0030600/0x83671231080c1256 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x83671231080c125d expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338589.414758:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787338589.414768:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbedc97c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d79243c8-b367-45ff-8d76-fbaa4be8becb+4:8504:x1874160212013440:12345-0@lo:104: Request processed in 1289us (1781us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338589.414775:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787338589.414830:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787338589.414840:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbedcb5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d79243c8-b367-45ff-8d76-fbaa4be8becb+3:8504:x1874160212013568:12345-0@lo:104: 00010000:00010000:2.0:1787338589.414855:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.153@tcp lock: ffff90bc021c9a00/0x83671231080c11f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x83671231080c11fb expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338589.414924:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787338589.414929:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbedcb5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d79243c8-b367-45ff-8d76-fbaa4be8becb+3:8504:x1874160212013568:12345-0@lo:104: Request processed in 93us (1647us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338589.414935:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787338589.414972:0:8504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc91dea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8504:1874160212013440:0@lo:104: 00000100:00100000:2.0:1787338589.414981:0:8504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc2d30a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8504:1874160212013568:0@lo:104: 00010000:00010000:0.0:1787338589.415107:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787338589.415115:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.153@tcp lock: ffff90bbc14a8a00/0x83671231080c1321 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x83671231080c1328 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338589.415122:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbc14a8a00 already unused, calling callback (ffffffffc1b2ec20) 10000000:00010000:0.0:1787338589.415126:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.153@tcp lock: ffff90bbc14a8a00/0x83671231080c1321 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x83671231080c1328 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338589.415134:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.153@tcp lock: ffff90bbc14a8a00/0x83671231080c1321 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x83671231080c1328 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787338589.415141:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.153@tcp lock: ffff90bbc14a8a00/0x83671231080c1321 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x83671231080c1328 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787338589.415147:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787338589.415184:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.153@tcp lock: ffff90bbc14a8a00/0x83671231080c1321 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c1328 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338589.415202:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787338589.415231:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.153@tcp lock: ffff90bbc14a8a00/0x83671231080c1321 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c1328 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338589.415239:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.153@tcp lock: ffff90bbc14a8a00/0x83671231080c1321 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c1328 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338589.415252:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787338589.415256:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.153@tcp lock: ffff90bbc0030600/0x83671231080c1256 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x83671231080c125d expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338589.415262:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbc0030600 already unused, calling callback (ffffffffc1b2ec20) 10000000:00010000:0.0:1787338589.415265:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.153@tcp lock: ffff90bbc0030600/0x83671231080c1256 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x83671231080c125d expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338589.415271:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.153@tcp lock: ffff90bbc0030600/0x83671231080c1256 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x83671231080c125d expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787338589.415277:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.153@tcp lock: ffff90bbc0030600/0x83671231080c1256 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x83671231080c125d expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787338589.415282:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787338589.415296:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.153@tcp lock: ffff90bbc0030600/0x83671231080c1256 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c125d expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338589.415302:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787338589.415308:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.153@tcp lock: ffff90bbc0030600/0x83671231080c1256 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c125d expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338589.415314:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.153@tcp lock: ffff90bbc0030600/0x83671231080c1256 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c125d expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338589.415329:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787338589.415333:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.153@tcp lock: ffff90bc021c9a00/0x83671231080c11f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x83671231080c11fb expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338589.415338:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bc021c9a00 already unused, calling callback (ffffffffc1b2ec20) 10000000:00010000:0.0:1787338589.415340:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.153@tcp lock: ffff90bc021c9a00/0x83671231080c11f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x83671231080c11fb expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338589.415347:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.153@tcp lock: ffff90bc021c9a00/0x83671231080c11f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x83671231080c11fb expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787338589.415353:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.153@tcp lock: ffff90bc021c9a00/0x83671231080c11f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x83671231080c11fb expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787338589.415358:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787338589.415371:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.153@tcp lock: ffff90bc021c9a00/0x83671231080c11f4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c11fb expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338589.415377:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787338589.415391:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.153@tcp lock: ffff90bc021c9a00/0x83671231080c11f4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c11fb expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338589.415398:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.153@tcp lock: ffff90bc021c9a00/0x83671231080c11f4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c11fb expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338589.415411:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787338589.415413:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787338589.415414:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787338589.415428:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc280380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d79243c8-b367-45ff-8d76-fbaa4be8becb:3317:1874160212013824:0@lo:103: 00000100:00100000:0.0:1787338589.415468:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338589.415508:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787338589.415514:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc280a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d79243c8-b367-45ff-8d76-fbaa4be8becb:3317:1874160212013696:0@lo:103: 00000100:00100000:0.0:1787338589.415535:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338589.415556:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc281180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d79243c8-b367-45ff-8d76-fbaa4be8becb:3314:1874160212013952:0@lo:103: 00000100:00100000:3.0:1787338589.415560:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212013824 00000100:00100000:3.0:1787338589.415566:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212013824 00000100:00100000:0.0:1787338589.415577:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787338589.415589:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90bbc0031a00/0x83671231080c125d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x83671231080c1256 expref: 12 pid: 5834 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338589.415611:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212013696 00000100:00100000:3.0:1787338589.415619:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212013696 00010000:00010000:3.0:1787338589.415632:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90bc021c8800/0x83671231080c1328 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x83671231080c1321 expref: 13 pid: 5833 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338589.415659:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212013952 00000100:00100000:0.0:1787338589.415663:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212013952 00010000:00010000:0.0:1787338589.415677:0:6704:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90bc021c9800/0x83671231080c11fb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x83671231080c11f4 expref: 14 pid: 5834 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338589.415693:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787338589.415700:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc283480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d79243c8-b367-45ff-8d76-fbaa4be8becb+14:3317:x1874160212013824:12345-0@lo:103: 00010000:00010000:0.0:1787338589.415711:0:6704:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787338589.415716:0:6704:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90bbc0031a00/0x83671231080c125d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x83671231080c1256 expref: 14 pid: 5834 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338589.415728:0:6704:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90bbc0031a00/0x83671231080c125d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x83671231080c1256 expref: 14 pid: 5834 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338589.415740:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90bbc0031a00/0x83671231080c125d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x83671231080c1256 expref: 14 pid: 5834 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338589.415752:0:6704:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787338589.415843:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787338589.415903:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc283480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d79243c8-b367-45ff-8d76-fbaa4be8becb+13:3317:x1874160212013824:12345-0@lo:103: Request processed in 203us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338589.415910:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787338589.415925:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787338589.415931:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc283100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d79243c8-b367-45ff-8d76-fbaa4be8becb+12:3317:x1874160212013696:12345-0@lo:103: 00010000:00010000:0.0:1787338589.415944:0:6704:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1787338589.415947:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00010000:00010000:0.0:1787338589.415949:0:6704:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90bc021c8800/0x83671231080c1328 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x83671231080c1321 expref: 12 pid: 5833 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338589.415954:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc280700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d79243c8-b367-45ff-8d76-fbaa4be8becb+12:3314:x1874160212013952:12345-0@lo:103: 00010000:00010000:0.0:1787338589.415958:0:6704:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90bc021c8800/0x83671231080c1328 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x83671231080c1321 expref: 12 pid: 5833 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338589.415960:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787338589.415963:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90bc021c9800/0x83671231080c11fb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x83671231080c11f4 expref: 12 pid: 5834 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338589.415967:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90bc021c8800/0x83671231080c1328 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x83671231080c1321 expref: 12 pid: 5833 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338589.415971:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90bc021c9800/0x83671231080c11fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x83671231080c11f4 expref: 12 pid: 5834 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338589.416084:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc280380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d79243c8-b367-45ff-8d76-fbaa4be8becb:3317:1874160212013824:0@lo:103: 00010000:00010000:0.0:1787338589.416126:0:6704:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787338589.416198:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc283100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d79243c8-b367-45ff-8d76-fbaa4be8becb+11:3317:x1874160212013696:12345-0@lo:103: Request processed in 266us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338589.416204:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787338589.416377:0:8504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc91dc700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8504:1874160212013184:192.168.201.53@tcp:104: 00010000:00010000:1.0:1787338589.416411:0:8504:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90bbf40e2600/0x83671231080c1424 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338589.416501:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc280a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d79243c8-b367-45ff-8d76-fbaa4be8becb:3317:1874160212013696:0@lo:103: 00010000:00010000:3.0:1787338589.416679:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90bc021c9800/0x83671231080c11fb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x83671231080c11f4 expref: 10 pid: 5834 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338589.416690:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787338589.416731:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc280700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d79243c8-b367-45ff-8d76-fbaa4be8becb+9:3314:x1874160212013952:12345-0@lo:103: Request processed in 778us (1153us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338589.416738:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787338589.417097:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338589.417275:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc281180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d79243c8-b367-45ff-8d76-fbaa4be8becb:3314:1874160212013952:0@lo:103: 00000100:00100000:2.0:1787338589.417321:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192067200 00000100:00100000:2.0:1787338589.417327:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192067200 00010000:00010000:2.0:1787338589.417349:0:6704:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90bbc0031000/0x83671231080c13e5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab5a2 expref: 10 pid: 5833 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338589.417387:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 24 00000100:00100000:2.0:1787338589.417396:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf41b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+10:2358:x1874160192067200:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787338589.417407:0:6704:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787338589.417413:0:6704:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90bbc0031000/0x83671231080c13e5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab5a2 expref: 10 pid: 5833 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338589.417423:0:6704:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90bbc0031000/0x83671231080c13e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab5a2 expref: 10 pid: 5833 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338589.417434:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90bbc0031000/0x83671231080c13e5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab5a2 expref: 10 pid: 5833 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338589.417443:0:6704:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90bbf40e2600/0x83671231080c1424 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338589.417448:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bbf40e2600/0x83671231080c1424 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338589.417459:0:6704:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90bbf40e2600/0x83671231080c1424 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338589.417463:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90bbf40e2600/0x83671231080c1424 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338589.417473:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90bbf40e2600/0x83671231080c1424 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338589.417478:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90bbf40e2600/0x83671231080c1424 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338589.417481:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e2600 already unused, calling callback (ffffffffc1546230) 00010000:00010000:2.0:1787338589.417484:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90bbf40e2600/0x83671231080c1424 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338589.417489:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90bbf40e2600/0x83671231080c1424 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338589.417504:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90bbf40e2600/0x83671231080c1424 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338589.417511:0:6704:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787338589.417543:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf41b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+9:2358:x1874160192067200:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 150us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338589.417548:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 24 00010000:00010000:1.0:1787338589.417602:0:8504:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90bbf40e2600/0x83671231080c1424 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338589.417607:0:8504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90bbf40e2600/0x83671231080c1424 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338589.417612:0:8504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90bbf40e2600/0x83671231080c1424 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787338589.614008:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787338589.614017:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90bbff941800 from 39 10000000:01000000:3.0:1787338589.614024:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787338589.614342:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbf7ea5e00/0x83671231080c142b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338589.614357:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.153@tcp lock: ffff90bbf7ea5e00/0x83671231080c142b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338589.614369:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.153@tcp lock: ffff90bbf7ea5e00/0x83671231080c142b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338589.614422:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbedcb6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212014080:0@lo:101: 00000100:00100000:3.0:1787338589.614493:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338589.614605:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbeb0489c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787338589.614725:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212014080 00000100:00100000:1.0:1787338589.614733:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212014080 00000100:00100000:1.0:1787338589.614801:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1787338589.614828:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc7da4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+9:5836:x1874160212014080:12345-0@lo:101: 00010000:00010000:1.0:1787338589.614842:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787338589.614855:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90bc02044c00/0x83671231080c1432 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x83671231080c142b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338589.614899:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bc02044c00/0x83671231080c1432 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x83671231080c142b expref: 10 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338589.614910:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90bc02044c00/0x83671231080c1432 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c142b expref: 10 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338589.614919:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bc02044c00, rc 0) 00000100:00100000:1.0:1787338589.614968:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc7da4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+10:5836:x1874160212014080:12345-0@lo:101: Request processed in 142us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338589.614976:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1787338589.615249:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbedcb6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212014080:0@lo:101: 00010000:00010000:3.0:1787338589.615261:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.153@tcp lock: ffff90bbf7ea5e00/0x83671231080c142b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c1432 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338589.615266:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.153@tcp lock: ffff90bbf7ea5e00/0x83671231080c142b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x83671231080c1432 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338589.615309:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbedcb6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212014208:0@lo:501: 00000100:00100000:3.0:1787338589.615336:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338589.615408:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212014208 00000100:00100000:0.0:1787338589.615413:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212014208 00000100:00100000:0.0:1787338589.615445:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787338589.615453:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc7da7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+10:5836:x1874160212014208:12345-0@lo:501: 00000100:00100000:0.0:1787338589.615695:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc7da7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+10:5836:x1874160212014208:12345-0@lo:501: Request processed in 242us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338589.615703:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787338589.616948:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbeb0489c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787338589.616977:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbedcb6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212014208:0@lo:501: 00000100:00100000:3.0:1787338589.617023:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbedcb6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212014336:0@lo:503: 00000100:00100000:3.0:1787338589.617268:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338589.617338:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbeb0489c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787338589.617499:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212014336 00000100:00100000:1.0:1787338589.617506:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212014336 00000100:00100000:1.0:1787338589.617589:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787338589.617597:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc7da7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+10:5836:x1874160212014336:12345-0@lo:503: 00000100:00100000:1.0:1787338589.617797:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc7da7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+10:5836:x1874160212014336:12345-0@lo:503: Request processed in 200us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338589.617817:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1787338589.617901:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbedcb6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212014336:0@lo:503: 00000100:00100000:0.0:1787338589.618478:0:8517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc281180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d79243c8-b367-45ff-8d76-fbaa4be8becb:8517:1874160212014464:0@lo:502: 00000100:00100000:0.0:1787338589.618509:0:8517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338589.620332:0:8517:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc6748000 going to sleep for 11 seconds 00000100:00100000:3.0:1787338589.620581:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212014464 00000100:00100000:3.0:1787338589.620591:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212014464 00000100:00100000:3.0:1787338589.620637:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787338589.620647:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc7da6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+10:8517:x1874160212014464:12345-0@lo:502: 00000100:00100000:3.0:1787338589.620942:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc7da6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+10:8517:x1874160212014464:12345-0@lo:502: Request processed in 296us (2430us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338589.620951:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1787338589.621072:0:8517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc281180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d79243c8-b367-45ff-8d76-fbaa4be8becb:8517:1874160212014464:0@lo:502: 00000100:00100000:0.0:1787338589.621158:0:8517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc281180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d79243c8-b367-45ff-8d76-fbaa4be8becb:8517:1874160212014592:0@lo:502: 00000100:00100000:0.0:1787338589.621197:0:8517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338589.621227:0:8517:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc6748000 going to sleep for 11 seconds 00000100:00100000:3.0:1787338589.621485:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212014592 00000100:00100000:3.0:1787338589.621497:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212014592 00000100:00100000:3.0:1787338589.621520:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787338589.621528:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc7da7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+10:8517:x1874160212014592:12345-0@lo:502: 00000100:00100000:3.0:1787338589.622926:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc7da7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+10:8517:x1874160212014592:12345-0@lo:502: Request processed in 1391us (1722us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338589.622935:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1787338589.623508:0:8517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc281180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d79243c8-b367-45ff-8d76-fbaa4be8becb:8517:1874160212014592:0@lo:502: 00000040:00080000:0.0:1787338589.623548:0:8517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1787338589.623646:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1787338589.623672:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787338589.623685:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbf7ea5e00/0x83671231080c142b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c1432 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338589.623698:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.153@tcp lock: ffff90bbf7ea5e00/0x83671231080c142b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c1432 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787338589.623709:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1787338589.623722:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:2.0:1787338589.623726:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1787338589.623760:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbf40e3a00/0x83671231080c1439 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338589.623769:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.153@tcp lock: ffff90bbf40e3a00/0x83671231080c1439 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338589.623778:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.153@tcp lock: ffff90bbf40e3a00/0x83671231080c1439 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338589.623796:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc2d30380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212014720:0@lo:101: 00000100:00100000:2.0:1787338589.623855:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338589.623928:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc67a6780 going to sleep for 11 seconds 00000100:00100000:3.0:1787338589.623957:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212014720 00000100:00100000:3.0:1787338589.623962:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212014720 00000100:00100000:3.0:1787338589.624032:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787338589.624041:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc7da5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+10:5836:x1874160212014720:12345-0@lo:101: 00010000:00010000:3.0:1787338589.624052:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787338589.624066:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90bbf7ea4e00/0x83671231080c1440 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x83671231080c1439 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338589.624090:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bbf7ea4e00/0x83671231080c1440 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x83671231080c1439 expref: 11 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338589.624101:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90bbf7ea4e00/0x83671231080c1440 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c1439 expref: 11 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338589.624110:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf7ea4e00, rc 0) 00000100:00100000:3.0:1787338589.624160:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc7da5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+11:5836:x1874160212014720:12345-0@lo:101: Request processed in 120us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338589.624320:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc2d30380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212014720:0@lo:101: 00010000:00010000:2.0:1787338589.624333:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.153@tcp lock: ffff90bbf40e3a00/0x83671231080c1439 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c1440 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338589.624342:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.153@tcp lock: ffff90bbf40e3a00/0x83671231080c1439 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x83671231080c1440 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338589.624387:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc2d30380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212014848:0@lo:501: 00000100:00100000:2.0:1787338589.624413:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338589.624439:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1787338589.624510:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc67a6780 going to sleep for 11 seconds 00000100:00100000:3.0:1787338589.624557:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212014848 00000100:00100000:3.0:1787338589.624561:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212014848 00000100:00100000:3.0:1787338589.624578:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1787338589.624585:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc7da7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+11:5836:x1874160212014848:12345-0@lo:501: 00000100:00100000:3.0:1787338589.624845:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc7da7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+11:5836:x1874160212014848:12345-0@lo:501: Request processed in 259us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338589.624859:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787338589.624963:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc2d30380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212014848:0@lo:501: 00000100:00100000:2.0:1787338589.624992:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc2d30380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212014976:0@lo:503: 00000100:00100000:2.0:1787338589.625028:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338589.625056:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc67a6780 going to sleep for 11 seconds 00000100:00100000:1.0:1787338589.625149:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212014976 00000100:00100000:1.0:1787338589.625154:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212014976 00000100:00100000:0.0:1787338589.625353:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1787338589.625364:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc7da4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+11:5836:x1874160212014976:12345-0@lo:503: 00000100:00100000:0.0:1787338589.625609:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc7da4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+11:5836:x1874160212014976:12345-0@lo:503: Request processed in 246us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338589.625617:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787338589.625639:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc2d30380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212014976:0@lo:503: 00000100:00100000:0.0:1787338589.626332:0:8518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc281180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d79243c8-b367-45ff-8d76-fbaa4be8becb:8518:1874160212015104:0@lo:502: 00000100:00100000:0.0:1787338589.626448:0:8518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338589.626482:0:8518:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc6748900 going to sleep for 11 seconds 00000100:00100000:2.0:1787338589.626498:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212015104 00000100:00100000:2.0:1787338589.626504:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212015104 00000100:00100000:2.0:1787338589.626541:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787338589.626551:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc7da5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+11:8518:x1874160212015104:12345-0@lo:502: 00000100:00100000:2.0:1787338589.626717:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc7da5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+11:8518:x1874160212015104:12345-0@lo:502: Request processed in 166us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338589.626724:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1787338589.626858:0:8518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc281180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d79243c8-b367-45ff-8d76-fbaa4be8becb:8518:1874160212015104:0@lo:502: 00000020:01000000:0.0:1787338589.626908:0:8518:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787338589.626916:0:8518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787338589.626919:0:8518:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787338589.626925:0:8518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1787338589.626948:0:8518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc281180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d79243c8-b367-45ff-8d76-fbaa4be8becb:8518:1874160212015232:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787338589.626983:0:8518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338589.627012:0:8518:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc6748900 going to sleep for 11 seconds 00000100:00100000:2.0:1787338589.627031:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212015232 00000100:00100000:2.0:1787338589.627037:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212015232 00000100:00100000:2.0:1787338589.627063:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787338589.627070:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc7da5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+11:8518:x1874160212015232:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787338589.627362:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc7da5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+11:8518:x1874160212015232:12345-0@lo:502:llog_process_th.0 Request processed in 292us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338589.627369:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787338589.627427:0:8518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc281180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d79243c8-b367-45ff-8d76-fbaa4be8becb:8518:1874160212015232:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787338589.627445:0:8518:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787338589.627449:0:8518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787338589.627451:0:8518:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787338589.627454:0:8518:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:2.0:1787338589.627624:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:2.0:1787338589.627644:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.153@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1787338589.627653:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbf40e3a00/0x83671231080c1439 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c1440 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338589.627665:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.153@tcp lock: ffff90bbf40e3a00/0x83671231080c1439 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c1440 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787338589.627674:0:5836:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787338589.627799:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90bbff941800 from 4 10000000:01000000:2.0:1787338589.627803:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787338589.627843:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbf40e3200/0x83671231080c1447 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338589.627863:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.153@tcp lock: ffff90bbf40e3200/0x83671231080c1447 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338589.628036:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.153@tcp lock: ffff90bbf40e3200/0x83671231080c1447 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338589.628054:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc2d30380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212015360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787338589.628091:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338589.628116:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc67a6b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787338589.628288:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212015360 00000100:00100000:3.0:1787338589.628294:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212015360 00000100:00100000:3.0:1787338589.628330:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787338589.628339:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc7da6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+11:5836:x1874160212015360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787338589.628348:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787338589.628363:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90bbf7ea4000/0x83671231080c144e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x83671231080c1447 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338589.628386:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bbf7ea4000/0x83671231080c144e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x83671231080c1447 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338589.628395:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90bbf7ea4000/0x83671231080c144e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c1447 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338589.628403:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf7ea4000, rc 0) 00000100:00100000:3.0:1787338589.628480:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc7da6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+12:5836:x1874160212015360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338589.628486:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787338589.628535:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc2d30380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212015360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787338589.628606:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.153@tcp lock: ffff90bbf40e3200/0x83671231080c1447 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c144e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338589.628617:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.153@tcp lock: ffff90bbf40e3200/0x83671231080c1447 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x83671231080c144e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338589.628664:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc2d30380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212015488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787338589.628701:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338589.628732:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc67a6b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787338589.628841:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212015488 00000100:00100000:0.0:1787338589.628846:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212015488 00000100:00100000:0.0:1787338589.628950:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1787338589.628958:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc7da5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+12:5836:x1874160212015488:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787338589.629396:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc7da5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+12:5836:x1874160212015488:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 438us (693us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338589.629404:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787338589.631495:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc2d30380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212015488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787338589.631763:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbedcb4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212015616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787338589.631860:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338589.631929:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbde22d300 going to sleep for 11 seconds 00000100:00100000:1.0:1787338589.632050:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212015616 00000100:00100000:1.0:1787338589.632057:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212015616 00000100:00100000:0.0:1787338589.632304:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1787338589.632316:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc7da6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+12:5836:x1874160212015616:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787338589.632507:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc7da6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+12:5836:x1874160212015616:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 194us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338589.632515:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787338589.632540:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbedcb4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212015616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787338589.633036:0:8519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc283b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d79243c8-b367-45ff-8d76-fbaa4be8becb:8519:1874160212015744:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787338589.633072:0:8519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338589.633116:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212015744 00000100:00100000:2.0:1787338589.633122:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212015744 00000100:00100000:0.0:1787338589.633191:0:8519:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc6748600 going to sleep for 11 seconds 00000100:00100000:2.0:1787338589.633317:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1787338589.633329:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc7da6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+12:8519:x1874160212015744:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787338589.633497:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc7da6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+12:8519:x1874160212015744:12345-0@lo:502:llog_process_th.0 Request processed in 171us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338589.633544:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787338589.633546:0:8519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc283b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d79243c8-b367-45ff-8d76-fbaa4be8becb:8519:1874160212015744:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787338589.633572:0:8519:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787338589.633581:0:8519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787338589.633583:0:8519:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787338589.633590:0:8519:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90bbff941800 00000020:00000080:0.0:1787338589.633593:0:8519:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787338589.633679:0:8519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc283b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d79243c8-b367-45ff-8d76-fbaa4be8becb:8519:1874160212015872:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787338589.633714:0:8519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338589.633738:0:8519:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc6748600 going to sleep for 11 seconds 00000100:00100000:1.0:1787338589.633789:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212015872 00000100:00100000:1.0:1787338589.633794:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212015872 00000100:00100000:1.0:1787338589.633835:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1787338589.633841:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc408b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+12:8519:x1874160212015872:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787338589.633966:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc408b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+12:8519:x1874160212015872:12345-0@lo:502:llog_process_th.0 Request processed in 126us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338589.633971:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1787338589.634992:0:8519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc283b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d79243c8-b367-45ff-8d76-fbaa4be8becb:8519:1874160212015872:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787338589.635016:0:8519:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787338589.635021:0:8519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787338589.635023:0:8519:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1787338589.635028:0:8519:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1787338589.635205:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1787338589.635223:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787338589.635230:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbf40e3200/0x83671231080c1447 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c144e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338589.635238:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.153@tcp lock: ffff90bbf40e3200/0x83671231080c1447 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c144e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787338589.635250:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787338589.635252:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90bbc9632800 from 39 10000000:01000000:0.0:1787338589.635254:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787338589.635279:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbc0030600/0x83671231080c1455 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338589.635285:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.153@tcp lock: ffff90bbc0030600/0x83671231080c1455 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338589.635291:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.153@tcp lock: ffff90bbc0030600/0x83671231080c1455 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338589.635302:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc281f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212016000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787338589.635333:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338589.635365:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc6748600 going to sleep for 11 seconds 00000100:00100000:1.0:1787338589.635650:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212016000 00000100:00100000:1.0:1787338589.635656:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212016000 00000100:00100000:1.0:1787338589.635698:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787338589.635707:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc408b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+12:5836:x1874160212016000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787338589.635718:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787338589.635730:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90bc02045600/0x83671231080c145c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x83671231080c1455 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338589.635751:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bc02045600/0x83671231080c145c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x83671231080c1455 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338589.635761:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90bc02045600/0x83671231080c145c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c1455 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338589.635770:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bc02045600, rc 0) 00000100:00100000:1.0:1787338589.635822:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc408b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+13:5836:x1874160212016000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338589.635829:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787338589.636932:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc281f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212016000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787338589.636955:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.153@tcp lock: ffff90bbc0030600/0x83671231080c1455 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c145c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338589.636967:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.153@tcp lock: ffff90bbc0030600/0x83671231080c1455 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x83671231080c145c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338589.637038:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc2d31180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212016128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787338589.637077:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338589.637108:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc67a6f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787338589.640186:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212016128 00000100:00100000:0.0:1787338589.640202:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212016128 00000100:00100000:0.0:1787338589.640262:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1787338589.640273:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc408a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+13:5836:x1874160212016128:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787338589.640585:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc408a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+13:5836:x1874160212016128:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 312us (3506us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338589.640594:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1787338589.640912:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc2d31180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212016128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787338589.640962:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc2d31180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212016256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787338589.641015:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338589.641051:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc67a6f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787338589.641253:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212016256 00000100:00100000:1.0:1787338589.641258:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212016256 00000100:00100000:1.0:1787338589.641300:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1787338589.641309:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc408bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+13:5836:x1874160212016256:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787338589.641450:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc408bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+13:5836:x1874160212016256:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 143us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338589.641466:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787338589.641615:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc2d31180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212016256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787338589.642018:0:8520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf41b4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d79243c8-b367-45ff-8d76-fbaa4be8becb:8520:1874160212016384:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787338589.642055:0:8520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338589.642091:0:8520:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc41630c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787338589.642255:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212016384 00000100:00100000:2.0:1787338589.642260:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212016384 00000100:00100000:2.0:1787338589.642283:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787338589.642292:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4089850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+13:8520:x1874160212016384:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787338589.642680:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4089850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+13:8520:x1874160212016384:12345-0@lo:502:llog_process_th.0 Request processed in 389us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338589.642697:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787338589.642780:0:8520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf41b4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d79243c8-b367-45ff-8d76-fbaa4be8becb:8520:1874160212016384:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787338589.642838:0:8520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf41b4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d79243c8-b367-45ff-8d76-fbaa4be8becb:8520:1874160212016512:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787338589.642948:0:8520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338589.643065:0:8520:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc41630c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787338589.645305:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212016512 00000100:00100000:0.0:1787338589.645317:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212016512 00000100:00100000:0.0:1787338589.645361:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1787338589.645370:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc408b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+13:8520:x1874160212016512:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787338589.646559:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc408b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+13:8520:x1874160212016512:12345-0@lo:502:llog_process_th.0 Request processed in 1184us (3606us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338589.646576:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787338589.646625:0:8520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf41b4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d79243c8-b367-45ff-8d76-fbaa4be8becb:8520:1874160212016512:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1787338589.646668:0:8520:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1787338589.646746:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1787338589.646768:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787338589.646778:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbc0030600/0x83671231080c1455 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c145c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338589.646789:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.153@tcp lock: ffff90bbc0030600/0x83671231080c1455 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c145c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787338589.646798:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1787338589.646801:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1787338589.646804:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1787338589.646846:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbc0030200/0x83671231080c1463 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338589.646854:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.153@tcp lock: ffff90bbc0030200/0x83671231080c1463 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338589.646862:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.153@tcp lock: ffff90bbc0030200/0x83671231080c1463 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338589.646945:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc281c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212016640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787338589.646984:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338589.647056:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc6748b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787338589.647184:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212016640 00000100:00100000:1.0:1787338589.647190:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212016640 00000100:00100000:1.0:1787338589.647260:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787338589.647268:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4088c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+13:5836:x1874160212016640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787338589.647280:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787338589.647292:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90bc02045000/0x83671231080c146a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x83671231080c1463 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338589.647314:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bc02045000/0x83671231080c146a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x83671231080c1463 expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338589.647325:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90bc02045000/0x83671231080c146a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c1463 expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338589.647333:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bc02045000, rc 0) 00000100:00100000:1.0:1787338589.647381:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4088c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+14:5836:x1874160212016640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338589.647387:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1787338589.647454:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc281c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212016640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787338589.647467:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.153@tcp lock: ffff90bbc0030200/0x83671231080c1463 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c146a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338589.647476:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.153@tcp lock: ffff90bbc0030200/0x83671231080c1463 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x83671231080c146a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338589.647521:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbedcb4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212016768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787338589.647548:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338589.647644:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbd1649f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787338589.647672:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212016768 00000100:00100000:0.0:1787338589.647676:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212016768 00000100:00100000:0.0:1787338589.647693:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1787338589.647698:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4089c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+14:5836:x1874160212016768:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787338589.647950:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4089c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+14:5836:x1874160212016768:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 249us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338589.647961:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1787338589.651991:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbedcb4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212016768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787338589.652055:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbedcb4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212016896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787338589.652276:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338589.652421:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbd1649f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787338589.652468:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212016896 00000100:00100000:1.0:1787338589.652476:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212016896 00000100:00100000:1.0:1787338589.652550:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1787338589.652561:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4089450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+14:5836:x1874160212016896:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787338589.652759:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4089450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+14:5836:x1874160212016896:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 200us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338589.652779:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1787338589.652787:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbedcb4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212016896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787338589.653054:0:8523:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbedcb4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d79243c8-b367-45ff-8d76-fbaa4be8becb:8523:1874160212017024:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787338589.653092:0:8523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338589.653128:0:8523:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbd16499c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787338589.653724:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212017024 00000100:00100000:0.0:1787338589.653731:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212017024 00000100:00100000:0.0:1787338589.653774:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1787338589.653782:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc408a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+14:8523:x1874160212017024:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787338589.654002:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc408a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+14:8523:x1874160212017024:12345-0@lo:502:llog_process_th.0 Request processed in 220us (908us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338589.654010:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1787338589.654032:0:8523:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbedcb4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d79243c8-b367-45ff-8d76-fbaa4be8becb:8523:1874160212017024:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787338589.654067:0:8523:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787338589.654076:0:8523:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787338589.654079:0:8523:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787338589.654084:0:8523:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787338589.654108:0:8523:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbedcb4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d79243c8-b367-45ff-8d76-fbaa4be8becb:8523:1874160212017152:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787338589.654141:0:8523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338589.654205:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212017152 00000100:00100000:1.0:1787338589.654210:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212017152 00000100:00100000:1.0:1787338589.654242:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1787338589.654258:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4089050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+14:8523:x1874160212017152:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787338589.654315:0:8523:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbd16499c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787338589.657285:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4089050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+14:8523:x1874160212017152:12345-0@lo:502:llog_process_th.0 Request processed in 3029us (3135us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338589.657299:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1787338589.657813:0:8523:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbedcb4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d79243c8-b367-45ff-8d76-fbaa4be8becb:8523:1874160212017152:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787338589.657853:0:8523:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787338589.657862:0:8523:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787338589.657864:0:8523:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787338589.657869:0:8523:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:2.0:1787338589.658256:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:2.0:1787338589.658277:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.153@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1787338589.658287:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbc0030200/0x83671231080c1463 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c146a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338589.658299:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.153@tcp lock: ffff90bbc0030200/0x83671231080c1463 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c146a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787338589.658308:0:5836:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787338589.658311:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90bbc9632800 from 4 10000000:01000000:2.0:1787338589.658313:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787338589.658344:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbf40e2400/0x83671231080c1471 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338589.658351:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.153@tcp lock: ffff90bbf40e2400/0x83671231080c1471 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338589.658360:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.153@tcp lock: ffff90bbf40e2400/0x83671231080c1471 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338589.658378:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc2d31180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212017280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787338589.658428:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338589.658456:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc67a6600 going to sleep for 11 seconds 00000100:00100000:1.0:1787338589.658510:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212017280 00000100:00100000:1.0:1787338589.658516:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212017280 00000100:00100000:1.0:1787338589.658559:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1787338589.658567:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc408ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+14:5836:x1874160212017280:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787338589.658579:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787338589.658590:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90bc02045e00/0x83671231080c1478 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x83671231080c1471 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338589.658609:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bc02045e00/0x83671231080c1478 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x83671231080c1471 expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338589.658619:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90bc02045e00/0x83671231080c1478 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c1471 expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338589.658641:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bc02045e00, rc 0) 00000100:00100000:1.0:1787338589.658678:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc408ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+15:5836:x1874160212017280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338589.658685:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1787338589.658719:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc2d31180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212017280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787338589.658732:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.153@tcp lock: ffff90bbf40e2400/0x83671231080c1471 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c1478 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338589.658740:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.153@tcp lock: ffff90bbf40e2400/0x83671231080c1471 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x83671231080c1478 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338589.658785:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf41b7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212017408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787338589.660082:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338589.660138:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc4163c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787338589.660327:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212017408 00000100:00100000:2.0:1787338589.660336:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212017408 00000100:00100000:2.0:1787338589.660401:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1787338589.660413:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc408a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+15:5836:x1874160212017408:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787338589.660769:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc408a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+15:5836:x1874160212017408:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 358us (691us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338589.660784:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1787338589.663076:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf41b7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212017408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787338589.663151:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc280000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212017536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787338589.663228:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338589.663940:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc6748e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787338589.664009:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212017536 00000100:00100000:1.0:1787338589.664016:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212017536 00000100:00100000:1.0:1787338589.664075:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1787338589.664085:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4088850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+15:5836:x1874160212017536:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787338589.664319:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4088850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+15:5836:x1874160212017536:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 235us (1092us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338589.664325:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1787338589.664448:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc280000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212017536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787338589.664776:0:8524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc280000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d79243c8-b367-45ff-8d76-fbaa4be8becb:8524:1874160212017664:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787338589.664821:0:8524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338589.664920:0:8524:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc6748600 going to sleep for 11 seconds 00000100:00100000:1.0:1787338589.664991:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212017664 00000100:00100000:1.0:1787338589.664996:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212017664 00000100:00100000:1.0:1787338589.665045:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1787338589.665050:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4088050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+15:8524:x1874160212017664:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787338589.665225:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4088050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+15:8524:x1874160212017664:12345-0@lo:502:llog_process_th.0 Request processed in 173us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338589.665232:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1787338589.665338:0:8524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc280000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d79243c8-b367-45ff-8d76-fbaa4be8becb:8524:1874160212017664:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787338589.665364:0:8524:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787338589.665374:0:8524:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787338589.665377:0:8524:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787338589.665383:0:8524:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90bbc9632800 00000020:00000080:0.0:1787338589.665386:0:8524:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787338589.665471:0:8524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc280000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d79243c8-b367-45ff-8d76-fbaa4be8becb:8524:1874160212017792:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787338589.665507:0:8524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338589.669404:0:8524:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc7c26600 going to sleep for 11 seconds 00000100:00100000:1.0:1787338589.669508:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212017792 00000100:00100000:1.0:1787338589.669517:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212017792 00000100:00100000:1.0:1787338589.669556:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1787338589.669565:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4088450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+15:8524:x1874160212017792:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787338589.669824:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4088450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+15:8524:x1874160212017792:12345-0@lo:502:llog_process_th.0 Request processed in 259us (4315us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338589.669831:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1787338589.669981:0:8524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc280000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d79243c8-b367-45ff-8d76-fbaa4be8becb:8524:1874160212017792:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787338589.670014:0:8524:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787338589.670022:0:8524:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787338589.670025:0:8524:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1787338589.670029:0:8524:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1787338589.671224:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1787338589.671259:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787338589.671269:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbf40e2400/0x83671231080c1471 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c1478 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338589.671280:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.153@tcp lock: ffff90bbf40e2400/0x83671231080c1471 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c1478 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787338589.671290:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787338589.671293:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90bbd0622000 from 39 10000000:01000000:1.0:1787338589.671296:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787338589.671326:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bc02044a00/0x83671231080c147f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338589.671332:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.153@tcp lock: ffff90bc02044a00/0x83671231080c147f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338589.671339:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.153@tcp lock: ffff90bc02044a00/0x83671231080c147f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338589.671360:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf41b4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212017920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787338589.671401:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338589.671434:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc818c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787338589.671892:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212017920 00000100:00100000:2.0:1787338589.671899:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212017920 00000100:00100000:2.0:1787338589.671936:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1787338589.671944:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4012050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+15:5836:x1874160212017920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787338589.671955:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787338589.671968:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90bbf40e2000/0x83671231080c1486 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x83671231080c147f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338589.671990:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bbf40e2000/0x83671231080c1486 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x83671231080c147f expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338589.672001:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90bbf40e2000/0x83671231080c1486 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c147f expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338589.672010:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf40e2000, rc 0) 00000100:00100000:2.0:1787338589.672050:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4012050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+16:5836:x1874160212017920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338589.672056:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1787338589.672339:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf41b4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212017920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787338589.672351:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.153@tcp lock: ffff90bc02044a00/0x83671231080c147f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c1486 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338589.672357:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.153@tcp lock: ffff90bc02044a00/0x83671231080c147f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x83671231080c1486 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338589.672403:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf41b4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212018048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787338589.672423:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338589.672447:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc818c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787338589.672456:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212018048 00000100:00100000:2.0:1787338589.672460:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212018048 00000100:00100000:2.0:1787338589.672484:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1787338589.672491:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4011050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+16:5836:x1874160212018048:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787338589.672717:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4011050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+16:5836:x1874160212018048:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 226us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338589.672725:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1787338589.673370:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf41b4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212018048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787338589.673398:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf41b4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212018176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787338589.673429:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338589.673454:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc818c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787338589.673466:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212018176 00000100:00100000:2.0:1787338589.673476:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212018176 00000100:00100000:2.0:1787338589.673512:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1787338589.673519:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4012c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+16:5836:x1874160212018176:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787338589.673738:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4012c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+16:5836:x1874160212018176:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 218us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338589.673746:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1787338589.673754:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf41b4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212018176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787338589.674421:0:8527:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc2d33480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d79243c8-b367-45ff-8d76-fbaa4be8becb:8527:1874160212018304:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787338589.674459:0:8527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338589.674491:0:8527:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbf42ddc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787338589.674534:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212018304 00000100:00100000:3.0:1787338589.674539:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212018304 00000100:00100000:3.0:1787338589.674612:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1787338589.674621:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4012450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+16:8527:x1874160212018304:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787338589.674831:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4012450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+16:8527:x1874160212018304:12345-0@lo:502:llog_process_th.0 Request processed in 211us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338589.674839:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1787338589.674913:0:8527:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc2d33480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d79243c8-b367-45ff-8d76-fbaa4be8becb:8527:1874160212018304:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787338589.674951:0:8527:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc2d33480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d79243c8-b367-45ff-8d76-fbaa4be8becb:8527:1874160212018432:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787338589.674981:0:8527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338589.675118:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212018432 00000100:00100000:1.0:1787338589.675123:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212018432 00000100:00100000:1.0:1787338589.675145:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1787338589.675152:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4010850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+16:8527:x1874160212018432:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787338589.675299:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4010850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+16:8527:x1874160212018432:12345-0@lo:502:llog_process_th.0 Request processed in 146us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338589.675314:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1787338589.675489:0:8527:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbf42ddc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787338589.675503:0:8527:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc2d33480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d79243c8-b367-45ff-8d76-fbaa4be8becb:8527:1874160212018432:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1787338589.675522:0:8527:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1787338589.675701:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1787338589.675735:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787338589.675744:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bc02044a00/0x83671231080c147f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c1486 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338589.675756:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.153@tcp lock: ffff90bc02044a00/0x83671231080c147f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c1486 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787338589.675767:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1787338589.675769:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:1.0:1787338589.675772:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787338589.675798:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bc021c9800/0x83671231080c148d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338589.675822:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.153@tcp lock: ffff90bc021c9800/0x83671231080c148d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338589.675831:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.153@tcp lock: ffff90bc021c9800/0x83671231080c148d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338589.675844:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf41b4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212018560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787338589.676015:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338589.676071:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbd8aae900 going to sleep for 11 seconds 00000100:00100000:2.0:1787338589.676108:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212018560 00000100:00100000:2.0:1787338589.676114:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212018560 00000100:00100000:2.0:1787338589.676177:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1787338589.676186:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4010050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+16:5836:x1874160212018560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787338589.676195:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787338589.676208:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90bbf40e2e00/0x83671231080c1494 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x83671231080c148d expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338589.676228:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bbf40e2e00/0x83671231080c1494 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x83671231080c148d expref: 17 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338589.676259:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90bbf40e2e00/0x83671231080c1494 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c148d expref: 17 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338589.676268:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf40e2e00, rc 0) 00000100:00100000:2.0:1787338589.676304:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4010050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+17:5836:x1874160212018560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338589.676310:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1787338589.676368:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf41b4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212018560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787338589.676380:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.153@tcp lock: ffff90bc021c9800/0x83671231080c148d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c1494 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338589.676398:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.153@tcp lock: ffff90bc021c9800/0x83671231080c148d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x83671231080c1494 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338589.676438:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf41b4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212018688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787338589.676461:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338589.676620:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbd8aae900 going to sleep for 11 seconds 00000100:00100000:3.0:1787338589.676669:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212018688 00000100:00100000:3.0:1787338589.676673:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212018688 00000100:00100000:3.0:1787338589.676693:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1787338589.676700:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4010450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+17:5836:x1874160212018688:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787338589.677955:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4010450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+17:5836:x1874160212018688:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1251us (1489us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338589.677964:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1787338589.678057:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf41b4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212018688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787338589.678129:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc280000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212018816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787338589.678168:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338589.678202:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc7c26600 going to sleep for 11 seconds 00000100:00100000:0.0:1787338589.678215:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212018816 00000100:00100000:0.0:1787338589.678220:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212018816 00000100:00100000:0.0:1787338589.678245:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1787338589.678253:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4013450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+17:5836:x1874160212018816:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787338589.678411:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4013450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+17:5836:x1874160212018816:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 158us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338589.678417:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1787338589.678606:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc280000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212018816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787338589.679231:0:8528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc280e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d79243c8-b367-45ff-8d76-fbaa4be8becb:8528:1874160212018944:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787338589.679269:0:8528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338589.679300:0:8528:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc7c26600 going to sleep for 11 seconds 00000100:00100000:1.0:1787338589.679327:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212018944 00000100:00100000:1.0:1787338589.679332:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212018944 00000100:00100000:1.0:1787338589.679363:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1787338589.679370:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4013050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+17:8528:x1874160212018944:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787338589.679521:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4013050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+17:8528:x1874160212018944:12345-0@lo:502:llog_process_th.0 Request processed in 151us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338589.679528:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1787338589.679541:0:8528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc280e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d79243c8-b367-45ff-8d76-fbaa4be8becb:8528:1874160212018944:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787338589.679563:0:8528:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787338589.679573:0:8528:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787338589.679575:0:8528:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787338589.679581:0:8528:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1787338589.679601:0:8528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc280e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d79243c8-b367-45ff-8d76-fbaa4be8becb:8528:1874160212019072:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787338589.679637:0:8528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338589.679661:0:8528:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc7c26600 going to sleep for 11 seconds 00000100:00100000:3.0:1787338589.679781:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212019072 00000100:00100000:3.0:1787338589.679793:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212019072 00000100:00100000:3.0:1787338589.679832:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1787338589.679838:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4012850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+17:8528:x1874160212019072:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787338589.680124:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4012850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+17:8528:x1874160212019072:12345-0@lo:502:llog_process_th.0 Request processed in 285us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338589.680132:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1787338589.680187:0:8528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc280e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d79243c8-b367-45ff-8d76-fbaa4be8becb:8528:1874160212019072:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787338589.680206:0:8528:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787338589.680210:0:8528:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787338589.680212:0:8528:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787338589.680219:0:8528:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1787338589.680716:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:2.0:1787338589.680750:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.153@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787338589.680760:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bc021c9800/0x83671231080c148d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c1494 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338589.680770:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.153@tcp lock: ffff90bc021c9800/0x83671231080c148d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c1494 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787338589.680779:0:5836:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787338589.680781:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90bbd0622000 from 4 10000000:01000000:2.0:1787338589.680784:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787338589.680823:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbf40e3600/0x83671231080c149b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338589.680831:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.153@tcp lock: ffff90bbf40e3600/0x83671231080c149b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338589.680839:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.153@tcp lock: ffff90bbf40e3600/0x83671231080c149b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338589.680854:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc2d33480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212019200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787338589.681038:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338589.681099:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbf42ddcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787338589.681135:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212019200 00000100:00100000:1.0:1787338589.681141:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212019200 00000100:00100000:1.0:1787338589.681203:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1787338589.681211:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4013c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+17:5836:x1874160212019200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787338589.681220:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787338589.681231:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90bc021c8800/0x83671231080c14a2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x83671231080c149b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338589.681353:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bc021c8800/0x83671231080c14a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x83671231080c149b expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338589.681364:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90bc021c8800/0x83671231080c14a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c149b expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338589.681372:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bc021c8800, rc 0) 00000100:00100000:1.0:1787338589.681408:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4013c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+18:5836:x1874160212019200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 199us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338589.681414:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1787338589.681463:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc2d33480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212019200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787338589.681474:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.153@tcp lock: ffff90bbf40e3600/0x83671231080c149b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c14a2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338589.681482:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.153@tcp lock: ffff90bbf40e3600/0x83671231080c149b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x83671231080c14a2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338589.681523:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbedcb4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212019328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787338589.681544:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338589.681624:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbd1649300 going to sleep for 11 seconds 00000100:00100000:2.0:1787338589.681684:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212019328 00000100:00100000:2.0:1787338589.681688:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212019328 00000100:00100000:2.0:1787338589.681706:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1787338589.681712:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4011850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+18:5836:x1874160212019328:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787338589.681937:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4011850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+18:5836:x1874160212019328:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 225us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338589.681943:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1787338589.682109:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbedcb4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212019328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787338589.682136:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbedcb4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212019456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787338589.682172:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338589.682224:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbd1649300 going to sleep for 11 seconds 00000100:00100000:2.0:1787338589.682312:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212019456 00000100:00100000:2.0:1787338589.682316:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212019456 00000100:00100000:2.0:1787338589.682653:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1787338589.682660:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4013850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+18:5836:x1874160212019456:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787338589.682795:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4013850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+18:5836:x1874160212019456:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 136us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338589.682800:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1787338589.682867:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbedcb4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212019456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787338589.683414:0:8529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbedcb4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d79243c8-b367-45ff-8d76-fbaa4be8becb:8529:1874160212019584:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787338589.683451:0:8529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338589.683474:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212019584 00000100:00100000:3.0:1787338589.683477:0:8529:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbd1649000 going to sleep for 11 seconds 00000100:00100000:0.0:1787338589.683480:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212019584 00000100:00100000:0.0:1787338589.683511:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1787338589.683518:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4010c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+18:8529:x1874160212019584:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787338589.683667:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4010c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+18:8529:x1874160212019584:12345-0@lo:502:llog_process_th.0 Request processed in 149us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338589.683674:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1787338589.683931:0:8529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbedcb4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d79243c8-b367-45ff-8d76-fbaa4be8becb:8529:1874160212019584:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787338589.683959:0:8529:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787338589.683969:0:8529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787338589.683971:0:8529:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787338589.683977:0:8529:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90bbd0622000 00000020:00000080:3.0:1787338589.683979:0:8529:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787338589.684094:0:8529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbedcb4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d79243c8-b367-45ff-8d76-fbaa4be8becb:8529:1874160212019712:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787338589.684129:0:8529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338589.684183:0:8529:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbd1649000 going to sleep for 11 seconds 00000100:00100000:2.0:1787338589.684213:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212019712 00000100:00100000:2.0:1787338589.684218:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212019712 00000100:00100000:2.0:1787338589.684342:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1787338589.684351:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4011c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+18:8529:x1874160212019712:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787338589.684494:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4011c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+18:8529:x1874160212019712:12345-0@lo:502:llog_process_th.0 Request processed in 144us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338589.684500:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1787338589.684568:0:8529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbedcb4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d79243c8-b367-45ff-8d76-fbaa4be8becb:8529:1874160212019712:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787338589.684589:0:8529:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787338589.684593:0:8529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787338589.684595:0:8529:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1787338589.684602:0:8529:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1787338589.685728:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1787338589.685758:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787338589.685769:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbf40e3600/0x83671231080c149b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c14a2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338589.685781:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.153@tcp lock: ffff90bbf40e3600/0x83671231080c149b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c14a2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787338589.685791:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1787338589.685794:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff90bbde3e99b8 from 1 10000000:01000000:0.0:1787338589.685797:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787338589.685845:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbc0030c00/0x83671231080c14a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338589.685855:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.153@tcp lock: ffff90bbc0030c00/0x83671231080c14a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338589.685866:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.153@tcp lock: ffff90bbc0030c00/0x83671231080c14a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338589.685910:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc281500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212019840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787338589.685966:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338589.686004:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc7c260c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787338589.686019:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212019840 00000100:00100000:1.0:1787338589.686025:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212019840 00000100:00100000:1.0:1787338589.686062:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1787338589.686071:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4011450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+18:5836:x1874160212019840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787338589.686080:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787338589.686093:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90bc021c9a00/0x83671231080c14b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x83671231080c14a9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338589.686113:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bc021c9a00/0x83671231080c14b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x83671231080c14a9 expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338589.686123:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90bc021c9a00/0x83671231080c14b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c14a9 expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338589.686139:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bc021c9a00, rc 0) 00000100:00100000:1.0:1787338589.686185:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4011450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+19:5836:x1874160212019840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338589.686190:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1787338589.686270:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc281500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212019840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787338589.686281:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.153@tcp lock: ffff90bbc0030c00/0x83671231080c14a9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c14b0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338589.686287:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.153@tcp lock: ffff90bbc0030c00/0x83671231080c14a9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x83671231080c14b0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338589.686325:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc281500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212019968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787338589.686342:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338589.686360:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc7c260c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787338589.686436:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212019968 00000100:00100000:1.0:1787338589.686439:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212019968 00000100:00100000:1.0:1787338589.686460:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1787338589.686471:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc414f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+19:5836:x1874160212019968:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787338589.686671:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc414f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+19:5836:x1874160212019968:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 200us (326us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787338589.686678:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1787338589.686688:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc281500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212019968:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1787338589.686708:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.153@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787338589.686713:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbc0030c00/0x83671231080c14a9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c14b0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338589.686720:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.153@tcp lock: ffff90bbc0030c00/0x83671231080c14a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c14b0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338589.878086:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338590.904127:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787338591.300870:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338591.300983:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192067328 00000100:00100000:3.0:1787338591.300994:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192067328 00000100:00100000:3.0:1787338591.301048:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 187 00000100:00100000:3.0:1787338591.301058:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc414e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+9:5598:x1874160192067328:12345-192.168.201.53@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787338591.301075:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787338591.301092:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90bbf7ea4800/0x83671231080c14b7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab5e1 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338591.301119:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bbf7ea4800/0x83671231080c14b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab5e1 expref: 10 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338591.301129:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90bbf7ea4800/0x83671231080c14b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab5e1 expref: 10 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338591.301138:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf7ea4800, rc 0) 00000100:00100000:3.0:1787338591.301215:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc414e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+10:5598:x1874160192067328:12345-192.168.201.53@tcp:101:ll_cfg_requeue.0 Request processed in 158us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338591.301223:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 187 00000100:00100000:0.0:1787338591.313983:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338591.314102:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192067456 00000100:00100000:1.0:1787338591.314113:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192067456 00000100:00100000:1.0:1787338591.314163:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 188 00000100:00100000:1.0:1787338591.314174:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc414fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+10:5598:x1874160192067456:12345-192.168.201.53@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787338591.314478:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc414fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+10:5598:x1874160192067456:12345-192.168.201.53@tcp:501:ll_cfg_requeue.0 Request processed in 305us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338591.314487:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 188 00000100:00100000:1.0:1787338591.317730:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338591.317901:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192067584 00000100:00100000:0.0:1787338591.317910:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192067584 00000100:00100000:0.0:1787338591.317954:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 189 00000100:00100000:0.0:1787338591.317963:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc414d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+10:5598:x1874160192067584:12345-192.168.201.53@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787338591.318149:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc414d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+10:5598:x1874160192067584:12345-192.168.201.53@tcp:503:ll_cfg_requeue.0 Request processed in 186us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338591.318163:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 189 00000100:00100000:3.0:1787338591.332927:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338591.333048:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192067712 00000100:00100000:1.0:1787338591.333058:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192067712 00000100:00100000:1.0:1787338591.333109:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 190 00000100:00100000:1.0:1787338591.333118:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc414f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+10:6127:x1874160192067712:12345-192.168.201.53@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787338591.333384:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc414f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+10:6127:x1874160192067712:12345-192.168.201.53@tcp:502:llog_process_th.0 Request processed in 265us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338591.333393:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 190 00000100:00100000:3.0:1787338591.338927:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338591.339048:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192067840 00000100:00100000:1.0:1787338591.339058:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192067840 00000100:00100000:1.0:1787338591.339105:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 191 00000100:00100000:1.0:1787338591.339115:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc414cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+10:6127:x1874160192067840:12345-192.168.201.53@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787338591.339390:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc414cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+10:6127:x1874160192067840:12345-192.168.201.53@tcp:502:llog_process_th.0 Request processed in 275us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338591.339399:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 191 00000100:00100000:1.0:1787338591.350377:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787338591.350400:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf41b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874160212020096:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787338591.350466:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338591.350546:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212020096 00000100:00100000:1.0:1787338591.350553:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212020096 00000100:00100000:1.0:1787338591.350604:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787338591.350613:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf41b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874160212020096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787338591.350645:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787338591.350689:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf41b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874160212020096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338591.350697:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1787338591.350717:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787338591.350744:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbf41b6d80 x1874160212020096/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787338607 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787338591.350761:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf41b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874160212020096:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787338591.863213:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787338591.863235:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbedcb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1874160212020480:0@lo:400:kworker.0 00000100:00100000:3.0:1787338591.863310:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338591.863490:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbedcb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d79243c8-b367-45ff-8d76-fbaa4be8becb:3316:1874160212020224:0@lo:400:kworker.0 00000100:00100000:2.0:1787338591.863525:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338591.863551:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787338591.863570:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbedcb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874160212020352:0@lo:400:kworker.0 00000100:00100000:2.0:1787338591.863596:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338591.863628:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212020224 00000100:00100000:2.0:1787338591.863635:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212020224 00000100:00100000:2.0:1787338591.863690:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1787338591.863701:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbde804050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+19:3316:x1874160212020224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787338591.863752:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbde804050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+19:3316:x1874160212020224:12345-0@lo:400:kworker.0 Request processed in 53us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338591.863760:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1787338591.863803:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212020480 00000100:00100000:2.0:1787338591.863807:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212020480 00000100:00100000:2.0:1787338591.863838:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212020352 00000100:00100000:2.0:1787338591.863841:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212020352 00000100:00100000:2.0:1787338591.863862:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787338591.863868:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbedcb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874160212020480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787338591.863928:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbedcb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874160212020480:12345-0@lo:400:kworker.0 Request processed in 60us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338591.863935:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787338591.863948:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787338591.863954:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc2d31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874160212020352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787338591.863980:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc2d31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874160212020352:12345-0@lo:400:kworker.0 Request processed in 27us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338591.863986:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787338591.864020:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbedcb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874160212020352:0@lo:400:kworker.0 00000100:00100000:2.0:1787338591.864030:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbedcb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d79243c8-b367-45ff-8d76-fbaa4be8becb:3316:1874160212020224:0@lo:400:kworker.0 00000100:00080000:1.0:1787338591.864282:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787338591.864389:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbedcb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1874160212020480:0@lo:400:kworker.0 00000100:00100000:1.0:1787338591.864555:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787338591.864564:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbedcb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1874160212020608:0@lo:400:kworker.0 00000100:00100000:1.0:1787338591.864595:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338591.864675:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787338591.864686:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbedcb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874160212020736:0@lo:400:kworker.0 00000100:00100000:0.0:1787338591.864717:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338591.864796:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212020736 00000100:00100000:1.0:1787338591.864803:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212020736 00000100:00100000:1.0:1787338591.864847:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787338591.864855:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc281500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1874160212020736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787338591.864921:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc281500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1874160212020736:12345-0@lo:400:kworker.0 Request processed in 66us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338591.864928:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1787338591.864967:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbedcb4e00 x1874160212020736/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787338607 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787338591.864979:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbedcb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874160212020736:0@lo:400:kworker.0 00000100:00080000:0.0:1787338591.865030:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787338591.865355:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212020608 00000100:00100000:3.0:1787338591.865360:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212020608 00000100:00100000:3.0:1787338591.865414:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787338591.865421:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf41b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874160212020608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787338591.865468:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf41b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874160212020608:12345-0@lo:400:kworker.0 Request processed in 48us (872us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338591.865474:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787338591.865587:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbedcb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1874160212020608:0@lo:400:kworker.0 00000100:00080000:0.0:1787338591.865625:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787338591.927493:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787338592.374830:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc282300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874160212020864:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787338592.374933:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338592.375412:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212020864 00000100:00100000:3.0:1787338592.375421:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212020864 00000100:00100000:3.0:1787338592.375480:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787338592.375490:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf41b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874160212020864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787338592.375526:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787338592.375586:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf41b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874160212020864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (653us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338592.375593:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1787338592.375779:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbfc282300 x1874160212020864/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787338608 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787338592.375798:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc282300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874160212020864:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787338592.951446:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338593.974680:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787338594.135020:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338594.135074:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338594.135107:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338594.135134:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338594.135164:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192068224 00000100:00100000:2.0:1787338594.135173:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192068224 00000100:00100000:2.0:1787338594.135235:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192068352 00000100:00100000:2.0:1787338594.135239:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192068352 00000100:00100000:2.0:1787338594.135262:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 15 00000100:00100000:2.0:1787338594.135273:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc2d32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:83642291-0761-4205-9531-7fd25bc2d48e+5:2358:x1874160192068224:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:2.0:1787338594.135371:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc2d32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:83642291-0761-4205-9531-7fd25bc2d48e+5:2358:x1874160192068224:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 99us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338594.135379:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 15 00000100:00100000:2.0:1787338594.135399:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 16 00000100:00100000:2.0:1787338594.135406:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc2d33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:83642291-0761-4205-9531-7fd25bc2d48e+5:2358:x1874160192068352:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:2.0:1787338594.135436:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc2d33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:83642291-0761-4205-9531-7fd25bc2d48e+5:2358:x1874160192068352:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 31us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338594.135442:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 16 00000100:00100000:2.0:1787338594.135462:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192068096 00000100:00100000:2.0:1787338594.135465:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192068096 00000100:00100000:2.0:1787338594.135500:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 33 00000100:00100000:2.0:1787338594.135507:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc2d30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+6:2358:x1874160192068096:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:2.0:1787338594.135548:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc2d30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+6:2358:x1874160192068096:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 41us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338594.135555:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 33 00000100:00080000:2.0:1787338594.135576:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787338594.135589:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787338594.135591:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787338594.137463:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192067968 00000100:00100000:3.0:1787338594.137476:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192067968 00000100:00100000:3.0:1787338594.137536:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 193 00000100:00100000:3.0:1787338594.137546:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbde804450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+10:2358:x1874160192067968:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:3.0:1787338594.137608:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbde804450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+10:2358:x1874160192067968:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 65us (2600us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338594.137624:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 193 00010000:00010000:0.0:1787338594.998011:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338596.029482:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787338596.302982:0:8812:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg153-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:1.0:1787338596.472251:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc2d32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874160212020992:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787338596.472337:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338596.472503:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212020992 00000100:00100000:0.0:1787338596.472513:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212020992 00000100:00100000:0.0:1787338596.472586:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787338596.472596:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf41b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874160212020992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787338596.472630:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1787338596.472815:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787338596.474450:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf41b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874160212020992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1849us (2106us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338596.474463:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1787338596.477952:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbc2d32300 x1874160212020992/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787338612 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787338596.477984:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc2d32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874160212020992:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787338596.982724:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf41b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1874160212021504:0@lo:400:kworker.0 00000100:00100000:1.0:1787338596.982810:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338596.982903:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787338596.982910:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf41b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d79243c8-b367-45ff-8d76-fbaa4be8becb:3314:1874160212021120:0@lo:400:kworker.0 00000100:00100000:1.0:1787338596.982939:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338596.982960:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf41b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874160212021632:0@lo:400:kworker.0 00000100:00100000:1.0:1787338596.982986:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338596.983014:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf41b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874160212021248:0@lo:400:kworker.0 00000100:00100000:1.0:1787338596.983053:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338596.983368:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212021504 00000100:00100000:3.0:1787338596.983379:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212021504 00000100:00100000:3.0:1787338596.983439:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212021248 00000100:00100000:3.0:1787338596.983443:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212021248 00000100:00100000:3.0:1787338596.983467:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787338596.983478:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf41b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874160212021504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787338596.983544:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf41b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874160212021504:12345-0@lo:400:kworker.0 Request processed in 68us (733us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338596.983552:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787338596.983569:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787338596.983576:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf3e9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874160212021248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787338596.983606:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf3e9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874160212021248:12345-0@lo:400:kworker.0 Request processed in 30us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338596.983612:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:3.0:1787338596.983629:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787338596.983671:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf41b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1874160212021504:0@lo:400:kworker.0 00000100:00100000:1.0:1787338596.984512:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf41b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874160212021248:0@lo:400:kworker.0 00000100:00100000:1.0:1787338596.984535:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787338596.984543:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf41b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874160212021376:0@lo:400:kworker.0 00000100:00100000:1.0:1787338596.984585:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338596.984630:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212021120 00000100:00100000:1.0:1787338596.984635:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212021120 00000100:00100000:1.0:1787338596.984689:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1787338596.984698:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbde807450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+19:3314:x1874160212021120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787338596.984744:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbde807450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+19:3314:x1874160212021120:12345-0@lo:400:kworker.0 Request processed in 47us (1802us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338596.984750:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1787338596.984782:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212021632 00000100:00100000:1.0:1787338596.984785:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212021632 00000100:00100000:1.0:1787338596.984822:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787338596.984828:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf41b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874160212021632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787338596.984859:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf41b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874160212021632:12345-0@lo:400:kworker.0 Request processed in 32us (1873us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338596.984901:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787338596.984925:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212021376 00000100:00100000:1.0:1787338596.984928:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212021376 00000100:00100000:1.0:1787338596.984952:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787338596.984958:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf3e9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874160212021376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787338596.984993:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf3e9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874160212021376:12345-0@lo:400:kworker.0 Request processed in 35us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338596.984999:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787338596.985025:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf41b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874160212021376:0@lo:400:kworker.0 00000100:00080000:3.0:1787338596.985133:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787338596.985137:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787338596.985158:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf41b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d79243c8-b367-45ff-8d76-fbaa4be8becb:3314:1874160212021120:0@lo:400:kworker.0 00010000:00080000:3.0:1787338596.985173:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbf41b7800 x1874160212021632/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787338612 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787338596.985185:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf41b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874160212021632:0@lo:400:kworker.0 00010000:00010000:0.0:1787338597.046007:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787338597.505481:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc282300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874160212021760:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787338597.505570:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338597.505739:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212021760 00000100:00100000:0.0:1787338597.505748:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212021760 00000100:00100000:0.0:1787338597.505806:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787338597.505817:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbedcb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874160212021760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787338597.505857:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787338597.505931:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbedcb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874160212021760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338597.505947:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1787338597.506028:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbfc282300 x1874160212021760/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787338613 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787338597.506045:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc282300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874160212021760:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787338598.072733:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787338599.094322:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787338599.244447:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338599.244496:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338599.244522:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338599.244547:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338599.244576:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192068736 00000100:00100000:2.0:1787338599.244586:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192068736 00000100:00100000:2.0:1787338599.244659:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192068864 00000100:00100000:2.0:1787338599.244663:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192068864 00000100:00100000:2.0:1787338599.244684:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 18 00000100:00100000:2.0:1787338599.244695:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc2d32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:83642291-0761-4205-9531-7fd25bc2d48e+5:2357:x1874160192068736:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:2.0:1787338599.244767:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc2d32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:83642291-0761-4205-9531-7fd25bc2d48e+5:2357:x1874160192068736:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 73us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338599.244774:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 18 00000100:00100000:2.0:1787338599.244791:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 19 00000100:00100000:2.0:1787338599.244799:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc2d30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:83642291-0761-4205-9531-7fd25bc2d48e+5:2357:x1874160192068864:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:2.0:1787338599.244824:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc2d30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:83642291-0761-4205-9531-7fd25bc2d48e+5:2357:x1874160192068864:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 27us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338599.244830:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 19 00000100:00100000:0.0:1787338599.245893:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192068480 00000100:00100000:0.0:1787338599.245903:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192068480 00000100:00100000:0.0:1787338599.245950:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 195 00000100:00100000:0.0:1787338599.245959:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbde807050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+10:2357:x1874160192068480:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:0.0:1787338599.246004:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbde807050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+10:2357:x1874160192068480:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 47us (1567us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338599.246011:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 195 00000100:00100000:0.0:1787338599.249842:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192068608 00000100:00100000:0.0:1787338599.249859:0:7647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192068608 00000100:00100000:0.0:1787338599.249974:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 37 00000100:00100000:0.0:1787338599.249986:0:7647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc2d31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+6:2357:x1874160192068608:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:0.0:1787338599.250074:0:7647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc2d31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+6:2357:x1874160192068608:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 90us (5549us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338599.250082:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 37 00000100:00080000:2.0:1787338599.251310:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787338599.251325:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787338599.251328:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787338600.124051:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787338601.141968:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787338601.597619:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbedcb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874160212021888:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787338601.597704:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338601.598127:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212021888 00000100:00100000:0.0:1787338601.598136:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212021888 00000100:00100000:0.0:1787338601.598302:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787338601.598313:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc282a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874160212021888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787338601.598365:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787338601.598609:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc282a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874160212021888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 287us (894us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338601.598630:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1787338601.598674:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbedcb5c00 x1874160212021888/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787338617 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787338601.598696:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbedcb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874160212021888:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787338601.598909:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787338602.105127:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbedcb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d79243c8-b367-45ff-8d76-fbaa4be8becb:3314:1874160212022016:0@lo:400:kworker.0 00000100:00100000:3.0:1787338602.105209:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338602.105253:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbedcb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874160212022528:0@lo:400:kworker.0 00000100:00100000:3.0:1787338602.105281:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338602.105312:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787338602.105318:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbedcb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874160212022144:0@lo:400:kworker.0 00000100:00100000:3.0:1787338602.105360:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338602.105394:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbedcb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874160212022272:0@lo:400:kworker.0 00000100:00100000:3.0:1787338602.105420:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338602.105439:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787338602.105445:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbedcb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1874160212022400:0@lo:400:kworker.0 00000100:00100000:3.0:1787338602.105467:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338602.105502:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212022528 00000100:00100000:3.0:1787338602.105509:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212022528 00000100:00100000:3.0:1787338602.105650:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787338602.105660:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbedcb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874160212022528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787338602.105714:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbedcb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874160212022528:12345-0@lo:400:kworker.0 Request processed in 55us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338602.105721:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787338602.105762:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212022144 00000100:00100000:3.0:1787338602.105767:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212022144 00000100:00100000:3.0:1787338602.105790:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212022272 00000100:00100000:3.0:1787338602.105793:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212022272 00000100:00100000:3.0:1787338602.105806:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212022400 00000100:00100000:3.0:1787338602.105808:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212022400 00000100:00100000:3.0:1787338602.105824:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787338602.105831:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbedcb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874160212022144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787338602.105862:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbedcb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874160212022144:12345-0@lo:400:kworker.0 Request processed in 32us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338602.105868:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787338602.105902:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787338602.105908:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf41b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874160212022272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787338602.105940:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf41b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874160212022272:12345-0@lo:400:kworker.0 Request processed in 33us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338602.105946:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787338602.105956:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787338602.105962:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf41b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874160212022400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787338602.105987:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf41b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874160212022400:12345-0@lo:400:kworker.0 Request processed in 25us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338602.105992:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:3.0:1787338602.106015:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787338602.106018:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787338602.106062:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbedcb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1874160212022400:0@lo:400:kworker.0 00000100:00100000:3.0:1787338602.106072:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbedcb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874160212022272:0@lo:400:kworker.0 00000100:00100000:3.0:1787338602.106102:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbedcb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874160212022144:0@lo:400:kworker.0 00010000:00080000:3.0:1787338602.106126:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbedcb6300 x1874160212022528/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787338618 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787338602.106136:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbedcb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874160212022528:0@lo:400:kworker.0 00000100:00100000:0.0:1787338602.106782:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212022016 00000100:00100000:0.0:1787338602.106791:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212022016 00000100:00100000:0.0:1787338602.106829:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1787338602.106837:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbde806850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+19:3314:x1874160212022016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787338602.106918:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbde806850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+19:3314:x1874160212022016:12345-0@lo:400:kworker.0 Request processed in 81us (1708us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338602.106924:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1787338602.106967:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbedcb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d79243c8-b367-45ff-8d76-fbaa4be8becb:3314:1874160212022016:0@lo:400:kworker.0 00010000:00010000:1.0:1787338602.173300:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787338602.618671:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787338602.618694:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc282680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874160212022656:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787338602.618769:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338602.618842:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212022656 00000100:00100000:0.0:1787338602.618849:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212022656 00000100:00100000:0.0:1787338602.618942:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787338602.618951:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc282300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874160212022656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787338602.618986:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787338602.619031:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc282300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874160212022656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338602.619039:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:0.0:1787338602.619080:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbfc282680 x1874160212022656/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787338618 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787338602.619113:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc282680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874160212022656:0@lo:13:osp-pre-1-0.0 00000001:02000400:1.0:1787338602.642025:0:9056:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg153-server.virtnet: executing yml_node 00010000:00010000:1.0:1787338603.195981:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338604.214664:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787338604.368240:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338604.368296:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338604.368390:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192069120 00000100:00100000:0.0:1787338604.368402:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192069120 00000100:00100000:0.0:1787338604.368480:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 41 00000100:00100000:0.0:1787338604.368490:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf41b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+6:2356:x1874160192069120:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:0.0:1787338604.368573:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf41b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+6:2356:x1874160192069120:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 85us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338604.368581:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 41 00000100:00100000:0.0:1787338604.368606:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192068992 00000100:00100000:0.0:1787338604.368609:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192068992 00000100:00100000:0.0:1787338604.368632:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 197 00000100:00100000:0.0:1787338604.368638:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbde807c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+10:2356:x1874160192068992:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:0.0:1787338604.368664:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbde807c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+10:2356:x1874160192068992:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 26us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338604.368670:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 197 00000100:00080000:3.0:1787338604.368925:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787338604.370622:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338604.370663:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338604.370692:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192069248 00000100:00100000:0.0:1787338604.370700:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192069248 00000100:00100000:0.0:1787338604.370761:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192069376 00000100:00100000:0.0:1787338604.370764:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192069376 00000100:00100000:0.0:1787338604.370779:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 10 00000100:00100000:0.0:1787338604.370789:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc282680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:83642291-0761-4205-9531-7fd25bc2d48e+5:2355:x1874160192069248:12345-192.168.201.53@tcp:9:kworker.0 00000020:00000080:0.0:1787338604.370826:0:6689:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x83671231080c13f3 00000100:00080000:0.0:1787338604.370838:0:6689:0:(import.c:65:import_set_state_nolock()) ffff90bac1f1d000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787338604.370923:0:6689:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1787338604.371252:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc282680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:83642291-0761-4205-9531-7fd25bc2d48e+2:2355:x1874160192069248:12345-192.168.201.53@tcp:9:kworker.0 Request processed in 464us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338604.371260:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 10 00000100:00100000:0.0:1787338604.371275:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 11 00000100:00100000:0.0:1787338604.371282:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc280e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:83642291-0761-4205-9531-7fd25bc2d48e+5:2355:x1874160192069376:12345-192.168.201.53@tcp:9:kworker.0 00000020:00000080:0.0:1787338604.371295:0:6689:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x83671231080c13fa 00000100:00080000:0.0:1787338604.371301:0:6689:0:(import.c:65:import_set_state_nolock()) ffff90bac1f1f800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787338604.371321:0:6689:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1787338604.372263:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc280e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:83642291-0761-4205-9531-7fd25bc2d48e+2:2355:x1874160192069376:12345-192.168.201.53@tcp:9:kworker.0 Request processed in 976us (1593us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338604.372273:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 11 00010000:00010000:0.0:1787338604.372856:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787338604.372864:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787338604.372912:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787338604.372917:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787338605.238930:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787338606.262960:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787338606.714147:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf41b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874160212022784:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787338606.714229:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338606.715014:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212022784 00000100:00100000:2.0:1787338606.715023:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212022784 00000100:00100000:2.0:1787338606.715083:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787338606.715101:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf3e9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874160212022784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787338606.715136:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1787338606.715256:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787338606.717569:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf3e9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874160212022784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2460us (3329us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338606.717583:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1787338606.717770:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbf41b5880 x1874160212022784/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787338622 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787338606.717793:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf41b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874160212022784:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787338607.222167:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf3e9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874160212023040:0@lo:400:kworker.0 00000100:00100000:1.0:1787338607.222234:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338607.222324:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787338607.222330:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf3e9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1874160212023168:0@lo:400:kworker.0 00000100:00100000:1.0:1787338607.222353:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338607.222407:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf3e9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874160212023552:0@lo:400:kworker.0 00000100:00100000:1.0:1787338607.222448:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338607.222528:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf3e9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d79243c8-b367-45ff-8d76-fbaa4be8becb:3317:1874160212022912:0@lo:400:kworker.0 00000100:00100000:3.0:1787338607.222561:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338607.222594:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf3e9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1874160212023424:0@lo:400:kworker.0 00000100:00100000:3.0:1787338607.222616:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338607.222636:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787338607.222641:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf3e9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874160212023296:0@lo:400:kworker.0 00000100:00100000:3.0:1787338607.222662:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338607.222695:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212023040 00000100:00100000:3.0:1787338607.222702:0:7647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212023040 00000100:00100000:3.0:1787338607.222749:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212023168 00000100:00100000:3.0:1787338607.222752:0:7647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212023168 00000100:00100000:3.0:1787338607.222774:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212023424 00000100:00100000:3.0:1787338607.222777:0:7647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212023424 00000100:00100000:3.0:1787338607.222792:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787338607.222801:0:7647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf3e9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874160212023040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787338607.222902:0:7647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf3e9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874160212023040:12345-0@lo:400:kworker.0 Request processed in 70us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338607.222911:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787338607.222930:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787338607.222944:0:7647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf3e9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874160212023168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787338607.222972:0:7647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf3e9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874160212023168:12345-0@lo:400:kworker.0 Request processed in 30us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338607.222979:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787338607.222991:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787338607.222997:0:7647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf41b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1874160212023424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787338607.223027:0:7647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf41b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1874160212023424:12345-0@lo:400:kworker.0 Request processed in 31us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338607.223034:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787338607.223054:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212023552 00000100:00100000:3.0:1787338607.223057:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212023552 00000100:00100000:3.0:1787338607.223083:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212023296 00000100:00100000:3.0:1787338607.223086:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212023296 00000100:00100000:3.0:1787338607.223098:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787338607.223105:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf3e9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1874160212023552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787338607.223135:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf3e9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1874160212023552:12345-0@lo:400:kworker.0 Request processed in 31us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338607.223141:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787338607.223152:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787338607.223158:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf41b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1874160212023296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787338607.223203:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf41b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1874160212023296:12345-0@lo:400:kworker.0 Request processed in 45us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338607.223209:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:3.0:1787338607.223236:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787338607.223240:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787338607.223262:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbf3e9ea00 x1874160212023552/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787338623 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787338607.223286:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf3e9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874160212023552:0@lo:400:kworker.0 00000100:00100000:3.0:1787338607.223300:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf3e9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1874160212023168:0@lo:400:kworker.0 00000100:00100000:3.0:1787338607.223307:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf3e9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874160212023040:0@lo:400:kworker.0 00010000:00080000:3.0:1787338607.223339:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbf3e9f100 x1874160212023296/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787338623 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787338607.223348:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf3e9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874160212023296:0@lo:400:kworker.0 00000100:00100000:3.0:1787338607.223357:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf3e9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1874160212023424:0@lo:400:kworker.0 00000100:00100000:1.0:1787338607.223823:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212022912 00000100:00100000:1.0:1787338607.223829:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212022912 00000100:00100000:1.0:1787338607.223868:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1787338607.223901:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbde805850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+19:3317:x1874160212022912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787338607.223941:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbde805850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+19:3317:x1874160212022912:12345-0@lo:400:kworker.0 Request processed in 67us (1379us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338607.223948:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1787338607.226132:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf3e9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d79243c8-b367-45ff-8d76-fbaa4be8becb:3317:1874160212022912:0@lo:400:kworker.0 00010000:00010000:0.0:1787338607.292131:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787338607.447276:0:9247:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.44 00000100:00100000:1.0:1787338607.736905:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787338607.736929:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc280000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874160212023680:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787338607.736997:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338607.737261:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212023680 00000100:00100000:0.0:1787338607.737274:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212023680 00000100:00100000:1.0:1787338607.737412:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787338607.737424:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf3e9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874160212023680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787338607.737459:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787338607.737529:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf3e9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874160212023680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338607.737535:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:0.0:1787338607.737615:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbfc280000 x1874160212023680/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787338623 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787338607.737636:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc280000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874160212023680:0@lo:13:osp-pre-1-0.0 00000001:00100000:3.0:1787338608.309602:0:7651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 83642291-0761-4205-9531-7fd25bc2d48e 00000020:00000080:3.0:1787338608.309613:0:7651:0:(genops.c:885:class_export_put()) final put ffff90bac1f1c000/83642291-0761-4205-9531-7fd25bc2d48e 00000020:00000080:3.0:1787338608.309646:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90bac1f1c000/83642291-0761-4205-9531-7fd25bc2d48e for lustre-OST0001 00000020:00000080:3.0:1787338608.309711:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90bac1f1f800 for lustre-OST0001 00010000:00010000:3.0:1787338608.314131:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787338608.330755:0:6714:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 83642291-0761-4205-9531-7fd25bc2d48e 00000020:00000080:0.0:1787338608.330765:0:6714:0:(genops.c:885:class_export_put()) final put ffff90bac1f1f000/83642291-0761-4205-9531-7fd25bc2d48e 00000020:00000080:1.0:1787338608.330848:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff90bac1f1f000/83642291-0761-4205-9531-7fd25bc2d48e for lustre-OST0000 00000020:00000080:1.0:1787338608.331268:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90bac1f1d000 for lustre-OST0000 00010000:00010000:1.0:1787338609.339546:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787338609.480990:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338609.481059:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338609.481294:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192069632 00000100:00100000:3.0:1787338609.481305:0:7647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192069632 00000100:00100000:3.0:1787338609.481371:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 45 00000100:00100000:3.0:1787338609.481384:0:7647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc280000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+6:2357:x1874160192069632:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:3.0:1787338609.481478:0:7647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc280000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+6:2357:x1874160192069632:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 95us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338609.481486:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 45 00000100:00080000:3.0:1787338609.481509:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787338609.481608:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192069504 00000100:00100000:2.0:1787338609.481613:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192069504 00000100:00100000:2.0:1787338609.481652:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 199 00000100:00100000:2.0:1787338609.481659:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbde807850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+10:2357:x1874160192069504:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:2.0:1787338609.481690:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbde807850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+10:2357:x1874160192069504:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 32us (713us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338609.481697:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 199 00000001:02000400:1.0:1787338610.163099:0:9347:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.44 00010000:00010000:2.0:1787338610.372188:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787338611.382074:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787338611.832722:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787338611.832753:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbedcb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874160212023808:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787338611.832864:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338611.833146:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212023808 00000100:00100000:1.0:1787338611.833154:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212023808 00000100:00100000:1.0:1787338611.833235:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787338611.833250:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc281c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874160212023808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787338611.833301:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787338611.833378:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc281c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874160212023808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 134us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338611.833400:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:1.0:1787338611.833456:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbedcb5c00 x1874160212023808/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787338627 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787338611.833477:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbedcb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874160212023808:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787338611.833562:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787338612.349044:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbedcb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1874160212024192:0@lo:400:kworker.0 00000100:00100000:3.0:1787338612.349129:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338612.349288:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbedcb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874160212024320:0@lo:400:kworker.0 00000100:00100000:2.0:1787338612.349323:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338612.349430:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787338612.349437:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbedcb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874160212024064:0@lo:400:kworker.0 00000100:00100000:3.0:1787338612.349460:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338612.349477:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf46fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874160212024576:0@lo:400:kworker.0 00000100:00100000:3.0:1787338612.349495:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338612.349557:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbedcb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d79243c8-b367-45ff-8d76-fbaa4be8becb:3317:1874160212023936:0@lo:400:kworker.0 00000100:00100000:0.0:1787338612.349593:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338612.353367:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212024192 00000100:00100000:2.0:1787338612.354105:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212024192 00000100:00100000:2.0:1787338612.354219:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212024064 00000100:00100000:2.0:1787338612.354224:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212024064 00000100:00100000:2.0:1787338612.354253:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787338612.354265:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf46f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874160212024192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787338612.354370:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf46f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874160212024192:12345-0@lo:400:kworker.0 Request processed in 107us (5240us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338612.354378:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787338612.356289:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787338612.356309:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf46f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874160212024064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787338612.356525:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf46f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874160212024064:12345-0@lo:400:kworker.0 Request processed in 224us (7062us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338612.356534:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787338612.356621:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212024320 00000100:00100000:2.0:1787338612.356629:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212024320 00000100:00100000:2.0:1787338612.356672:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212024576 00000100:00100000:2.0:1787338612.356676:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212024576 00000100:00100000:2.0:1787338612.356698:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787338612.356704:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc2d30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1874160212024320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787338612.356742:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc2d30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1874160212024320:12345-0@lo:400:kworker.0 Request processed in 38us (7418us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338612.356748:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787338612.356759:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787338612.356765:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf46f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1874160212024576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787338612.356794:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf46f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1874160212024576:12345-0@lo:400:kworker.0 Request processed in 29us (7298us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338612.356800:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:3.0:1787338612.360969:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787338612.360982:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787338612.361147:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbf46fb800 x1874160212024576/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787338628 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787338612.361165:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf46fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874160212024576:0@lo:400:kworker.0 00000100:00100000:3.0:1787338612.361193:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbedcb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1874160212024192:0@lo:400:kworker.0 00000100:00100000:3.0:1787338612.361227:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbedcb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874160212024064:0@lo:400:kworker.0 00010000:00080000:3.0:1787338612.373605:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbedcb7100 x1874160212024320/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787338628 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787338612.373627:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbedcb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874160212024320:0@lo:400:kworker.0 00000100:00100000:0.0:1787338612.378352:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbedcb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1874160212024448:0@lo:400:kworker.0 00000100:00100000:0.0:1787338612.378447:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338612.378513:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212023936 00000100:00100000:0.0:1787338612.378522:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212023936 00000100:00100000:0.0:1787338612.378587:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1787338612.378597:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbde804c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+19:3317:x1874160212023936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787338612.378652:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbde804c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+19:3317:x1874160212023936:12345-0@lo:400:kworker.0 Request processed in 57us (29058us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338612.378659:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1787338612.378715:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbedcb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d79243c8-b367-45ff-8d76-fbaa4be8becb:3317:1874160212023936:0@lo:400:kworker.0 00000100:00100000:2.0:1787338612.378819:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212024448 00000100:00100000:2.0:1787338612.378823:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212024448 00000100:00100000:2.0:1787338612.378892:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787338612.378900:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc281f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1874160212024448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787338612.378940:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc281f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1874160212024448:12345-0@lo:400:kworker.0 Request processed in 41us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338612.378946:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:0.0:1787338612.381816:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787338612.381953:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbedcb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1874160212024448:0@lo:400:kworker.0 00010000:00010000:2.0:1787338612.407201:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787338612.854276:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc283b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874160212024704:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787338612.854381:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338612.854560:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212024704 00000100:00100000:0.0:1787338612.854569:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212024704 00000100:00100000:0.0:1787338612.854628:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787338612.854640:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc2d31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874160212024704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787338612.854681:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787338612.854731:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc2d31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874160212024704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338612.854748:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:2.0:1787338612.855126:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbfc283b80 x1874160212024704/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787338628 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787338612.855146:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc283b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874160212024704:0@lo:13:osp-pre-1-0.0 00000001:02000400:3.0:1787338613.172735:0:9444:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.44 00010000:00010000:2.0:1787338613.430305:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338614.455442:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787338614.600823:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338614.600863:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338614.600983:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192069888 00000100:00100000:2.0:1787338614.600995:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192069888 00000100:00100000:2.0:1787338614.601073:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 49 00000100:00100000:2.0:1787338614.601085:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf46fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+6:2358:x1874160192069888:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:1.0:1787338614.601123:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192069760 00000100:00100000:1.0:1787338614.601128:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192069760 00000100:00100000:1.0:1787338614.601158:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 201 00000100:00100000:1.0:1787338614.601166:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbde805c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+10:2358:x1874160192069760:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:2.0:1787338614.601170:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf46fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+6:2358:x1874160192069888:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 88us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338614.601177:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 49 00000100:00100000:1.0:1787338614.601191:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbde805c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+10:2358:x1874160192069760:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 27us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338614.601198:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 201 00000100:00080000:3.0:1787338614.601290:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:2.0:1787338615.050647:0:9492:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Fri Aug 21 14:56:53 EDT 2026 00010000:00010000:2.0:1787338615.481653:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338616.510959:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787338616.950043:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787338616.950075:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf3e9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874160212024832:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787338616.950151:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338616.950229:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212024832 00000100:00100000:1.0:1787338616.950237:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212024832 00000100:00100000:1.0:1787338616.950289:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787338616.950298:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf3e9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874160212024832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787338616.950340:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787338616.950383:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf3e9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874160212024832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338616.950390:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:1.0:1787338616.950410:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787338616.950451:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbf3e9c000 x1874160212024832/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787338632 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787338616.950470:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf3e9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874160212024832:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787338617.463870:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc281180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d79243c8-b367-45ff-8d76-fbaa4be8becb:3317:1874160212024960:0@lo:400:kworker.0 00000100:00100000:0.0:1787338617.463948:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc280a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874160212025088:0@lo:400:kworker.0 00000100:00100000:1.0:1787338617.463978:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338617.463993:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338617.464090:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc283b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874160212025344:0@lo:400:kworker.0 00000100:00100000:2.0:1787338617.464135:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338617.464434:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787338617.464442:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbd172fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1874160212025472:0@lo:400:kworker.0 00000100:00100000:2.0:1787338617.464469:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338617.464496:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc280380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1874160212025216:0@lo:400:kworker.0 00000100:00100000:2.0:1787338617.464522:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338617.464756:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212024960 00000100:00100000:1.0:1787338617.464763:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212024960 00000100:00100000:1.0:1787338617.464805:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1787338617.464814:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc7da4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+19:3317:x1874160212024960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787338617.464865:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc7da4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+19:3317:x1874160212024960:12345-0@lo:400:kworker.0 Request processed in 51us (887us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338617.464889:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1787338617.464948:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc281180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d79243c8-b367-45ff-8d76-fbaa4be8becb:3317:1874160212024960:0@lo:400:kworker.0 00000100:00100000:2.0:1787338617.465132:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212025088 00000100:00100000:2.0:1787338617.465461:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212025088 00000100:00100000:2.0:1787338617.465504:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212025472 00000100:00100000:2.0:1787338617.465508:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212025472 00000100:00100000:2.0:1787338617.465535:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212025216 00000100:00100000:1.0:1787338617.466261:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787338617.466276:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbd172ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874160212025088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787338617.466348:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbd172ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874160212025088:12345-0@lo:400:kworker.0 Request processed in 78us (2356us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338617.466355:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787338617.466371:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787338617.466377:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc2d33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874160212025472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787338617.466415:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc2d33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874160212025472:12345-0@lo:400:kworker.0 Request processed in 39us (1945us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338617.466421:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787338617.466477:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212025216 00000100:00100000:2.0:1787338617.466516:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787338617.466523:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc2d33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874160212025216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787338617.466690:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc2d33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874160212025216:12345-0@lo:400:kworker.0 Request processed in 168us (2167us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338617.466697:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787338617.466718:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212025344 00000100:00100000:2.0:1787338617.466722:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212025344 00000100:00100000:2.0:1787338617.466750:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787338617.466757:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc2d31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1874160212025344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787338617.466787:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc2d31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1874160212025344:12345-0@lo:400:kworker.0 Request processed in 31us (2652us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338617.466793:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:2.0:1787338617.466813:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787338617.466841:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc280380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1874160212025216:0@lo:400:kworker.0 00000100:00100000:2.0:1787338617.466868:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbd172fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1874160212025472:0@lo:400:kworker.0 00010000:00080000:2.0:1787338617.466901:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbfc283b80 x1874160212025344/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787338633 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787338617.466911:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc283b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874160212025344:0@lo:400:kworker.0 00000100:00100000:0.0:1787338617.469865:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc280a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874160212025088:0@lo:400:kworker.0 00000100:00100000:0.0:1787338617.469900:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbd172f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874160212025600:0@lo:400:kworker.0 00000100:00100000:0.0:1787338617.469974:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338617.470176:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212025600 00000100:00100000:2.0:1787338617.470185:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212025600 00000100:00100000:2.0:1787338617.470245:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787338617.470257:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbd172ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874160212025600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787338617.470330:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbd172ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874160212025600:12345-0@lo:400:kworker.0 Request processed in 67us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338617.470338:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:2.0:1787338617.470373:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787338617.470692:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbd172f800 x1874160212025600/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787338633 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787338617.470705:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbd172f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874160212025600:0@lo:400:kworker.0 00010000:00010000:3.0:1787338617.527078:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787338617.983392:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf3e9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874160212025728:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787338617.983466:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338617.983643:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212025728 00000100:00100000:1.0:1787338617.983652:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212025728 00000100:00100000:1.0:1787338617.983722:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787338617.983732:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbd172f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874160212025728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787338617.983769:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787338617.983814:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbd172f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874160212025728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338617.983822:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:0.0:1787338617.983926:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbf3e9c000 x1874160212025728/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787338633 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787338617.983946:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf3e9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874160212025728:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787338618.553170:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338619.574138:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787338619.717504:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338619.717563:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338619.717649:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192070144 00000100:00100000:2.0:1787338619.717659:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192070144 00000100:00100000:2.0:1787338619.717749:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 53 00000100:00100000:2.0:1787338619.717762:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbd172c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+6:2357:x1874160192070144:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:2.0:1787338619.717849:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbd172c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+6:2357:x1874160192070144:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 90us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338619.717857:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 53 00000100:00100000:1.0:1787338619.717905:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192070016 00000100:00100000:1.0:1787338619.717910:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192070016 00000100:00080000:3.0:1787338619.717947:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787338619.717954:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 203 00000100:00100000:1.0:1787338619.717961:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc7da4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+10:2357:x1874160192070016:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:1.0:1787338619.717989:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc7da4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+10:2357:x1874160192070016:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 28us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338619.717996:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 203 00010000:00010000:1.0:1787338620.598732:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338621.627095:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787338622.076066:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbd172d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874160212025856:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787338622.076141:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338622.076239:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212025856 00000100:00100000:1.0:1787338622.076258:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212025856 00000100:00100000:1.0:1787338622.076322:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787338622.076332:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf46f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874160212025856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787338622.076365:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1787338622.078021:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787338622.083066:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf46f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874160212025856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 6724us (6913us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338622.083081:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:3.0:1787338622.083267:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbd172d180 x1874160212025856/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787338638 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787338622.083295:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbd172d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874160212025856:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787338622.582354:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf3e9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d79243c8-b367-45ff-8d76-fbaa4be8becb:3317:1874160212025984:0@lo:400:kworker.0 00000100:00100000:1.0:1787338622.582397:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf3e9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1874160212026240:0@lo:400:kworker.0 00000100:00100000:0.0:1787338622.582435:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338622.582458:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf3e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874160212026112:0@lo:400:kworker.0 00000100:00100000:3.0:1787338622.582523:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf3e9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874160212026368:0@lo:400:kworker.0 00000100:00100000:1.0:1787338622.586590:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338622.586701:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212025984 00000100:00100000:1.0:1787338622.586726:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212025984 00000100:00100000:1.0:1787338622.586777:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1787338622.586788:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc7da4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+19:3317:x1874160212025984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787338622.586896:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc7da4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+19:3317:x1874160212025984:12345-0@lo:400:kworker.0 Request processed in 110us (4460us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338622.586904:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1787338622.586946:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212026240 00000100:00100000:1.0:1787338622.586950:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212026240 00000100:00100000:1.0:1787338622.587005:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787338622.587012:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf3e9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874160212026240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787338622.587050:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf3e9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874160212026240:12345-0@lo:400:kworker.0 Request processed in 39us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338622.587057:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:1.0:1787338622.587077:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787338622.587111:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf3e9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1874160212026240:0@lo:400:kworker.0 00000100:00100000:0.0:1787338622.590686:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf3e9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d79243c8-b367-45ff-8d76-fbaa4be8becb:3317:1874160212025984:0@lo:400:kworker.0 00000100:00100000:0.0:1787338622.590730:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf3e9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1874160212026496:0@lo:400:kworker.0 00000100:00100000:0.0:1787338622.590801:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338622.590958:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212026496 00000100:00100000:1.0:1787338622.590966:0:7647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212026496 00000100:00100000:1.0:1787338622.591035:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787338622.591046:0:7647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbd172f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1874160212026496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787338622.591105:0:7647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbd172f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1874160212026496:12345-0@lo:400:kworker.0 Request processed in 62us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338622.591112:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:1.0:1787338622.591137:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787338622.591309:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf3e9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1874160212026496:0@lo:400:kworker.0 00000100:00100000:3.0:1787338622.593488:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338622.593488:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338622.593545:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf3e9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874160212026624:0@lo:400:kworker.0 00000100:00100000:1.0:1787338622.593564:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212026112 00000100:00100000:1.0:1787338622.593571:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212026112 00000100:00100000:1.0:1787338622.593698:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787338622.593709:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc2d32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874160212026112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787338622.593784:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc2d32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874160212026112:12345-0@lo:400:kworker.0 Request processed in 77us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338622.593791:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787338622.594490:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338622.594626:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf3e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874160212026112:0@lo:400:kworker.0 00000100:00100000:0.0:1787338622.594689:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212026368 00000100:00100000:0.0:1787338622.594695:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212026368 00000100:00100000:2.0:1787338622.595112:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212026624 00000100:00100000:2.0:1787338622.595117:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212026624 00000100:00100000:2.0:1787338622.595216:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787338622.595225:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf46f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1874160212026368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787338622.595298:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf46f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1874160212026368:12345-0@lo:400:kworker.0 Request processed in 74us (1815us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338622.595305:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787338622.595320:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787338622.595327:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf3e9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874160212026624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787338622.595361:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf3e9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874160212026624:12345-0@lo:400:kworker.0 Request processed in 36us (874us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338622.595367:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:3.0:1787338622.595509:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbf3e9c000 x1874160212026368/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787338638 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787338622.595522:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf3e9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874160212026368:0@lo:400:kworker.0 00000100:00080000:1.0:1787338622.595668:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787338622.595692:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbf3e9e300 x1874160212026624/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787338638 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787338622.595702:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf3e9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874160212026624:0@lo:400:kworker.0 00010000:00010000:1.0:1787338622.646345:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787338623.094373:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787338623.094900:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbd172d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874160212026752:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787338623.094978:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338623.095586:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212026752 00000100:00100000:2.0:1787338623.095595:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212026752 00000100:00100000:2.0:1787338623.095744:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787338623.095755:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf3e9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874160212026752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787338623.095807:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787338623.095904:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf3e9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874160212026752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (892us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338623.095912:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1787338623.096004:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbd172d880 x1874160212026752/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787338639 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787338623.096026:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbd172d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874160212026752:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787338623.670270:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787338624.697923:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787338624.836710:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338624.837396:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192070272 00000100:00100000:3.0:1787338624.837408:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192070272 00000100:00100000:3.0:1787338624.837474:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 205 00000100:00100000:3.0:1787338624.837494:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc7da7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+10:2358:x1874160192070272:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:3.0:1787338624.837604:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc7da7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+10:2358:x1874160192070272:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 121us (903us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338624.837613:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 205 00000100:00100000:3.0:1787338624.844331:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338624.844435:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192070400 00000100:00100000:1.0:1787338624.844458:0:7647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192070400 00000100:00100000:1.0:1787338624.844545:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 57 00000100:00100000:1.0:1787338624.844556:0:7647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbedcb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+6:2358:x1874160192070400:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:1.0:1787338624.844645:0:7647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbedcb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+6:2358:x1874160192070400:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 91us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338624.844653:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 57 00000100:00080000:3.0:1787338624.844951:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787338625.728223:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338626.750334:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787338627.192842:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbd172e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874160212026880:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787338627.192950:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338627.193099:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212026880 00000100:00100000:0.0:1787338627.193108:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212026880 00000100:00100000:0.0:1787338627.193203:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787338627.193214:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbedcb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874160212026880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787338627.193250:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787338627.193308:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbedcb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874160212026880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338627.193316:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:3.0:1787338627.194606:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787338627.194661:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbd172e680 x1874160212026880/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787338643 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787338627.194699:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbd172e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874160212026880:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787338627.702912:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf3e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d79243c8-b367-45ff-8d76-fbaa4be8becb:3317:1874160212027008:0@lo:400:kworker.0 00000100:00100000:1.0:1787338627.702995:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338627.703043:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf3e9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874160212027520:0@lo:400:kworker.0 00000100:00100000:1.0:1787338627.703083:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338627.703111:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787338627.703117:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf3e9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1874160212027392:0@lo:400:kworker.0 00000100:00100000:1.0:1787338627.703141:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338627.703183:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf3e9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874160212027136:0@lo:400:kworker.0 00000100:00100000:1.0:1787338627.703208:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338627.703226:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787338627.703230:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf3e9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1874160212027264:0@lo:400:kworker.0 00000100:00100000:1.0:1787338627.703251:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338627.703349:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212027008 00000100:00100000:1.0:1787338627.703357:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212027008 00000100:00100000:1.0:1787338627.703410:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1787338627.703421:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc7da7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+19:3317:x1874160212027008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787338627.703481:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc7da7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+19:3317:x1874160212027008:12345-0@lo:400:kworker.0 Request processed in 61us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338627.703488:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1787338627.703520:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212027520 00000100:00100000:1.0:1787338627.703524:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212027520 00000100:00100000:1.0:1787338627.703832:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787338627.703840:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf3e9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1874160212027520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787338627.703893:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf3e9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1874160212027520:12345-0@lo:400:kworker.0 Request processed in 34us (789us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338627.703899:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787338627.708041:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212027392 00000100:00100000:0.0:1787338627.708059:0:7647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212027392 00000100:00100000:0.0:1787338627.708119:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212027136 00000100:00100000:0.0:1787338627.708122:0:7647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212027136 00000100:00100000:0.0:1787338627.708136:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212027264 00000100:00100000:0.0:1787338627.708139:0:7647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212027264 00000100:00100000:0.0:1787338627.708171:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787338627.708181:0:7647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf3e9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1874160212027392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787338627.708276:0:7647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf3e9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1874160212027392:12345-0@lo:400:kworker.0 Request processed in 96us (5134us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338627.708293:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787338627.708314:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787338627.708321:0:7647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc280a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874160212027136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787338627.708362:0:7647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc280a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874160212027136:12345-0@lo:400:kworker.0 Request processed in 42us (5152us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338627.708368:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787338627.708379:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787338627.708403:0:7647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc283b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874160212027264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787338627.708435:0:7647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc283b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874160212027264:12345-0@lo:400:kworker.0 Request processed in 33us (5183us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338627.708441:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787338627.708505:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf3e9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1874160212027264:0@lo:400:kworker.0 00000100:00100000:0.0:1787338627.708519:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf3e9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874160212027136:0@lo:400:kworker.0 00000100:00100000:3.0:1787338627.712055:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf3e9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1874160212027392:0@lo:400:kworker.0 00000100:00100000:3.0:1787338627.712075:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf3e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d79243c8-b367-45ff-8d76-fbaa4be8becb:3317:1874160212027008:0@lo:400:kworker.0 00010000:00080000:3.0:1787338627.712090:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbf3e9c000 x1874160212027520/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787338643 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787338627.712102:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf3e9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874160212027520:0@lo:400:kworker.0 00000100:00080000:0.0:1787338627.716972:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787338627.716996:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787338627.776218:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787338628.215330:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787338628.215350:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbd172c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874160212027648:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787338628.215416:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338628.215477:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212027648 00000100:00100000:0.0:1787338628.215484:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212027648 00000100:00100000:0.0:1787338628.215529:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787338628.215539:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbd172f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874160212027648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787338628.215572:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787338628.215616:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbd172f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874160212027648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338628.215624:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1787338628.215666:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbd172c700 x1874160212027648/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787338644 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787338628.215684:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbd172c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874160212027648:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787338628.790119:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787338629.817360:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787338629.958400:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338629.958450:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338629.959141:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192070528 00000100:00100000:1.0:1787338629.959151:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192070528 00000100:00100000:1.0:1787338629.959212:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 207 00000100:00100000:1.0:1787338629.959237:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc7da6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+10:2358:x1874160192070528:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:1.0:1787338629.959318:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc7da6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+10:2358:x1874160192070528:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 84us (929us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338629.959326:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 207 00000100:00100000:0.0:1787338629.961207:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192070656 00000100:00100000:0.0:1787338629.961231:0:7647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192070656 00000100:00100000:0.0:1787338629.961302:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 61 00000100:00100000:0.0:1787338629.961310:0:7647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbedcb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+6:2358:x1874160192070656:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:0.0:1787338629.961376:0:7647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbedcb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+6:2358:x1874160192070656:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 66us (2925us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338629.961383:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 61 00000100:00080000:3.0:1787338629.962384:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787338630.838077:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338631.862358:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787338631.874514:0:10124:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 14:57:10 (1787338630) === 00000100:00100000:3.0:1787338632.310280:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787338632.310305:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbd172c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874160212027776:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787338632.310382:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338632.310558:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212027776 00000100:00100000:0.0:1787338632.310568:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212027776 00000100:00100000:0.0:1787338632.310633:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787338632.310645:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbedcb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874160212027776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787338632.310682:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787338632.310763:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbedcb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874160212027776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338632.310771:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:2.0:1787338632.310860:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbd172c700 x1874160212027776/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787338648 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787338632.310907:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbd172c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874160212027776:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787338632.310963:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787338632.628152:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338632.629436:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192070784 00000100:00100000:2.0:1787338632.629451:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192070784 00000100:00100000:2.0:1787338632.629570:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 208 00000100:00100000:2.0:1787338632.629583:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc7da7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+10:8125:x1874160192070784:12345-192.168.201.53@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787338632.629601:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787338632.629634:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90bbf40e3400/0x83671231080c14be lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab5e8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338632.629667:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bbf40e3400/0x83671231080c14be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab5e8 expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338632.629679:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90bbf40e3400/0x83671231080c14be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab5e8 expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338632.629690:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf40e3400, rc 0) 00000100:00100000:2.0:1787338632.629765:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc7da7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+11:8125:x1874160192070784:12345-192.168.201.53@tcp:101:mount.lustre.0 Request processed in 184us (1623us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338632.629791:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 208 00000100:00100000:0.0:1787338632.654953:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338632.655168:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192070912 00000100:00100000:2.0:1787338632.655180:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192070912 00000100:00100000:2.0:1787338632.655260:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 209 00000100:00100000:2.0:1787338632.655273:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc7da5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+11:8125:x1874160192070912:12345-192.168.201.53@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787338632.655631:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc7da5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+11:8125:x1874160192070912:12345-192.168.201.53@tcp:501:mount.lustre.0 Request processed in 352us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338632.655639:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 209 00000100:00100000:3.0:1787338632.660462:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338632.660802:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192071040 00000100:00100000:2.0:1787338632.660814:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192071040 00000100:00100000:1.0:1787338632.661054:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 210 00000100:00100000:1.0:1787338632.661077:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc7da7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+11:8125:x1874160192071040:12345-192.168.201.53@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787338632.661342:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc7da7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+11:8125:x1874160192071040:12345-192.168.201.53@tcp:503:mount.lustre.0 Request processed in 267us (889us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338632.661351:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 210 00000100:00100000:3.0:1787338632.673937:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338632.674281:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192071168 00000100:00100000:2.0:1787338632.674292:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192071168 00000100:00100000:2.0:1787338632.674359:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 211 00000100:00100000:2.0:1787338632.674370:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc7da4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+11:8129:x1874160192071168:12345-192.168.201.53@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787338632.674679:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc7da4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+11:8129:x1874160192071168:12345-192.168.201.53@tcp:502:llog_process_th.0 Request processed in 309us (753us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338632.674687:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 211 00000100:00100000:0.0:1787338632.707734:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338632.707916:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192071296 00000100:00100000:3.0:1787338632.707930:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192071296 00000100:00100000:3.0:1787338632.707996:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 212 00000100:00100000:3.0:1787338632.708008:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc7da5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+11:8129:x1874160192071296:12345-192.168.201.53@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787338632.708343:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc7da5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+11:8129:x1874160192071296:12345-192.168.201.53@tcp:502:llog_process_th.0 Request processed in 336us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338632.708351:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 212 00000100:00100000:3.0:1787338632.711927:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338632.712118:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192071424 00000100:00100000:0.0:1787338632.712129:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192071424 00000100:00100000:0.0:1787338632.712176:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 213 00000100:00100000:0.0:1787338632.712184:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc7da5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+11:8125:x1874160192071424:12345-192.168.201.53@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787338632.712199:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787338632.712215:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90bbc0031c00/0x83671231080c14c5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab612 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338632.712251:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bbc0031c00/0x83671231080c14c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab612 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338632.712281:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90bbc0031c00/0x83671231080c14c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab612 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338632.712289:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbc0031c00, rc 0) 00000100:00100000:0.0:1787338632.712365:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc7da5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+12:8125:x1874160192071424:12345-192.168.201.53@tcp:101:mount.lustre.0 Request processed in 180us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338632.712372:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 213 00000100:00100000:1.0:1787338632.715292:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338632.715388:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192071552 00000100:00100000:2.0:1787338632.715399:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192071552 00000100:00100000:2.0:1787338632.715476:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 214 00000100:00100000:2.0:1787338632.715487:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc7da6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+12:8125:x1874160192071552:12345-192.168.201.53@tcp:256:mount.lustre.0 20000000:01000000:2.0:1787338632.715513:0:5832:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1787338632.715538:0:5832:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787338632.715541:0:5832:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1787338632.715555:0:5832:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1787338632.715563:0:5832:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1787338632.717694:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc7da6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+12:8125:x1874160192071552:12345-192.168.201.53@tcp:256:mount.lustre.0 Request processed in 2196us (2399us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338632.717709:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 214 00000100:00100000:3.0:1787338632.722451:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338632.722577:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192071680 00000100:00100000:0.0:1787338632.722587:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192071680 00000100:00100000:0.0:1787338632.722649:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 215 00000100:00100000:0.0:1787338632.722659:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc7da5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+12:8125:x1874160192071680:12345-192.168.201.53@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787338632.722677:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787338632.722694:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90bbc0031000/0x83671231080c14cc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab619 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338632.722725:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bbc0031000/0x83671231080c14cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab619 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338632.722737:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90bbc0031000/0x83671231080c14cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab619 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338632.722747:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbc0031000, rc 0) 00000100:00100000:0.0:1787338632.722817:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc7da5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+13:8125:x1874160192071680:12345-192.168.201.53@tcp:101:mount.lustre.0 Request processed in 159us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338632.722824:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 215 00000100:00100000:1.0:1787338632.727682:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338632.727860:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192071808 00000100:00100000:2.0:1787338632.727871:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192071808 00000100:00100000:2.0:1787338632.727971:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 216 00000100:00100000:2.0:1787338632.727983:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc7da6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+13:8125:x1874160192071808:12345-192.168.201.53@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787338632.729633:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc7da6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+13:8125:x1874160192071808:12345-192.168.201.53@tcp:501:mount.lustre.0 Request processed in 1634us (1942us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338632.729649:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 216 00000100:00100000:2.0:1787338632.732673:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338632.732916:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192071936 00000100:00100000:1.0:1787338632.732928:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192071936 00000100:00100000:1.0:1787338632.732987:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 217 00000100:00100000:1.0:1787338632.732998:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc7da6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+13:8125:x1874160192071936:12345-192.168.201.53@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787338632.733292:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc7da6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+13:8125:x1874160192071936:12345-192.168.201.53@tcp:503:mount.lustre.0 Request processed in 294us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338632.733302:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 217 00000100:00100000:3.0:1787338632.738603:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338632.739136:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192072064 00000100:00100000:2.0:1787338632.739147:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192072064 00000100:00100000:2.0:1787338632.739204:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 218 00000100:00100000:2.0:1787338632.739212:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc408b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+13:8131:x1874160192072064:12345-192.168.201.53@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787338632.739493:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc408b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+13:8131:x1874160192072064:12345-192.168.201.53@tcp:502:llog_process_th.0 Request processed in 281us (903us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338632.739500:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 218 00000100:00100000:3.0:1787338632.747867:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338632.748410:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192072192 00000100:00100000:0.0:1787338632.748448:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192072192 00000100:00100000:0.0:1787338632.748499:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 219 00000100:00100000:0.0:1787338632.748507:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc408b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+13:8131:x1874160192072192:12345-192.168.201.53@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787338632.748741:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc408b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+13:8131:x1874160192072192:12345-192.168.201.53@tcp:502:llog_process_th.0 Request processed in 234us (885us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338632.748968:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 219 00000100:00100000:3.0:1787338632.753451:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338632.753502:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338632.753709:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192072448 00000100:00100000:1.0:1787338632.753719:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192072448 00000100:00100000:1.0:1787338632.753797:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192072320 00000100:00100000:1.0:1787338632.753800:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192072320 00000100:00100000:1.0:1787338632.753816:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 62 00000100:00100000:1.0:1787338632.753824:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbedcb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+6:2358:x1874160192072448:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:1.0:1787338632.753946:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbedcb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+6:2358:x1874160192072448:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 123us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338632.753953:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 62 00000100:00100000:1.0:1787338632.753968:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 10 00000100:00100000:1.0:1787338632.753971:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee561f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2355:x1874160192072320:12345-192.168.201.53@tcp:38:mount.lustre.0 00010000:00080000:1.0:1787338632.753993:0:5841:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from e810cb1b-6993-4b6e-89c4-e8961cf35b35@192.168.201.53@tcp t0 exp 0000000000000000 cur 285 last 0 00000020:00000080:1.0:1787338632.754032:0:5841:0:(genops.c:1385:class_connect()) connect: client e810cb1b-6993-4b6e-89c4-e8961cf35b35, cookie 0x83671231080c14d3 00000004:00100000:1.0:1787338632.754077:0:5841:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1787338632.754304:0:5841:0:(import.c:65:import_set_state_nolock()) ffff90bbde3cc000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787338632.754329:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee561f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e810cb1b-6993-4b6e-89c4-e8961cf35b35+6:2355:x1874160192072320:12345-192.168.201.53@tcp:38:mount.lustre.0 Request processed in 356us (828us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338632.754333:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 10 00000100:00080000:3.0:1787338632.754718:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787338632.767353:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338632.767542:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192072576 00000100:00100000:1.0:1787338632.767553:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192072576 00000100:00100000:1.0:1787338632.767682:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 11 00000100:00100000:1.0:1787338632.767695:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee560a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e810cb1b-6993-4b6e-89c4-e8961cf35b35+6:0:x1874160192072576:12345-192.168.201.53@tcp:41:mount.lustre.0 00000100:00080000:3.0:1787338632.769483:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787338632.769756:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000004:00000024:1.0:1787338632.769837:0:5841:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1787338632.769968:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee560a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e810cb1b-6993-4b6e-89c4-e8961cf35b35+6:0:x1874160192072576:12345-192.168.201.53@tcp:41:mount.lustre.0 Request processed in 2273us (2624us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338632.769978:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 11 00000100:00100000:1.0:1787338632.772099:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192072704 00000100:00100000:1.0:1787338632.772114:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192072704 00000100:00100000:1.0:1787338632.772160:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 12 00000100:00100000:1.0:1787338632.772169:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbd172e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e810cb1b-6993-4b6e-89c4-e8961cf35b35+6:8125:x1874160192072704:12345-192.168.201.53@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787338632.772217:0:5841:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1787338632.772294:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbd172e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e810cb1b-6993-4b6e-89c4-e8961cf35b35+6:8125:x1874160192072704:12345-192.168.201.53@tcp:41:mount.lustre.0 Request processed in 124us (2543us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338632.772300:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 12 00000100:00100000:3.0:1787338632.781446:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338632.781945:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192072832 00000100:00100000:1.0:1787338632.781955:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192072832 00000100:00100000:1.0:1787338632.782013:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 13 00000100:00100000:1.0:1787338632.782024:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee561c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e810cb1b-6993-4b6e-89c4-e8961cf35b35+6:8125:x1874160192072832:12345-192.168.201.53@tcp:40:mount.lustre.0 00000100:00100000:1.0:1787338632.782135:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee561c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e810cb1b-6993-4b6e-89c4-e8961cf35b35+6:8125:x1874160192072832:12345-192.168.201.53@tcp:40:mount.lustre.0 Request processed in 112us (700us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338632.782143:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 13 00000100:00100000:1.0:1787338632.789978:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338632.790024:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338632.790150:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192072960 00000100:00100000:2.0:1787338632.790161:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192072960 00000100:00100000:2.0:1787338632.790209:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192073088 00000100:00100000:2.0:1787338632.790212:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192073088 00000100:00100000:2.0:1787338632.790238:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 12 00000100:00100000:2.0:1787338632.790247:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc280380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2355:x1874160192072960:12345-192.168.201.53@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787338632.790282:0:6690:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from e810cb1b-6993-4b6e-89c4-e8961cf35b35@192.168.201.53@tcp t0 exp 0000000000000000 cur 285 last 0 00000020:00000080:2.0:1787338632.790326:0:6690:0:(genops.c:1385:class_connect()) connect: client e810cb1b-6993-4b6e-89c4-e8961cf35b35, cookie 0x83671231080c14da 00002000:00100000:2.0:1787338632.790338:0:6690:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli e810cb1b-6993-4b6e-89c4-e8961cf35b35/ffff90bbfc2ba800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787338632.790349:0:6690:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:3.0:1787338632.790569:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338632.790595:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192073216 00000100:00100000:3.0:1787338632.790599:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192073216 00000100:00100000:3.0:1787338632.790640:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 1 00000100:00100000:3.0:1787338632.790648:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee560700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e810cb1b-6993-4b6e-89c4-e8961cf35b35+6:8125:x1874160192073216:12345-192.168.201.53@tcp:33:mount.lustre.0 00002000:00080000:2.0:1787338632.790828:0:6690:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787338632.790861:0:6690:0:(import.c:65:import_set_state_nolock()) ffff90bbfc2be000 : changing import state from RECOVER to FULL 00000004:00200000:3.0:1787338632.790923:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:2.0:1787338632.791199:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc280380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e810cb1b-6993-4b6e-89c4-e8961cf35b35+6:2355:x1874160192072960:12345-192.168.201.53@tcp:8:mount.lustre.0 Request processed in 949us (1230us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338632.791208:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 12 00000100:00100000:2.0:1787338632.791240:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 13 00000100:00100000:2.0:1787338632.791247:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc281180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2355:x1874160192073088:12345-192.168.201.53@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787338632.791268:0:6690:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from e810cb1b-6993-4b6e-89c4-e8961cf35b35@192.168.201.53@tcp t0 exp 0000000000000000 cur 285 last 0 00000020:00000080:2.0:1787338632.791294:0:6690:0:(genops.c:1385:class_connect()) connect: client e810cb1b-6993-4b6e-89c4-e8961cf35b35, cookie 0x83671231080c14e1 00002000:00100000:2.0:1787338632.791302:0:6690:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli e810cb1b-6993-4b6e-89c4-e8961cf35b35/ffff90bbfc2b8000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787338632.791323:0:6690:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:3.0:1787338632.791360:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee560700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e810cb1b-6993-4b6e-89c4-e8961cf35b35+6:8125:x1874160192073216:12345-192.168.201.53@tcp:33:mount.lustre.0 Request processed in 712us (791us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338632.791368:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 1 00002000:00080000:2.0:1787338632.791513:0:6690:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787338632.791530:0:6690:0:(import.c:65:import_set_state_nolock()) ffff90bbfc2be800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787338632.791555:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc281180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e810cb1b-6993-4b6e-89c4-e8961cf35b35+6:2355:x1874160192073088:12345-192.168.201.53@tcp:8:mount.lustre.0 Request processed in 308us (1531us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338632.791563:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 13 00000100:00100000:0.0:1787338632.822714:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc2d31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1874160212028160:0@lo:400:kworker.0 00000100:00100000:0.0:1787338632.822791:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338632.822899:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc2d32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d79243c8-b367-45ff-8d76-fbaa4be8becb:3316:1874160212027904:0@lo:400:kworker.0 00000100:00100000:1.0:1787338632.822948:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338632.822959:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc2d33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874160212028032:0@lo:400:kworker.0 00000100:00100000:3.0:1787338632.822999:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338632.823005:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212027904 00000100:00100000:1.0:1787338632.823014:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212027904 00000100:00100000:3.0:1787338632.823071:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212028160 00000100:00100000:3.0:1787338632.823076:0:7647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212028160 00000100:00100000:1.0:1787338632.823077:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1787338632.823087:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc408a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+19:3316:x1874160212027904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787338632.823147:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212028032 00000100:00100000:3.0:1787338632.823152:0:7647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212028032 00000100:00100000:1.0:1787338632.823155:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc408a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+19:3316:x1874160212027904:12345-0@lo:400:kworker.0 Request processed in 68us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338632.823165:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1787338632.823181:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787338632.823190:0:7647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbd172ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874160212028160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787338632.823299:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc2d32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d79243c8-b367-45ff-8d76-fbaa4be8becb:3316:1874160212027904:0@lo:400:kworker.0 00000100:00100000:1.0:1787338632.823331:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787338632.823339:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee563480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874160212028032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787338632.823386:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee563480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874160212028032:12345-0@lo:400:kworker.0 Request processed in 47us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338632.823393:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787338632.823435:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc2d33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874160212028032:0@lo:400:kworker.0 00000100:00100000:1.0:1787338632.823484:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc2d30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1874160212028288:0@lo:400:kworker.0 00000100:00100000:1.0:1787338632.823522:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338632.823548:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212028288 00000100:00100000:1.0:1787338632.823552:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212028288 00000100:00100000:1.0:1787338632.823576:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787338632.823582:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf3e91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874160212028288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787338632.823614:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf3e91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874160212028288:12345-0@lo:400:kworker.0 Request processed in 32us (92us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338632.823620:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787338632.823643:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc2d30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1874160212028288:0@lo:400:kworker.0 00000100:00080000:1.0:1787338632.823673:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787338632.839520:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787338632.839545:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc2d30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874160212028416:0@lo:400:kworker.0 00000100:00100000:3.0:1787338632.840571:0:7647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbd172ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874160212028160:12345-0@lo:400:kworker.0 Request processed in 17375us (17772us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338632.840585:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787338632.842887:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc2d31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1874160212028160:0@lo:400:kworker.0 00000100:00100000:2.0:1787338632.846402:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338632.850950:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212028416 00000100:00100000:1.0:1787338632.850967:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212028416 00000100:00100000:1.0:1787338632.851062:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787338632.851074:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc2d31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1874160212028416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787338632.851188:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc2d31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1874160212028416:12345-0@lo:400:kworker.0 Request processed in 116us (4793us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338632.851196:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:2.0:1787338632.851472:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbc2d30a80 x1874160212028416/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787338648 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787338632.851511:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc2d30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874160212028416:0@lo:400:kworker.0 00000100:00080000:3.0:1787338632.854038:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787338632.886751:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787338633.334274:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbd172d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874160212028544:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787338633.334355:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338633.334556:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212028544 00000100:00100000:0.0:1787338633.334566:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212028544 00000100:00100000:0.0:1787338633.334623:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787338633.334634:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc2d30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874160212028544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787338633.334659:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787338633.334712:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc2d30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874160212028544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338633.334720:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:2.0:1787338633.334841:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbd172d500 x1874160212028544/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787338649 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787338633.334863:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbd172d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874160212028544:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787338633.915592:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787338633.953359:0:5861:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e810cb1b-6993-4b6e-89c4-e8961cf35b35 00000001:00100000:3.0:1787338633.966360:0:7651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e810cb1b-6993-4b6e-89c4-e8961cf35b35 00000001:00100000:1.0:1787338633.971270:0:6714:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e810cb1b-6993-4b6e-89c4-e8961cf35b35 00010000:00010000:1.0:1787338634.936007:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787338635.959238:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338636.982142:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787338637.430234:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787338637.430276:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbd172ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874160212028672:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787338637.430368:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338637.430540:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212028672 00000100:00100000:0.0:1787338637.430549:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212028672 00000100:00100000:0.0:1787338637.430618:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787338637.430631:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf3e93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874160212028672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787338637.430668:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787338637.430736:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf3e93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874160212028672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338637.430761:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:3.0:1787338637.430825:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787338637.431028:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbd172ce00 x1874160212028672/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787338653 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787338637.431046:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbd172ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874160212028672:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787338637.942779:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbffa4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874160212028928:0@lo:400:kworker.0 00000100:00100000:1.0:1787338637.942912:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338637.942986:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787338637.942994:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbffa48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874160212029056:0@lo:400:kworker.0 00000100:00100000:1.0:1787338637.943020:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338637.943063:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212028928 00000100:00100000:1.0:1787338637.943073:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212028928 00000100:00100000:1.0:1787338637.943127:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212029056 00000100:00100000:1.0:1787338637.943130:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212029056 00000100:00100000:1.0:1787338637.943164:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787338637.943174:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf3e91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874160212028928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787338637.943234:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf3e91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874160212028928:12345-0@lo:400:kworker.0 Request processed in 61us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338637.943243:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787338637.943264:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787338637.943271:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf3e92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874160212029056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787338637.943300:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf3e92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874160212029056:12345-0@lo:400:kworker.0 Request processed in 29us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338637.943851:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbffa4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1874160212029184:0@lo:400:kworker.0 00000100:00100000:2.0:1787338637.943904:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338637.943938:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee562a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d79243c8-b367-45ff-8d76-fbaa4be8becb:3315:1874160212028800:0@lo:400:kworker.0 00000100:00100000:0.0:1787338637.943989:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787338637.943998:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787338637.944017:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212029184 00000100:00100000:2.0:1787338637.944021:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212029184 00000100:00100000:0.0:1787338637.944025:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbffa4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874160212029312:0@lo:400:kworker.0 00000100:00100000:2.0:1787338637.944062:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787338637.944063:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338637.944074:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc2d30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874160212029184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787338637.944102:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212028800 00000100:00100000:0.0:1787338637.944107:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212028800 00000100:00100000:2.0:1787338637.944124:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc2d30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874160212029184:12345-0@lo:400:kworker.0 Request processed in 51us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338637.944132:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787338637.944139:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1787338637.944148:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc408bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+19:3315:x1874160212028800:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787338637.944155:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787338637.944186:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbffa4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1874160212029184:0@lo:400:kworker.0 00000100:00100000:0.0:1787338637.944193:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc408bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+19:3315:x1874160212028800:12345-0@lo:400:kworker.0 Request processed in 45us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338637.944200:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1787338637.944236:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212029312 00000100:00100000:2.0:1787338637.944240:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212029312 00000100:00100000:0.0:1787338637.944244:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee562a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d79243c8-b367-45ff-8d76-fbaa4be8becb:3315:1874160212028800:0@lo:400:kworker.0 00000100:00100000:2.0:1787338637.944282:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787338637.944292:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbd172c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1874160212029312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787338637.944345:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbd172c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1874160212029312:12345-0@lo:400:kworker.0 Request processed in 57us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338637.944363:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:2.0:1787338637.944377:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787338637.944411:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbffa48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874160212029056:0@lo:400:kworker.0 00000100:00100000:2.0:1787338637.944422:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbffa4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874160212028928:0@lo:400:kworker.0 00000100:00100000:1.0:1787338637.945615:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:0.0:1787338637.945793:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbffa4a300 x1874160212029312/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787338653 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787338637.945809:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbffa4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874160212029312:0@lo:400:kworker.0 00010000:00010000:0.0:1787338638.006016:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787338638.149574:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338638.149663:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338638.149705:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338638.149741:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338638.149800:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192073344 00000100:00100000:3.0:1787338638.149811:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192073344 00000100:00100000:3.0:1787338638.149863:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 222 00000100:00100000:3.0:1787338638.149903:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4089850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+13:2359:x1874160192073344:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:3.0:1787338638.150006:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4089850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+13:2359:x1874160192073344:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 133us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338638.150016:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 222 00000100:00100000:0.0:1787338638.150238:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192073728 00000100:00100000:0.0:1787338638.150243:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192073728 00000100:00100000:0.0:1787338638.150298:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 32 00000100:00100000:0.0:1787338638.150307:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf3e93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e810cb1b-6993-4b6e-89c4-e8961cf35b35+5:2359:x1874160192073728:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:0.0:1787338638.150360:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf3e93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e810cb1b-6993-4b6e-89c4-e8961cf35b35+5:2359:x1874160192073728:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 54us (696us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338638.150367:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 32 00000100:00080000:3.0:1787338638.150998:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787338638.152516:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192073472 00000100:00100000:2.0:1787338638.152541:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192073472 00000100:00100000:2.0:1787338638.152638:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338638.152766:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192073856 00000100:00100000:1.0:1787338638.152770:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192073856 00000100:00100000:2.0:1787338638.152832:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192073600 00000100:00100000:2.0:1787338638.152837:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192073600 00000100:00100000:3.0:1787338638.153052:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 69 00000100:00100000:3.0:1787338638.153066:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf3e90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+6:2359:x1874160192073472:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:3.0:1787338638.153140:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf3e90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+6:2359:x1874160192073472:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 78us (3619us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338638.153148:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 69 00000100:00080000:0.0:1787338638.153558:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787338638.153564:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787338638.155041:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 33 00000100:00100000:0.0:1787338638.155056:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc2d33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e810cb1b-6993-4b6e-89c4-e8961cf35b35+5:2359:x1874160192073856:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:0.0:1787338638.155173:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc2d33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e810cb1b-6993-4b6e-89c4-e8961cf35b35+5:2359:x1874160192073856:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 122us (2537us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338638.155180:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 33 00000100:00100000:2.0:1787338638.155346:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 70 00000100:00100000:2.0:1787338638.155355:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf3e92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e810cb1b-6993-4b6e-89c4-e8961cf35b35+5:2359:x1874160192073600:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:2.0:1787338638.155385:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf3e92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e810cb1b-6993-4b6e-89c4-e8961cf35b35+5:2359:x1874160192073600:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 32us (5644us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338638.155391:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 70 00000100:00100000:1.0:1787338638.455100:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc2d32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874160212029440:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787338638.455180:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338638.455297:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212029440 00000100:00100000:2.0:1787338638.455306:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212029440 00000100:00100000:2.0:1787338638.455375:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787338638.455385:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf3e92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874160212029440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787338638.455421:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787338638.455468:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf3e92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874160212029440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338638.455475:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:1.0:1787338638.455830:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbc2d32300 x1874160212029440/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787338654 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787338638.455850:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc2d32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874160212029440:0@lo:13:osp-pre-1-0.0 00000001:02000400:0.0:1787338638.773664:0:10322:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg153-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:1.0:1787338639.030234:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787338640.054237:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338641.083447:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338642.102653:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787338642.552302:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787338642.552325:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf3e91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874160212029568:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787338642.552392:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338642.552450:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212029568 00000100:00100000:1.0:1787338642.552458:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212029568 00000100:00100000:1.0:1787338642.552507:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787338642.552515:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf3e90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874160212029568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787338642.552545:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787338642.552583:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf3e90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874160212029568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338642.552590:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:1.0:1787338642.552624:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbf3e91500 x1874160212029568/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787338658 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787338642.552652:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf3e91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874160212029568:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787338642.555062:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787338643.062664:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787338643.062741:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787338643.062764:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbd172df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874160212029824:0@lo:400:kworker.0 00000100:00100000:2.0:1787338643.062834:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338643.062970:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212029824 00000100:00100000:3.0:1787338643.062978:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212029824 00000100:00100000:3.0:1787338643.063039:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787338643.063049:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc2d32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874160212029824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787338643.063106:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc2d32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874160212029824:12345-0@lo:400:kworker.0 Request processed in 58us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338643.063113:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787338643.063151:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbd172df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874160212029824:0@lo:400:kworker.0 00000100:00100000:1.0:1787338643.067540:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbd172dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d79243c8-b367-45ff-8d76-fbaa4be8becb:3315:1874160212029696:0@lo:400:kworker.0 00000100:00100000:1.0:1787338643.067619:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338643.067748:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212029696 00000100:00100000:2.0:1787338643.067756:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212029696 00000100:00100000:2.0:1787338643.067805:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1787338643.067813:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc408b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+19:3315:x1874160212029696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787338643.067866:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc408b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+19:3315:x1874160212029696:12345-0@lo:400:kworker.0 Request processed in 53us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338643.067898:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1787338643.068460:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787338643.068471:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbd172df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1874160212029952:0@lo:400:kworker.0 00000100:00100000:0.0:1787338643.068499:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338643.068527:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212029952 00000100:00100000:0.0:1787338643.068530:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212029952 00000100:00100000:0.0:1787338643.068561:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787338643.068567:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbd172ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874160212029952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787338643.068599:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbd172ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874160212029952:12345-0@lo:400:kworker.0 Request processed in 32us (99us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338643.068605:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:0.0:1787338643.068620:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787338643.068642:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbd172df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1874160212029952:0@lo:400:kworker.0 00000100:00100000:0.0:1787338643.068670:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbd172df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1874160212030080:0@lo:400:kworker.0 00000100:00100000:0.0:1787338643.068688:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338643.068710:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212030080 00000100:00100000:0.0:1787338643.068713:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212030080 00000100:00100000:0.0:1787338643.068749:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787338643.068754:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbd172d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1874160212030080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787338643.068781:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbd172d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1874160212030080:12345-0@lo:400:kworker.0 Request processed in 27us (92us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338643.068787:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:0.0:1787338643.068797:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787338643.068812:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbd172df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1874160212030080:0@lo:400:kworker.0 00000100:00100000:3.0:1787338643.068985:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbd172df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874160212030208:0@lo:400:kworker.0 00000100:00100000:3.0:1787338643.069014:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338643.069127:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212030208 00000100:00100000:0.0:1787338643.069131:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212030208 00000100:00100000:0.0:1787338643.069171:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787338643.069177:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874160212030208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787338643.069210:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874160212030208:12345-0@lo:400:kworker.0 Request processed in 34us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338643.069216:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:0.0:1787338643.069249:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbd172df80 x1874160212030208/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787338659 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787338643.069260:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbd172df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874160212030208:0@lo:400:kworker.0 00000100:00080000:2.0:1787338643.069381:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787338643.069523:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbd172dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d79243c8-b367-45ff-8d76-fbaa4be8becb:3315:1874160212029696:0@lo:400:kworker.0 00010000:00010000:2.0:1787338643.135615:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787338643.273642:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338643.273679:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338643.273705:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338643.273725:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338643.274150:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338643.274191:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192073984 00000100:00100000:2.0:1787338643.274201:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192073984 00000100:00100000:2.0:1787338643.274249:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 224 00000100:00100000:2.0:1787338643.274260:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4088c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+13:2359:x1874160192073984:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:2.0:1787338643.274339:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4088c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+13:2359:x1874160192073984:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 81us (708us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338643.274347:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 224 00000100:00100000:2.0:1787338643.274381:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192074240 00000100:00100000:2.0:1787338643.274385:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192074240 00000100:00100000:2.0:1787338643.274420:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192074112 00000100:00100000:2.0:1787338643.274423:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192074112 00000100:00100000:2.0:1787338643.274505:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 74 00000100:00100000:2.0:1787338643.274514:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc91dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e810cb1b-6993-4b6e-89c4-e8961cf35b35+5:2359:x1874160192074240:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:2.0:1787338643.274609:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc91dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e810cb1b-6993-4b6e-89c4-e8961cf35b35+5:2359:x1874160192074240:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 96us (928us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338643.274628:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 74 00000100:00100000:2.0:1787338643.274642:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 75 00000100:00100000:2.0:1787338643.274649:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc91df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+6:2359:x1874160192074112:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:2.0:1787338643.274676:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc91df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+6:2359:x1874160192074112:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 28us (950us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338643.274683:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 75 00000100:00100000:2.0:1787338643.274702:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192074496 00000100:00100000:2.0:1787338643.274706:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192074496 00000100:00100000:2.0:1787338643.274732:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192074368 00000100:00100000:2.0:1787338643.274735:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192074368 00000100:00100000:2.0:1787338643.274750:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 35 00000100:00100000:2.0:1787338643.274756:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc91dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e810cb1b-6993-4b6e-89c4-e8961cf35b35+5:2359:x1874160192074496:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:2.0:1787338643.274782:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc91dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e810cb1b-6993-4b6e-89c4-e8961cf35b35+5:2359:x1874160192074496:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 26us (1077us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338643.274788:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 35 00000100:00100000:2.0:1787338643.274799:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 36 00000100:00100000:2.0:1787338643.274806:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc91dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e810cb1b-6993-4b6e-89c4-e8961cf35b35+5:2359:x1874160192074368:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:2.0:1787338643.274829:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc91dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e810cb1b-6993-4b6e-89c4-e8961cf35b35+5:2359:x1874160192074368:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 24us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338643.274835:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 36 00000100:00080000:2.0:1787338643.274866:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787338643.274869:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787338643.274902:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787338643.575022:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf3e91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874160212030336:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787338643.575130:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338643.575201:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212030336 00000100:00100000:3.0:1787338643.575209:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212030336 00000100:00100000:3.0:1787338643.575265:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787338643.575275:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbd172df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874160212030336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787338643.575318:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787338643.575367:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbd172df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874160212030336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338643.575375:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:0.0:1787338643.575664:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbf3e91500 x1874160212030336/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787338659 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787338643.575684:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf3e91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874160212030336:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787338644.153934:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338645.179963:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338646.199491:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338647.223063:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787338647.670511:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf3e90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874160212030464:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787338647.670585:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338647.670829:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212030464 00000100:00100000:1.0:1787338647.670838:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212030464 00000100:00100000:1.0:1787338647.670931:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787338647.670942:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874160212030464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787338647.670978:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1787338647.671192:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787338647.671333:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874160212030464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 393us (747us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338647.671341:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:3.0:1787338647.673623:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbf3e90000 x1874160212030464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787338663 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787338647.673652:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf3e90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874160212030464:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787338648.183141:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbd172d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874160212030976:0@lo:400:kworker.0 00000100:00100000:0.0:1787338648.183233:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338648.183298:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787338648.183305:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbd172c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d79243c8-b367-45ff-8d76-fbaa4be8becb:3316:1874160212030592:0@lo:400:kworker.0 00000100:00100000:0.0:1787338648.183337:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338648.183361:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbd172fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1874160212031104:0@lo:400:kworker.0 00000100:00100000:0.0:1787338648.183408:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338648.183439:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbd172e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874160212030720:0@lo:400:kworker.0 00000100:00100000:0.0:1787338648.183479:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338648.183498:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbd172dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874160212031232:0@lo:400:kworker.0 00000100:00100000:0.0:1787338648.183520:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338648.183535:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787338648.183539:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbd172d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1874160212030848:0@lo:400:kworker.0 00000100:00100000:2.0:1787338648.183707:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212030976 00000100:00100000:2.0:1787338648.183715:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212030976 00000100:00100000:2.0:1787338648.183765:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212031232 00000100:00100000:2.0:1787338648.183769:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212031232 00000100:00100000:2.0:1787338648.183805:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787338648.183815:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee562a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1874160212030976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787338648.183893:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee562a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1874160212030976:12345-0@lo:400:kworker.0 Request processed in 58us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338648.183901:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787338648.183920:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787338648.183927:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf3e9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1874160212031232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787338648.183956:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf3e9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1874160212031232:12345-0@lo:400:kworker.0 Request processed in 30us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338648.183962:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:2.0:1787338648.183979:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787338648.184005:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbd172d180 x1874160212030976/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787338664 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787338648.184019:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbd172d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874160212030976:0@lo:400:kworker.0 00000100:00100000:0.0:1787338648.184103:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1787338648.184137:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbd172dc00 x1874160212031232/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787338664 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787338648.184146:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbd172dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874160212031232:0@lo:400:kworker.0 00000100:00100000:0.0:1787338648.184239:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212030592 00000100:00100000:0.0:1787338648.184244:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212030592 00000100:00100000:0.0:1787338648.184272:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1787338648.184279:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4089c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+19:3316:x1874160212030592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787338648.184312:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4089c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+19:3316:x1874160212030592:12345-0@lo:400:kworker.0 Request processed in 33us (974us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338648.184318:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1787338648.184346:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212031104 00000100:00100000:0.0:1787338648.184349:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212031104 00000100:00100000:0.0:1787338648.184373:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212030720 00000100:00100000:0.0:1787338648.184377:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212030720 00000100:00100000:0.0:1787338648.184399:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212030848 00000100:00100000:0.0:1787338648.184402:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212030848 00000100:00100000:0.0:1787338648.184416:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787338648.184422:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf3e9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874160212031104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787338648.184454:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf3e9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874160212031104:12345-0@lo:400:kworker.0 Request processed in 32us (1046us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338648.184460:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787338648.184471:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787338648.184477:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf3e9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874160212030720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787338648.184504:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf3e9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874160212030720:12345-0@lo:400:kworker.0 Request processed in 27us (1025us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338648.184510:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787338648.184520:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787338648.184526:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf3e9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874160212030848:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787338648.184641:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787338648.184659:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbd172c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d79243c8-b367-45ff-8d76-fbaa4be8becb:3316:1874160212030592:0@lo:400:kworker.0 00000100:00100000:2.0:1787338648.184670:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbd172fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1874160212031104:0@lo:400:kworker.0 00000100:00100000:0.0:1787338648.184720:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf3e9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874160212030848:12345-0@lo:400:kworker.0 Request processed in 194us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338648.184727:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787338648.184754:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbd172d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1874160212030848:0@lo:400:kworker.0 00000100:00100000:0.0:1787338648.184762:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbd172e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874160212030720:0@lo:400:kworker.0 00010000:00010000:3.0:1787338648.246116:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787338648.398196:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338648.398245:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338648.398289:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338648.398327:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338648.398356:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338648.398385:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192074752 00000100:00100000:1.0:1787338648.398385:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192074624 00000100:00100000:3.0:1787338648.398393:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192074752 00000100:00100000:1.0:1787338648.398393:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192074624 00000100:00100000:1.0:1787338648.398438:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 226 00000100:00100000:3.0:1787338648.398445:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192074880 00000100:00100000:3.0:1787338648.398448:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192074880 00000100:00100000:1.0:1787338648.398448:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4089450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+13:2359:x1874160192074624:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:3.0:1787338648.398467:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 79 00000100:00100000:3.0:1787338648.398473:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+6:2359:x1874160192074752:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:1.0:1787338648.398513:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4089450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+13:2359:x1874160192074624:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 66us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338648.398521:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 226 00000100:00100000:0.0:1787338648.398534:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192075008 00000100:00100000:0.0:1787338648.398538:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192075008 00000100:00100000:0.0:1787338648.398562:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192075136 00000100:00100000:0.0:1787338648.398565:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192075136 00000100:00100000:0.0:1787338648.398579:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 39 00000100:00100000:0.0:1787338648.398585:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e810cb1b-6993-4b6e-89c4-e8961cf35b35+5:2359:x1874160192075008:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:2.0:1787338648.398659:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 80 00000100:00100000:2.0:1787338648.398670:0:7647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e810cb1b-6993-4b6e-89c4-e8961cf35b35+5:2359:x1874160192074880:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:3.0:1787338648.406034:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+6:2359:x1874160192074752:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 7545us (7842us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338648.406050:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 79 00000100:00100000:3.0:1787338648.406112:0:6690:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1787338648.406121:0:6690:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00080000:3.0:1787338648.406153:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787338648.406159:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787338648.406162:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787338648.407063:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 40 00000100:00100000:3.0:1787338648.407080:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa49f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e810cb1b-6993-4b6e-89c4-e8961cf35b35+5:2359:x1874160192075136:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:3.0:1787338648.407164:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa49f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e810cb1b-6993-4b6e-89c4-e8961cf35b35+5:2359:x1874160192075136:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 91us (8807us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338648.407171:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 40 00000100:00100000:0.0:1787338648.409336:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e810cb1b-6993-4b6e-89c4-e8961cf35b35+5:2359:x1874160192075008:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 10740us (11079us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338648.409361:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 39 00000100:00100000:3.0:1787338648.428134:0:7647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e810cb1b-6993-4b6e-89c4-e8961cf35b35+5:2359:x1874160192074880:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 29454us (29793us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338648.428149:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 80 00000100:00100000:2.0:1787338648.704434:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787338648.704467:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf3e91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874160212031360:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787338648.704541:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338648.704743:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212031360 00000100:00100000:1.0:1787338648.704751:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212031360 00000100:00100000:1.0:1787338648.704817:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787338648.704842:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc91dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874160212031360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787338648.704909:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787338648.704963:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc91dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874160212031360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 124us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338648.704971:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:1.0:1787338648.705022:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbf3e91c00 x1874160212031360/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787338664 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787338648.705040:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf3e91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874160212031360:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787338649.269969:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338650.298424:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338651.324462:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787338652.344529:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787338652.790937:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf3e91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874160212031488:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787338652.791007:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338652.791099:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212031488 00000100:00100000:1.0:1787338652.791107:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212031488 00000100:00100000:1.0:1787338652.791161:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787338652.791170:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874160212031488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787338652.791205:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787338652.791259:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874160212031488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338652.791267:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:3.0:1787338652.791358:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787338652.791396:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbf3e91c00 x1874160212031488/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787338668 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787338652.791415:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf3e91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874160212031488:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787338653.306626:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbffa48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874160212032000:0@lo:400:kworker.0 00000100:00100000:3.0:1787338653.306691:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338653.307444:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787338653.307452:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbffa4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d79243c8-b367-45ff-8d76-fbaa4be8becb:3316:1874160212031616:0@lo:400:kworker.0 00000100:00100000:3.0:1787338653.307592:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338653.307630:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbffa49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1874160212032128:0@lo:400:kworker.0 00000100:00100000:3.0:1787338653.307658:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338653.307689:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbffa4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874160212031744:0@lo:400:kworker.0 00000100:00100000:3.0:1787338653.307724:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338653.307991:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbffa48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1874160212031872:0@lo:400:kworker.0 00000100:00100000:3.0:1787338653.308046:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbffa4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874160212032256:0@lo:400:kworker.0 00000100:00100000:2.0:1787338653.308127:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212031616 00000100:00100000:2.0:1787338653.308134:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212031616 00000100:00100000:2.0:1787338653.308178:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1787338653.308187:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc408a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+19:3316:x1874160212031616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787338653.308245:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338653.308830:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212032128 00000100:00100000:0.0:1787338653.308835:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212032128 00000100:00100000:0.0:1787338653.308892:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212031744 00000100:00100000:0.0:1787338653.308896:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212031744 00000100:00100000:0.0:1787338653.308909:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212031872 00000100:00100000:0.0:1787338653.308912:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212031872 00000100:00100000:0.0:1787338653.308925:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787338653.308932:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874160212032128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787338653.308981:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874160212032128:12345-0@lo:400:kworker.0 Request processed in 48us (1321us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338653.308988:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787338653.309007:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787338653.309013:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874160212031744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787338653.309041:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874160212031744:12345-0@lo:400:kworker.0 Request processed in 28us (1316us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338653.309047:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787338653.309057:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787338653.309064:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf3e9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874160212031872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787338653.309095:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf3e9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874160212031872:12345-0@lo:400:kworker.0 Request processed in 31us (850us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338653.309100:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:0.0:1787338653.309116:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787338653.309150:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbffa48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1874160212031872:0@lo:400:kworker.0 00000100:00100000:0.0:1787338653.309182:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbffa49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1874160212032128:0@lo:400:kworker.0 00000100:00100000:3.0:1787338653.310563:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338653.310623:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbffa4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874160212031744:0@lo:400:kworker.0 00000100:00100000:3.0:1787338653.310660:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212032000 00000100:00100000:3.0:1787338653.310664:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212032000 00000100:00100000:3.0:1787338653.310711:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212032256 00000100:00100000:3.0:1787338653.310715:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212032256 00000100:00100000:3.0:1787338653.310750:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787338653.310758:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1874160212032000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787338653.310822:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1874160212032000:12345-0@lo:400:kworker.0 Request processed in 65us (4131us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338653.310829:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787338653.310843:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787338653.310849:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc95e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874160212032256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787338653.310897:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc95e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874160212032256:12345-0@lo:400:kworker.0 Request processed in 48us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338653.310902:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:3.0:1787338653.311068:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbffa4b480 x1874160212032256/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787338669 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787338653.311080:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbffa4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874160212032256:0@lo:400:kworker.0 00000100:00080000:0.0:1787338653.311665:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787338653.311692:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbffa48380 x1874160212032000/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787338669 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787338653.311715:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbffa48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874160212032000:0@lo:400:kworker.0 00000100:00100000:2.0:1787338653.313290:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc408a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+19:3316:x1874160212031616:12345-0@lo:400:kworker.0 Request processed in 5098us (5693us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338653.313303:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1787338653.315390:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbffa4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d79243c8-b367-45ff-8d76-fbaa4be8becb:3316:1874160212031616:0@lo:400:kworker.0 00010000:00010000:1.0:1787338653.366948:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787338653.510747:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338653.510796:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338653.512558:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338653.512603:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338653.512643:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338653.512679:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192075392 00000100:00100000:0.0:1787338653.512691:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192075392 00000100:00100000:0.0:1787338653.512766:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192075520 00000100:00100000:0.0:1787338653.512770:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192075520 00000100:00100000:0.0:1787338653.512797:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 84 00000100:00100000:0.0:1787338653.512810:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf3e9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+6:2358:x1874160192075392:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:0.0:1787338653.512919:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf3e9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+6:2358:x1874160192075392:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 111us (2179us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338653.512927:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 84 00000100:00100000:0.0:1787338653.512945:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 85 00000100:00100000:0.0:1787338653.512953:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf3e9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e810cb1b-6993-4b6e-89c4-e8961cf35b35+5:2358:x1874160192075520:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:0.0:1787338653.512979:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf3e9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e810cb1b-6993-4b6e-89c4-e8961cf35b35+5:2358:x1874160192075520:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 26us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338653.512986:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 85 00000100:00100000:0.0:1787338653.513017:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192075648 00000100:00100000:0.0:1787338653.513020:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192075648 00000100:00100000:0.0:1787338653.513047:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192075776 00000100:00100000:0.0:1787338653.513050:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192075776 00000100:00100000:0.0:1787338653.513070:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 14 00000100:00100000:0.0:1787338653.513077:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf3e9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e810cb1b-6993-4b6e-89c4-e8961cf35b35+5:2355:x1874160192075648:12345-192.168.201.53@tcp:9:kworker.0 00000020:00000080:0.0:1787338653.513097:0:6690:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x83671231080c14da 00000100:00080000:0.0:1787338653.513106:0:6690:0:(import.c:65:import_set_state_nolock()) ffff90bbfc2be000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787338653.513142:0:6690:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1787338653.513721:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 15 00000100:00100000:1.0:1787338653.513732:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf3e9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e810cb1b-6993-4b6e-89c4-e8961cf35b35+5:2355:x1874160192075776:12345-192.168.201.53@tcp:9:kworker.0 00000020:00000080:1.0:1787338653.513747:0:6689:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x83671231080c14e1 00000100:00080000:1.0:1787338653.513752:0:6689:0:(import.c:65:import_set_state_nolock()) ffff90bbfc2be800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787338653.513777:0:6689:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1787338653.514066:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf3e9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e810cb1b-6993-4b6e-89c4-e8961cf35b35+2:2355:x1874160192075776:12345-192.168.201.53@tcp:9:kworker.0 Request processed in 337us (1422us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338653.514074:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 15 00000100:00080000:1.0:1787338653.514103:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787338653.514108:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787338653.514110:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787338653.514117:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787338653.515411:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787338653.517311:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf3e9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e810cb1b-6993-4b6e-89c4-e8961cf35b35+2:2355:x1874160192075648:12345-192.168.201.53@tcp:9:kworker.0 Request processed in 4216us (4690us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338653.517325:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 14 00000100:00100000:2.0:1787338653.521506:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192075264 00000100:00100000:2.0:1787338653.521523:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192075264 00000100:00100000:2.0:1787338653.521715:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 228 00000100:00100000:2.0:1787338653.521728:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4089050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+13:2358:x1874160192075264:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:2.0:1787338653.521817:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4089050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+13:2358:x1874160192075264:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 92us (11019us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338653.521825:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 228 00000100:00100000:3.0:1787338653.816375:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc91ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874160212032384:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787338653.816444:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338653.816650:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212032384 00000100:00100000:0.0:1787338653.816658:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212032384 00000100:00100000:0.0:1787338653.816739:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787338653.816750:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874160212032384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787338653.816784:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787338653.816835:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874160212032384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338653.816843:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:0.0:1787338653.816906:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbc91ded80 x1874160212032384/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787338669 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787338653.816925:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc91ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874160212032384:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787338654.391146:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787338654.457500:0:6714:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e810cb1b-6993-4b6e-89c4-e8961cf35b35 00000020:00000080:1.0:1787338654.457516:0:6714:0:(genops.c:885:class_export_put()) final put ffff90bbfc2ba800/e810cb1b-6993-4b6e-89c4-e8961cf35b35 00000020:00000080:3.0:1787338654.458398:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff90bbfc2ba800/e810cb1b-6993-4b6e-89c4-e8961cf35b35 for lustre-OST0000 00000020:00000080:3.0:1787338654.458452:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90bbfc2be000 for lustre-OST0000 00000001:00100000:2.0:1787338654.461522:0:7651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e810cb1b-6993-4b6e-89c4-e8961cf35b35 00000020:00000080:2.0:1787338654.461535:0:7651:0:(genops.c:885:class_export_put()) final put ffff90bbfc2b8000/e810cb1b-6993-4b6e-89c4-e8961cf35b35 00000020:00000080:2.0:1787338654.461579:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90bbfc2b8000/e810cb1b-6993-4b6e-89c4-e8961cf35b35 for lustre-OST0001 00000020:00000080:2.0:1787338654.461631:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90bbfc2be800 for lustre-OST0001 00010000:00010000:0.0:1787338655.414708:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787338656.218115:0:11025:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1787338656.437986:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787338657.462136:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787338657.923148:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf3e91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874160212032512:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787338657.923224:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338657.923300:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212032512 00000100:00100000:1.0:1787338657.923309:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212032512 00000100:00100000:1.0:1787338657.923655:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787338657.923665:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf3e93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874160212032512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787338657.923699:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787338657.923746:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf3e93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874160212032512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338657.923754:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:1.0:1787338657.923795:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbf3e91f80 x1874160212032512/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787338673 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787338657.923816:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf3e91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874160212032512:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787338657.923901:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787338658.425850:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf3e91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d79243c8-b367-45ff-8d76-fbaa4be8becb:3317:1874160212032640:0@lo:400:kworker.0 00000100:00100000:0.0:1787338658.425943:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338658.425995:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212032640 00000100:00100000:3.0:1787338658.426003:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212032640 00000100:00100000:3.0:1787338658.426053:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1787338658.426062:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc408ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+19:3317:x1874160212032640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787338658.428077:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf3e93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874160212032768:0@lo:400:kworker.0 00000100:00100000:2.0:1787338658.428121:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338658.428146:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787338658.428150:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf3e92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1874160212032896:0@lo:400:kworker.0 00000100:00100000:2.0:1787338658.428163:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338658.430579:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc408ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+19:3317:x1874160212032640:12345-0@lo:400:kworker.0 Request processed in 4509us (4626us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338658.430593:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1787338658.430778:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf3e90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874160212033024:0@lo:400:kworker.0 00000100:00100000:1.0:1787338658.430822:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338658.430846:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787338658.430850:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf3e90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1874160212033152:0@lo:400:kworker.0 00000100:00100000:1.0:1787338658.430892:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338658.430912:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212032768 00000100:00100000:1.0:1787338658.430917:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212032768 00000100:00100000:1.0:1787338658.430943:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212032896 00000100:00100000:1.0:1787338658.430945:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212032896 00000100:00100000:1.0:1787338658.430959:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212033152 00000100:00100000:1.0:1787338658.430960:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212033152 00000100:00100000:1.0:1787338658.430980:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787338658.430985:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc91dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874160212032768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787338658.431099:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc91dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874160212032768:12345-0@lo:400:kworker.0 Request processed in 113us (2977us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338658.431104:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787338658.431114:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787338658.431119:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc91dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874160212032896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787338658.431136:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc91dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874160212032896:12345-0@lo:400:kworker.0 Request processed in 19us (2973us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338658.431140:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787338658.431146:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787338658.431150:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf3e90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874160212033152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787338658.431166:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf3e90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874160212033152:12345-0@lo:400:kworker.0 Request processed in 16us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338658.431170:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787338658.431184:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212033024 00000100:00100000:1.0:1787338658.431187:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212033024 00000100:00100000:1.0:1787338658.431210:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787338658.431216:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf3e91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1874160212033024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787338658.431244:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf3e91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1874160212033024:12345-0@lo:400:kworker.0 Request processed in 29us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338658.431257:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:1.0:1787338658.431278:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787338658.431307:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf3e90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1874160212033152:0@lo:400:kworker.0 00010000:00080000:1.0:1787338658.431320:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbf3e90a80 x1874160212033024/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787338674 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787338658.431331:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf3e90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874160212033024:0@lo:400:kworker.0 00000100:00100000:3.0:1787338658.431408:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf3e93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874160212033280:0@lo:400:kworker.0 00000100:00100000:3.0:1787338658.431439:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338658.431473:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf3e92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1874160212032896:0@lo:400:kworker.0 00000100:00100000:3.0:1787338658.431484:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf3e93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874160212032768:0@lo:400:kworker.0 00000100:00100000:1.0:1787338658.433254:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212033280 00000100:00100000:1.0:1787338658.433263:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212033280 00000100:00100000:1.0:1787338658.433377:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787338658.433387:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1874160212033280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787338658.433504:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1874160212033280:12345-0@lo:400:kworker.0 Request processed in 119us (2063us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338658.433523:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:1.0:1787338658.433587:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbf3e93100 x1874160212033280/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787338674 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787338658.433620:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf3e93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874160212033280:0@lo:400:kworker.0 00000100:00080000:2.0:1787338658.433827:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787338658.437712:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf3e91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d79243c8-b367-45ff-8d76-fbaa4be8becb:3317:1874160212032640:0@lo:400:kworker.0 00010000:00010000:0.0:1787338658.486120:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787338658.629296:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338658.629370:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338658.629413:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338658.631561:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192075904 00000100:00100000:0.0:1787338658.631574:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192075904 00000100:00100000:0.0:1787338658.631637:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 230 00000100:00100000:0.0:1787338658.631648:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc408a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+13:2356:x1874160192075904:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:0.0:1787338658.631726:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc408a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+13:2356:x1874160192075904:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 79us (2355us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338658.631734:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 230 00000100:00100000:2.0:1787338658.641073:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192076032 00000100:00100000:2.0:1787338658.641093:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192076032 00000100:00100000:2.0:1787338658.641287:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192076160 00000100:00100000:2.0:1787338658.641292:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192076160 00000100:00100000:0.0:1787338658.643054:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 89 00000100:00100000:0.0:1787338658.643069:0:7647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf3e91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+6:2356:x1874160192076032:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:0.0:1787338658.643153:0:7647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf3e91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+6:2356:x1874160192076032:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 88us (13864us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338658.643161:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 89 00000100:00080000:3.0:1787338658.645497:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787338658.647072:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 90 00000100:00100000:2.0:1787338658.647084:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf3e93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e810cb1b-6993-4b6e-89c4-e8961cf35b35+5:2356:x1874160192076160:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:2.0:1787338658.647162:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf3e93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e810cb1b-6993-4b6e-89c4-e8961cf35b35+5:2356:x1874160192076160:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 81us (17748us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338658.647272:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 90 00000100:00100000:3.0:1787338658.934659:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787338658.934686:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc91de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874160212033408:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787338658.934766:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338658.934867:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212033408 00000100:00100000:2.0:1787338658.935042:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212033408 00000100:00100000:2.0:1787338658.935093:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787338658.935102:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874160212033408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787338658.935140:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787338658.935190:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874160212033408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338658.935198:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:3.0:1787338658.935353:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbc91de300 x1874160212033408/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787338674 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787338658.935373:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc91de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874160212033408:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787338659.510081:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787338660.095614:0:11174:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc2200b400 20000000:00000080:1.0:1787338660.095633:0:11174:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff90bbedc96c00 uarg=0000000000000000 20000000:01000000:1.0:1787338660.095670:0:11174:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787338660.095676:0:11174:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787338660.095686:0:11174:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1787338660.096394:0:11175:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:3.0:1787338660.096531:0:11174:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1787338660.108243:0:11174:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787338660.108619:0:11174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90bbf40e3800/0x83671231080c14e8 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338660.108643:0:11174:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90bbf7ea4000/0x83671231080c144e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c1447 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338660.108652:0:11174:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90bc02045e00/0x83671231080c1478 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c1471 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338660.108659:0:11174:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90bc021c8800/0x83671231080c14a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c149b expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338660.108668:0:11174:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90bbf7ea4800/0x83671231080c14b7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab5e1 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338660.108691:0:11174:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90bbc0031000/0x83671231080c14cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab619 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338660.108699:0:11174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90bbf40e3800/0x83671231080c14e8 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338660.108747:0:11174:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90bbc0031000/0x83671231080c14cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab619 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338660.108762:0:11174:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90bbc0031000/0x83671231080c14cc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab619 expref: 12 pid: 5834 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338660.108776:0:11174:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc91de300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11174:1874160212033536:192.168.201.53@tcp:104: 00010000:00010000:2.0:1787338660.108910:0:11174:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90bbf7ea4800/0x83671231080c14b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab5e1 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338660.108919:0:11174:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90bbf7ea4800/0x83671231080c14b7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab5e1 expref: 12 pid: 5832 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338660.108928:0:11174:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc91ded80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11174:1874160212033664:192.168.201.53@tcp:104: 00010000:00010000:2.0:1787338660.108959:0:11174:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90bc021c8800/0x83671231080c14a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x83671231080c149b expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338660.108966:0:11174:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90bc021c8800/0x83671231080c14a2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x83671231080c149b expref: 18 pid: 5834 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338660.108974:0:11174:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc91de680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11174:1874160212033792:0@lo:104: 00000100:00100000:2.0:1787338660.109012:0:11174:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338660.109064:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212033792 00000100:00100000:3.0:1787338660.109072:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212033792 00010000:00010000:2.0:1787338660.109090:0:11174:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90bc02045e00/0x83671231080c1478 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x83671231080c1471 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338660.109100:0:11174:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90bc02045e00/0x83671231080c1478 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x83671231080c1471 expref: 18 pid: 5834 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338660.109110:0:11174:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc91dea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11174:1874160212033920:0@lo:104: 00000100:00100000:3.0:1787338660.109125:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787338660.109136:0:11174:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338660.109140:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc91dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d79243c8-b367-45ff-8d76-fbaa4be8becb+3:11174:x1874160212033792:12345-0@lo:104: 00010000:00010000:2.0:1787338660.109158:0:11174:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90bbf7ea4000/0x83671231080c144e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x83671231080c1447 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338660.109167:0:11174:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90bbf7ea4000/0x83671231080c144e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x83671231080c1447 expref: 18 pid: 5832 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338660.109176:0:11174:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbd172ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11174:1874160212034048:0@lo:104: 00000100:00100000:2.0:1787338660.109196:0:11174:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338660.109206:0:11174:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbf3c7f540 going to sleep for 11 seconds 00000100:00100000:0.0:1787338660.109443:0:5821:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:0.0:1787338660.109452:0:5821:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:3.0:1787338660.109691:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.153@tcp lock: ffff90bbf40e3600/0x83671231080c149b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x83671231080c14a2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338660.109767:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787338660.109773:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc91dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d79243c8-b367-45ff-8d76-fbaa4be8becb+3:11174:x1874160212033792:12345-0@lo:104: Request processed in 639us (762us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338660.109864:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212033920 00000100:00100000:0.0:1787338660.109894:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212033920 00010000:00010000:1.0:1787338660.109916:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1787338660.109919:0:5821:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00010000:00010000:1.0:1787338660.109924:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.153@tcp lock: ffff90bbf40e3600/0x83671231080c149b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x83671231080c14a2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338660.109927:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212034048 00000100:00100000:0.0:1787338660.109932:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212034048 00010000:00010000:1.0:1787338660.109936:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e3600 already unused, calling callback (ffffffffc1b2ec20) 10000000:00010000:1.0:1787338660.109942:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.153@tcp lock: ffff90bbf40e3600/0x83671231080c149b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x83671231080c14a2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338660.109953:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.153@tcp lock: ffff90bbf40e3600/0x83671231080c149b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x83671231080c14a2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787338660.109961:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.153@tcp lock: ffff90bbf40e3600/0x83671231080c149b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x83671231080c14a2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787338660.109968:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787338660.109998:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.153@tcp lock: ffff90bbf40e3600/0x83671231080c149b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c14a2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338660.110005:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1787338660.110009:0:11176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787338660.110020:0:11176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc91dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d79243c8-b367-45ff-8d76-fbaa4be8becb+5:11174:x1874160212033920:12345-0@lo:104: 00010000:00010000:1.0:1787338660.110025:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.153@tcp lock: ffff90bbf40e3600/0x83671231080c149b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c14a2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338660.110030:0:11176:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.153@tcp lock: ffff90bbf40e2400/0x83671231080c1471 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x83671231080c1478 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338660.110036:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.153@tcp lock: ffff90bbf40e3600/0x83671231080c149b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c14a2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338660.110054:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338660.110056:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338660.110058:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787338660.110079:0:11176:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787338660.110080:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf3e90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d79243c8-b367-45ff-8d76-fbaa4be8becb:3316:1874160212034176:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787338660.110087:0:11176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc91dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d79243c8-b367-45ff-8d76-fbaa4be8becb+5:11174:x1874160212033920:12345-0@lo:104: Request processed in 68us (951us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338660.110104:0:11176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787338660.110125:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787338660.110127:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787338660.110134:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.153@tcp lock: ffff90bbf40e2400/0x83671231080c1471 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x83671231080c1478 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338660.110143:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e2400 already unused, calling callback (ffffffffc1b2ec20) 00000100:00100000:2.0:1787338660.110222:0:11174:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc91de680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11174:1874160212033792:0@lo:104: 00000100:00100000:2.0:1787338660.110231:0:11174:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc91dea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11174:1874160212033920:0@lo:104: 10000000:00010000:0.0:1787338660.110262:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.153@tcp lock: ffff90bbf40e2400/0x83671231080c1471 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x83671231080c1478 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338660.110271:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.153@tcp lock: ffff90bbf40e2400/0x83671231080c1471 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x83671231080c1478 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787338660.110278:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.153@tcp lock: ffff90bbf40e2400/0x83671231080c1471 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x83671231080c1478 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787338660.110284:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787338660.110329:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.153@tcp lock: ffff90bbf40e2400/0x83671231080c1471 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c1478 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338660.110336:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787338660.110357:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.153@tcp lock: ffff90bbf40e2400/0x83671231080c1471 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c1478 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338660.110364:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.153@tcp lock: ffff90bbf40e2400/0x83671231080c1471 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c1478 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338660.110375:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787338660.110377:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787338660.110378:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787338660.110391:0:11176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787338660.110405:0:11176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbd172c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d79243c8-b367-45ff-8d76-fbaa4be8becb+4:11174:x1874160212034048:12345-0@lo:104: 00010000:00010000:0.0:1787338660.110414:0:11176:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.153@tcp lock: ffff90bbf40e3200/0x83671231080c1447 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x83671231080c144e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338660.110451:0:11176:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787338660.110455:0:11176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbd172c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d79243c8-b367-45ff-8d76-fbaa4be8becb+4:11174:x1874160212034048:12345-0@lo:104: Request processed in 52us (1259us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338660.110462:0:11176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787338660.110495:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212034176 00000100:00100000:0.0:1787338660.110499:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212034176 00010000:00010000:0.0:1787338660.110520:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90bc021c8800/0x83671231080c14a2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x83671231080c149b expref: 19 pid: 5834 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338660.110521:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787338660.110534:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbef178000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d79243c8-b367-45ff-8d76-fbaa4be8becb:3316:1874160212034304:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787338660.110551:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787338660.110561:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbde53e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d79243c8-b367-45ff-8d76-fbaa4be8becb+19:3316:x1874160212034176:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787338660.110566:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787338660.110588:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787338660.110596:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90bc021c8800/0x83671231080c14a2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x83671231080c149b expref: 19 pid: 5834 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338660.110607:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90bc021c8800/0x83671231080c14a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x83671231080c149b expref: 19 pid: 5834 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338660.110619:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212034304 00010000:00010000:0.0:1787338660.110622:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90bc021c8800/0x83671231080c14a2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x83671231080c149b expref: 19 pid: 5834 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338660.110624:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212034304 00010000:00010000:0.0:1787338660.110640:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787338660.110644:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90bc02045e00/0x83671231080c1478 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x83671231080c1471 expref: 19 pid: 5834 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338660.110670:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787338660.110677:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbde53e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d79243c8-b367-45ff-8d76-fbaa4be8becb+19:3316:x1874160212034176:12345-0@lo:103:ldlm_bl.0 Request processed in 117us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338660.110680:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf3e90380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d79243c8-b367-45ff-8d76-fbaa4be8becb+19:3316:x1874160212034304:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787338660.110689:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:1.0:1787338660.110692:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787338660.110699:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90bc02045e00/0x83671231080c1478 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x83671231080c1471 expref: 19 pid: 5834 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338660.110709:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90bc02045e00/0x83671231080c1478 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x83671231080c1471 expref: 18 pid: 5834 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338660.110723:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90bc02045e00/0x83671231080c1478 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x83671231080c1471 expref: 18 pid: 5834 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338660.110734:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787338660.110758:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1787338660.110766:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf3e90380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d79243c8-b367-45ff-8d76-fbaa4be8becb+17:3316:x1874160212034304:12345-0@lo:103:ldlm_bl.0 Request processed in 86us (200us total) trans 0 rc 0/0 00010000:00010000:0.0:1787338660.110766:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.153@tcp lock: ffff90bbf40e3200/0x83671231080c1447 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x83671231080c144e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338660.110779:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787338660.110806:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbef178000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d79243c8-b367-45ff-8d76-fbaa4be8becb:3316:1874160212034304:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787338660.110815:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf3e90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d79243c8-b367-45ff-8d76-fbaa4be8becb:3316:1874160212034176:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787338660.110863:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787338660.110969:0:11174:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbd172ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11174:1874160212034048:0@lo:104: 00010000:00010000:0.0:1787338660.111228:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e3200 already unused, calling callback (ffffffffc1b2ec20) 10000000:00010000:0.0:1787338660.111232:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.153@tcp lock: ffff90bbf40e3200/0x83671231080c1447 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x83671231080c144e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338660.111240:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.153@tcp lock: ffff90bbf40e3200/0x83671231080c1447 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x83671231080c144e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787338660.111247:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.153@tcp lock: ffff90bbf40e3200/0x83671231080c1447 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x83671231080c144e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787338660.111253:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787338660.111277:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.153@tcp lock: ffff90bbf40e3200/0x83671231080c1447 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c144e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338660.111283:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787338660.111305:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.153@tcp lock: ffff90bbf40e3200/0x83671231080c1447 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c144e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338660.111312:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.153@tcp lock: ffff90bbf40e3200/0x83671231080c1447 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c144e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338660.111326:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:0.0:1787338660.111326:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787338660.111329:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787338660.111332:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787338660.111339:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbef179c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d79243c8-b367-45ff-8d76-fbaa4be8becb:3315:1874160212034432:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787338660.111366:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338660.111464:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212034432 00000100:00100000:0.0:1787338660.111468:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212034432 00010000:00010000:0.0:1787338660.111483:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90bbf7ea4000/0x83671231080c144e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x83671231080c1447 expref: 17 pid: 5832 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338660.111519:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787338660.111526:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbd172e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d79243c8-b367-45ff-8d76-fbaa4be8becb+17:3315:x1874160212034432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787338660.111534:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787338660.111539:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90bbf7ea4000/0x83671231080c144e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x83671231080c1447 expref: 17 pid: 5832 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338660.111547:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90bbf7ea4000/0x83671231080c144e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x83671231080c1447 expref: 17 pid: 5832 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338660.111557:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90bbf7ea4000/0x83671231080c144e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x83671231080c1447 expref: 17 pid: 5832 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338660.111566:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787338660.111659:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbd172e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d79243c8-b367-45ff-8d76-fbaa4be8becb+16:3315:x1874160212034432:12345-0@lo:103:ldlm_bl.0 Request processed in 133us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338660.111665:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787338660.114417:0:11174:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc91de300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11174:1874160212033536:192.168.201.53@tcp:104: 00000100:00100000:3.0:1787338660.114435:0:11174:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc91ded80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11174:1874160212033664:192.168.201.53@tcp:104: 00010000:00010000:3.0:1787338660.114484:0:11174:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90bbf40e3800/0x83671231080c14e8 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338660.119242:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbef179c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d79243c8-b367-45ff-8d76-fbaa4be8becb:3315:1874160212034432:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787338660.120825:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338660.121030:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192076416 00000100:00100000:0.0:1787338660.121039:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192076416 00010000:00010000:0.0:1787338660.121076:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90bbf7ea4800/0x83671231080c14b7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab5e1 expref: 13 pid: 5832 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338660.121120:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 28 00000100:00100000:0.0:1787338660.121130:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbd172d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+13:2359:x1874160192076416:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787338660.121144:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787338660.121161:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90bbf7ea4800/0x83671231080c14b7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab5e1 expref: 13 pid: 5832 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338660.121189:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90bbf7ea4800/0x83671231080c14b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab5e1 expref: 13 pid: 5832 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338660.121208:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90bbf7ea4800/0x83671231080c14b7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab5e1 expref: 13 pid: 5832 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338660.121224:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787338660.121287:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbd172d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+12:2359:x1874160192076416:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 158us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338660.121294:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 28 00000100:00100000:2.0:1787338660.121476:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338660.122009:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192076288 00000100:00100000:0.0:1787338660.122015:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192076288 00010000:00010000:0.0:1787338660.122037:0:6704:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90bbc0031000/0x83671231080c14cc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab619 expref: 12 pid: 5834 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338660.122070:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 29 00000100:00100000:0.0:1787338660.122078:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbd172fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+12:2359:x1874160192076288:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787338660.122089:0:6704:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787338660.122094:0:6704:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90bbc0031000/0x83671231080c14cc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab619 expref: 12 pid: 5834 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338660.122103:0:6704:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90bbc0031000/0x83671231080c14cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab619 expref: 12 pid: 5834 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338660.122117:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90bbc0031000/0x83671231080c14cc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab619 expref: 12 pid: 5834 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338660.122130:0:6704:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90bbf40e3800/0x83671231080c14e8 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338660.122158:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bbf40e3800/0x83671231080c14e8 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338660.122176:0:6704:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90bbf40e3800/0x83671231080c14e8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338660.122183:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90bbf40e3800/0x83671231080c14e8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338660.122190:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90bbf40e3800/0x83671231080c14e8 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338660.122197:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90bbf40e3800/0x83671231080c14e8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338660.122204:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e3800 already unused, calling callback (ffffffffc1546230) 00010000:00010000:0.0:1787338660.122208:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90bbf40e3800/0x83671231080c14e8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338660.122215:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90bbf40e3800/0x83671231080c14e8 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338660.122227:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90bbf40e3800/0x83671231080c14e8 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338660.122237:0:6704:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787338660.122280:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbd172fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+11:2359:x1874160192076288:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 201us (802us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338660.122287:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 29 00010000:00010000:2.0:1787338660.122594:0:11174:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90bbf40e3800/0x83671231080c14e8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338660.122614:0:11174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90bbf40e3800/0x83671231080c14e8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338660.122621:0:11174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90bbf40e3800/0x83671231080c14e8 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338660.534040:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787338661.188709:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338661.189371:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192076544 00000100:00100000:2.0:1787338661.189381:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192076544 00000100:00100000:2.0:1787338661.189428:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 231 00000100:00100000:2.0:1787338661.189438:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4088850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+11:5598:x1874160192076544:12345-192.168.201.53@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787338661.189455:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787338661.189473:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90bbf40e3000/0x83671231080c14ef lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab643 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338661.189500:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bbf40e3000/0x83671231080c14ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab643 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338661.189510:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90bbf40e3000/0x83671231080c14ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab643 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338661.189518:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf40e3000, rc 0) 00000100:00100000:2.0:1787338661.189585:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4088850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+12:5598:x1874160192076544:12345-192.168.201.53@tcp:101:ll_cfg_requeue.0 Request processed in 148us (885us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338661.189592:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 231 00000100:00100000:0.0:1787338661.200383:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338661.201402:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192076672 00000100:00100000:3.0:1787338661.201413:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192076672 00000100:00100000:3.0:1787338661.201468:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 232 00000100:00100000:3.0:1787338661.201479:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4088050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+12:5598:x1874160192076672:12345-192.168.201.53@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787338661.203085:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4088050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+12:5598:x1874160192076672:12345-192.168.201.53@tcp:501:ll_cfg_requeue.0 Request processed in 1600us (2704us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338661.203098:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 232 00000100:00100000:2.0:1787338661.219938:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338661.220081:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192076800 00000100:00100000:0.0:1787338661.220093:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192076800 00000100:00100000:0.0:1787338661.220154:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 233 00000100:00100000:0.0:1787338661.220175:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4088450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+12:5598:x1874160192076800:12345-192.168.201.53@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787338661.220436:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4088450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+12:5598:x1874160192076800:12345-192.168.201.53@tcp:503:ll_cfg_requeue.0 Request processed in 272us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338661.220446:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 233 00000100:00100000:3.0:1787338661.236092:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338661.236206:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192076928 00000100:00100000:2.0:1787338661.236219:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192076928 00000100:00100000:2.0:1787338661.236325:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 234 00000100:00100000:2.0:1787338661.236338:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4012050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+12:5598:x1874160192076928:12345-192.168.201.53@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787338661.236357:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787338661.236376:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90bbf40e3e00/0x83671231080c14f6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab64a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338661.236407:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bbf40e3e00/0x83671231080c14f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab64a expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338661.236419:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90bbf40e3e00/0x83671231080c14f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab64a expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338661.236429:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf40e3e00, rc 0) 00000100:00100000:2.0:1787338661.236485:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4012050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+13:5598:x1874160192076928:12345-192.168.201.53@tcp:101:ll_cfg_requeue.0 Request processed in 150us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338661.236492:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 234 10000000:01000000:3.0:1787338661.240160:0:5836:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787338661.240167:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90bbff941800 from 7 10000000:01000000:3.0:1787338661.240171:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787338661.240212:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbf7ea5200/0x83671231080c14fd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338661.240224:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.153@tcp lock: ffff90bbf7ea5200/0x83671231080c14fd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338661.240235:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.153@tcp lock: ffff90bbf7ea5200/0x83671231080c14fd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338661.240258:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbffa49f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212034560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787338661.240317:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338661.240365:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbf43d80c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787338661.240672:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212034560 00000100:00100000:2.0:1787338661.240681:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212034560 00000100:00100000:2.0:1787338661.240751:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1787338661.240762:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4011050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+16:5836:x1874160212034560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787338661.240774:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787338661.240786:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90bbf40e2800/0x83671231080c1504 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x83671231080c14fd expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338661.240809:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bbf40e2800/0x83671231080c1504 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x83671231080c14fd expref: 17 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338661.240819:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90bbf40e2800/0x83671231080c1504 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c14fd expref: 17 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338661.240839:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf40e2800, rc 0) 00000100:00100000:2.0:1787338661.240907:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4011050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+17:5836:x1874160212034560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 147us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338661.240914:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1787338661.241414:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbffa49f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212034560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787338661.241432:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.153@tcp lock: ffff90bbf7ea5200/0x83671231080c14fd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c1504 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338661.241447:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.153@tcp lock: ffff90bbf7ea5200/0x83671231080c14fd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x83671231080c1504 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338661.241509:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbffa49f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212034688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787338661.241550:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338661.241586:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbf43d80c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787338661.241602:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212034688 00000100:00100000:3.0:1787338661.241606:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212034688 00000100:00100000:3.0:1787338661.241633:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1787338661.241640:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4012c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+17:5836:x1874160212034688:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787338661.241904:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4012c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+17:5836:x1874160212034688:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 262us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338661.241911:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1787338661.241944:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbffa49f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212034688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787338661.241973:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbffa49f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212034816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787338661.242012:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338661.242026:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbf43d80c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787338661.242039:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212034816 00000100:00100000:3.0:1787338661.242043:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212034816 00000100:00100000:3.0:1787338661.242063:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1787338661.242069:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4012450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+17:5836:x1874160212034816:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787338661.242227:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4012450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+17:5836:x1874160212034816:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 157us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338661.242234:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1787338661.242293:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbffa49f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212034816:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787338661.244009:0:11203:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1787338661.244091:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1787338661.244119:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787338661.244131:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbf7ea5200/0x83671231080c14fd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c1504 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338661.244144:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.153@tcp lock: ffff90bbf7ea5200/0x83671231080c14fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c1504 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787338661.244154:0:5836:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787338661.244157:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90bbc9632800 from 7 10000000:01000000:1.0:1787338661.244160:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787338661.244195:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bc021c9200/0x83671231080c150b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338661.244204:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.153@tcp lock: ffff90bc021c9200/0x83671231080c150b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338661.244216:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.153@tcp lock: ffff90bc021c9200/0x83671231080c150b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338661.244241:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf3e90a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212034944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787338661.244306:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338661.244350:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbff9b7840 going to sleep for 11 seconds 00000100:00100000:0.0:1787338661.246075:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212034944 00000100:00100000:0.0:1787338661.246086:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212034944 00000100:00100000:0.0:1787338661.246148:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1787338661.246159:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4010850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+17:5836:x1874160212034944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787338661.246173:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787338661.246189:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90bbc0030400/0x83671231080c1512 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x83671231080c150b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338661.246215:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bbc0030400/0x83671231080c1512 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x83671231080c150b expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338661.246228:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90bbc0030400/0x83671231080c1512 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c150b expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338661.246238:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbc0030400, rc 0) 00000100:00100000:0.0:1787338661.246304:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4010850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+18:5836:x1874160212034944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 146us (1996us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338661.246311:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1787338661.246332:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf3e90a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212034944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787338661.246351:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.153@tcp lock: ffff90bc021c9200/0x83671231080c150b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c1512 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338661.246361:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.153@tcp lock: ffff90bc021c9200/0x83671231080c150b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x83671231080c1512 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338661.246428:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf3e90a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212035072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787338661.246453:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338661.246471:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbff9b7840 going to sleep for 11 seconds 00000100:00100000:2.0:1787338661.246866:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212035072 00000100:00100000:2.0:1787338661.246902:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212035072 00000100:00100000:2.0:1787338661.246934:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1787338661.246941:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4010050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+18:5836:x1874160212035072:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787338661.247178:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4010050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+18:5836:x1874160212035072:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 237us (723us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338661.247186:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1787338661.247206:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf3e90a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212035072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787338661.247239:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf3e90a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212035200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787338661.247279:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338661.247315:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbff9b7840 going to sleep for 11 seconds 00000100:00100000:2.0:1787338661.248076:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212035200 00000100:00100000:2.0:1787338661.248082:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212035200 00000100:00100000:2.0:1787338661.248120:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1787338661.248130:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4010450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+18:5836:x1874160212035200:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787338661.248287:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4010450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+18:5836:x1874160212035200:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 159us (1006us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338661.248295:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1787338661.248338:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf3e90a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212035200:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787338661.249103:0:11205:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000100:00100000:0.0:1787338661.249261:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338661.249294:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192077056 00000100:00100000:0.0:1787338661.249298:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192077056 00000100:00100000:0.0:1787338661.249327:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 241 00000100:00100000:0.0:1787338661.249335:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4013450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+13:5598:x1874160192077056:12345-192.168.201.53@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787338661.249547:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4013450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+13:5598:x1874160192077056:12345-192.168.201.53@tcp:501:ll_cfg_requeue.0 Request processed in 212us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338661.249555:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 241 00000020:01000000:3.0:1787338661.256613:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1787338661.256654:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787338661.256667:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bc021c9200/0x83671231080c150b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c1512 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338661.256680:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.153@tcp lock: ffff90bc021c9200/0x83671231080c150b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c1512 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787338661.256692:0:5836:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787338661.256694:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90bbd0622000 from 7 10000000:01000000:3.0:1787338661.256697:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787338661.256744:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbf7ea4400/0x83671231080c1519 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338661.256753:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.153@tcp lock: ffff90bbf7ea4400/0x83671231080c1519 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338661.256768:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.153@tcp lock: ffff90bbf7ea4400/0x83671231080c1519 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338661.257979:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbffa49f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212035328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787338661.258050:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338661.258103:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbf43d80c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787338661.258152:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212035328 00000100:00100000:0.0:1787338661.258160:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212035328 00000100:00100000:0.0:1787338661.258219:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1787338661.258232:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4013050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+18:5836:x1874160212035328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787338661.258250:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787338661.258268:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90bbc0031400/0x83671231080c1520 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x83671231080c1519 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338661.258299:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bbc0031400/0x83671231080c1520 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x83671231080c1519 expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338661.258310:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90bbc0031400/0x83671231080c1520 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c1519 expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338661.258322:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbc0031400, rc 0) 00000100:00100000:0.0:1787338661.258364:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4013050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+19:5836:x1874160212035328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338661.258374:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1787338661.258583:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbffa49f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212035328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787338661.258602:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.153@tcp lock: ffff90bbf7ea4400/0x83671231080c1519 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c1520 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338661.258613:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.153@tcp lock: ffff90bbf7ea4400/0x83671231080c1519 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x83671231080c1520 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338661.258676:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbffa49f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212035456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787338661.258700:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338661.258731:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbf43d80c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787338661.258807:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212035456 00000100:00100000:0.0:1787338661.258815:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212035456 00000100:00100000:0.0:1787338661.258845:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1787338661.258862:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4012850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+19:5836:x1874160212035456:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787338661.259139:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4012850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+19:5836:x1874160212035456:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 278us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338661.259149:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1787338661.259623:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbffa49f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212035456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787338661.259656:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbffa49f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212035584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787338661.259693:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338661.259720:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbf43d80c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787338661.261074:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212035584 00000100:00100000:0.0:1787338661.261082:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212035584 00000100:00100000:0.0:1787338661.261131:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1787338661.261140:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4013c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+19:5836:x1874160212035584:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787338661.261338:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4013c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+19:5836:x1874160212035584:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 200us (1644us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338661.261344:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1787338661.261387:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbffa49f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212035584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787338661.263380:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338661.263602:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192077184 00000100:00100000:0.0:1787338661.263610:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192077184 00000100:00100000:0.0:1787338661.263667:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 245 00000100:00100000:0.0:1787338661.263679:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4011850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+13:5598:x1874160192077184:12345-192.168.201.53@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787338661.263921:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4011850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+13:5598:x1874160192077184:12345-192.168.201.53@tcp:503:ll_cfg_requeue.0 Request processed in 243us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338661.263929:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 245 00000040:00080000:0.0:1787338661.269266:0:11206:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1787338661.270547:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1787338661.270576:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787338661.270587:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbf7ea4400/0x83671231080c1519 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c1520 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338661.270599:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.153@tcp lock: ffff90bbf7ea4400/0x83671231080c1519 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c1520 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338661.560857:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787338662.582330:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787338663.036415:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787338663.036439:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbd172c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874160212035712:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787338663.036509:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338663.036593:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212035712 00000100:00100000:2.0:1787338663.036601:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212035712 00000100:00100000:2.0:1787338663.036653:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787338663.036662:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbd172dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874160212035712:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787338663.036897:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1787338663.038517:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787338663.038603:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbd172dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874160212035712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1939us (2091us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338663.038613:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:2.0:1787338663.038661:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbd172c700 x1874160212035712/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787338679 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787338663.038681:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbd172c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874160212035712:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787338663.542210:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbef17b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1874160212036096:0@lo:400:kworker.0 00000100:00100000:0.0:1787338663.542297:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338663.542355:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787338663.542362:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbef17ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874160212036224:0@lo:400:kworker.0 00000100:00100000:0.0:1787338663.542387:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338663.542436:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212036096 00000100:00100000:0.0:1787338663.542443:0:7647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212036096 00000100:00100000:0.0:1787338663.542496:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787338663.542505:0:7647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbef179180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874160212036096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787338663.542568:0:7647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbef179180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874160212036096:12345-0@lo:400:kworker.0 Request processed in 64us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338663.542576:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787338663.542599:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212036224 00000100:00100000:0.0:1787338663.542603:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212036224 00000100:00100000:0.0:1787338663.542629:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787338663.542635:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbef17b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874160212036224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787338663.542666:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbef17b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874160212036224:12345-0@lo:400:kworker.0 Request processed in 31us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338663.542672:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:0.0:1787338663.542688:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787338663.542717:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbef17ad80 x1874160212036224/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787338679 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787338663.542730:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbef17ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874160212036224:0@lo:400:kworker.0 00000100:00100000:0.0:1787338663.542742:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbef17b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1874160212036096:0@lo:400:kworker.0 00000100:00100000:1.0:1787338663.542898:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbef179f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d79243c8-b367-45ff-8d76-fbaa4be8becb:3316:1874160212035840:0@lo:400:kworker.0 00000100:00100000:1.0:1787338663.542931:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338663.542953:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbef178a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1874160212036352:0@lo:400:kworker.0 00000100:00100000:1.0:1787338663.542988:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338663.543008:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787338663.543014:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbef17bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874160212035968:0@lo:400:kworker.0 00000100:00100000:1.0:1787338663.543035:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338663.543053:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbef178380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874160212036480:0@lo:400:kworker.0 00000100:00100000:1.0:1787338663.543074:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338663.543100:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212036352 00000100:00100000:1.0:1787338663.543104:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212036352 00000100:00100000:1.0:1787338663.543128:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212035968 00000100:00100000:1.0:1787338663.543132:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212035968 00000100:00100000:1.0:1787338663.543147:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787338663.543153:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf3e91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874160212036352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787338663.543199:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf3e91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874160212036352:12345-0@lo:400:kworker.0 Request processed in 45us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338663.543206:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787338663.543218:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787338663.543225:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf3e90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874160212035968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787338663.543251:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf3e90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874160212035968:12345-0@lo:400:kworker.0 Request processed in 27us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338663.543256:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787338663.543287:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212036480 00000100:00100000:1.0:1787338663.543291:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212036480 00000100:00100000:1.0:1787338663.543315:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787338663.543321:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf3e93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1874160212036480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787338663.543349:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf3e93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1874160212036480:12345-0@lo:400:kworker.0 Request processed in 29us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338663.543355:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787338663.543383:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbef17bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874160212035968:0@lo:400:kworker.0 00010000:00080000:1.0:1787338663.543392:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbef178380 x1874160212036480/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787338679 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787338663.543402:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbef178380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874160212036480:0@lo:400:kworker.0 00000100:00100000:1.0:1787338663.543410:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbef178a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1874160212036352:0@lo:400:kworker.0 00000100:00100000:0.0:1787338663.543661:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212035840 00000100:00100000:0.0:1787338663.543666:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212035840 00000100:00100000:0.0:1787338663.543699:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1787338663.543706:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4013850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+19:3316:x1874160212035840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787338663.543744:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4013850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+19:3316:x1874160212035840:12345-0@lo:400:kworker.0 Request processed in 38us (811us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338663.543750:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00080000:0.0:1787338663.543783:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787338663.543787:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787338663.543804:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbef179f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d79243c8-b367-45ff-8d76-fbaa4be8becb:3316:1874160212035840:0@lo:400:kworker.0 00010000:00010000:3.0:1787338663.607049:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787338663.748587:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338663.748641:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338663.748669:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338663.748715:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192077568 00000100:00100000:3.0:1787338663.748726:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192077568 00000100:00100000:3.0:1787338663.748792:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192077440 00000100:00100000:3.0:1787338663.748795:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192077440 00000100:00100000:3.0:1787338663.748822:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 94 00000100:00100000:3.0:1787338663.748833:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e810cb1b-6993-4b6e-89c4-e8961cf35b35+5:2356:x1874160192077568:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:3.0:1787338663.748971:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e810cb1b-6993-4b6e-89c4-e8961cf35b35+5:2356:x1874160192077568:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 140us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338663.748980:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 94 00000100:00100000:3.0:1787338663.751249:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 95 00000100:00100000:3.0:1787338663.751269:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+6:2356:x1874160192077440:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:3.0:1787338663.751333:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+6:2356:x1874160192077440:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 73us (2663us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338663.751341:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 95 00000100:00080000:3.0:1787338663.751370:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787338663.751746:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192077312 00000100:00100000:0.0:1787338663.751755:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192077312 00000100:00100000:0.0:1787338663.752012:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 247 00000100:00100000:0.0:1787338663.752022:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4010c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+13:2356:x1874160192077312:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:0.0:1787338663.752054:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4010c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+13:2356:x1874160192077312:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 35us (3478us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338663.752061:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 247 00000100:00100000:2.0:1787338664.055551:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787338664.055572:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbd172c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874160212036608:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787338664.055637:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338664.056041:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212036608 00000100:00100000:0.0:1787338664.056049:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212036608 00000100:00100000:0.0:1787338664.056094:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787338664.056104:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbd172d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874160212036608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787338664.056137:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787338664.056194:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbd172d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874160212036608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338664.056201:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:3.0:1787338664.056297:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbd172c700 x1874160212036608/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787338680 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787338664.056316:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbd172c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874160212036608:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787338664.632638:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787338664.775465:0:11373:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg153-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787338665.654893:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787338666.679331:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338667.706700:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787338668.151237:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbd172c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874160212036736:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787338668.151341:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338668.153274:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212036736 00000100:00100000:2.0:1787338668.153288:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212036736 00000100:00100000:2.0:1787338668.153370:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787338668.153381:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874160212036736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787338668.153420:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787338668.153648:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874160212036736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 268us (2305us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338668.153656:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:2.0:1787338668.153715:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbd172c700 x1874160212036736/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787338684 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787338668.153738:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbd172c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874160212036736:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787338668.158428:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:2.0:1787338668.654663:0:11473:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 14:57:47 (1787338667) === 00000100:00100000:1.0:1787338668.669596:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbffa2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874160212036992:0@lo:400:kworker.0 00000100:00100000:1.0:1787338668.669678:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338668.669734:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbffa2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874160212037504:0@lo:400:kworker.0 00000100:00100000:1.0:1787338668.669761:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338668.669789:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787338668.669794:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf3e92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d79243c8-b367-45ff-8d76-fbaa4be8becb:3317:1874160212036864:0@lo:400:kworker.0 00000100:00100000:1.0:1787338668.669817:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338668.669847:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbffa2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1874160212037376:0@lo:400:kworker.0 00000100:00100000:1.0:1787338668.669865:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338668.669910:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbffa2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1874160212037120:0@lo:400:kworker.0 00000100:00100000:1.0:1787338668.669930:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338668.669946:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787338668.669951:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbffa2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874160212037248:0@lo:400:kworker.0 00000100:00100000:1.0:1787338668.669967:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338668.670142:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212036992 00000100:00100000:1.0:1787338668.670149:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212036992 00000100:00100000:1.0:1787338668.670196:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212037376 00000100:00100000:1.0:1787338668.670199:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212037376 00000100:00100000:1.0:1787338668.670218:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212037120 00000100:00100000:1.0:1787338668.670220:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212037120 00000100:00100000:1.0:1787338668.670234:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787338668.670241:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874160212036992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787338668.670293:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874160212036992:12345-0@lo:400:kworker.0 Request processed in 51us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338668.670301:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787338668.670317:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787338668.670323:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1874160212037376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787338668.670350:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1874160212037376:12345-0@lo:400:kworker.0 Request processed in 27us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338668.670366:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787338668.670377:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787338668.670382:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874160212037120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787338668.670409:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874160212037120:12345-0@lo:400:kworker.0 Request processed in 27us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338668.670414:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787338668.670511:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212037504 00000100:00100000:1.0:1787338668.670515:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212037504 00000100:00100000:1.0:1787338668.670633:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212037248 00000100:00100000:1.0:1787338668.670637:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212037248 00000100:00100000:0.0:1787338668.672195:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787338668.672210:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1874160212037504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787338668.672272:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1874160212037504:12345-0@lo:400:kworker.0 Request processed in 68us (2509us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338668.672279:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787338668.672298:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787338668.672305:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1874160212037248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787338668.672345:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1874160212037248:12345-0@lo:400:kworker.0 Request processed in 41us (2377us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338668.672352:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787338668.672453:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212036864 00000100:00100000:1.0:1787338668.672459:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212036864 00000100:00100000:1.0:1787338668.672495:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1787338668.672503:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4011c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+19:3317:x1874160212036864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787338668.672536:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4011c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+19:3317:x1874160212036864:12345-0@lo:400:kworker.0 Request processed in 34us (2717us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338668.672542:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00080000:1.0:1787338668.672576:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787338668.672581:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787338668.672610:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbffa2dc00 x1874160212037248/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787338684 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787338668.672625:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbffa2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874160212037248:0@lo:400:kworker.0 00000100:00100000:1.0:1787338668.672640:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbffa2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1874160212037120:0@lo:400:kworker.0 00000100:00100000:1.0:1787338668.673062:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf3e92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d79243c8-b367-45ff-8d76-fbaa4be8becb:3317:1874160212036864:0@lo:400:kworker.0 00000100:00100000:1.0:1787338668.673077:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbffa2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1874160212037376:0@lo:400:kworker.0 00000100:00100000:1.0:1787338668.673096:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbffa2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874160212036992:0@lo:400:kworker.0 00010000:00080000:1.0:1787338668.673118:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbffa2fb80 x1874160212037504/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787338684 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787338668.673129:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbffa2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874160212037504:0@lo:400:kworker.0 00010000:00010000:0.0:1787338668.726151:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787338668.872176:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338668.872212:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338668.872239:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338668.872307:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192077696 00000100:00100000:0.0:1787338668.872318:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192077696 00000100:00100000:0.0:1787338668.872373:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 249 00000100:00100000:0.0:1787338668.872382:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4011450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+13:2358:x1874160192077696:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:0.0:1787338668.872455:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4011450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+13:2358:x1874160192077696:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 75us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338668.872462:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 249 00000100:00100000:3.0:1787338668.872611:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192077952 00000100:00100000:3.0:1787338668.872616:0:7647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192077952 00000100:00100000:3.0:1787338668.872664:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192077824 00000100:00100000:3.0:1787338668.872667:0:7647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192077824 00000100:00100000:3.0:1787338668.872691:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 99 00000100:00100000:3.0:1787338668.872698:0:7647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbd172c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e810cb1b-6993-4b6e-89c4-e8961cf35b35+5:2358:x1874160192077952:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:3.0:1787338668.872732:0:7647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbd172c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e810cb1b-6993-4b6e-89c4-e8961cf35b35+5:2358:x1874160192077952:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 35us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338668.872754:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 99 00000100:00100000:3.0:1787338668.872766:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 100 00000100:00100000:3.0:1787338668.872771:0:7647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbd172ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+6:2358:x1874160192077824:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:3.0:1787338668.872789:0:7647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbd172ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+6:2358:x1874160192077824:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 18us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338668.872794:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 100 00000100:00080000:0.0:1787338668.872970:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787338669.084013:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338669.084059:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338669.084199:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192078080 00000100:00100000:3.0:1787338669.084209:0:7647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192078080 00000100:00100000:3.0:1787338669.084272:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 14 00000100:00100000:3.0:1787338669.084284:0:7647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4095180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+6:2357:x1874160192078080:12345-192.168.201.53@tcp:41:mkdir.0 00000004:00000024:3.0:1787338669.084331:0:7647:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787338669.084430:0:7647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4095180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+6:2357:x1874160192078080:12345-192.168.201.53@tcp:41:mkdir.0 Request processed in 139us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338669.084439:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 14 00000100:00100000:0.0:1787338669.084662:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192078208 00000100:00100000:0.0:1787338669.084667:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192078208 00000100:00100000:0.0:1787338669.084711:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 0 00000100:00100000:0.0:1787338669.084718:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4097480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:83642291-0761-4205-9531-7fd25bc2d48e+6:9676:x1874160192078208:12345-192.168.201.53@tcp:700:mkdir.0 00000100:00100000:0.0:1787338669.084765:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4097480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:83642291-0761-4205-9531-7fd25bc2d48e+6:9676:x1874160192078208:12345-192.168.201.53@tcp:700:mkdir.0 Request processed in 48us (705us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338669.084772:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 0 00000100:00100000:2.0:1787338669.093542:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338669.093663:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192078464 00000100:00100000:3.0:1787338669.093674:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192078464 00000100:00100000:3.0:1787338669.093733:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 15 00000100:00100000:3.0:1787338669.093743:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4095880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+6:9676:x1874160192078464:12345-192.168.201.53@tcp:36:mkdir.0 00010000:00010000:3.0:1787338669.093798:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787338669.093844:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc14a9e00/0x83671231080c1408 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab5cc expref: 6 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.093865:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90bbd38d6b00) 00010000:00010000:3.0:1787338669.093925:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787338669.094419:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4600/0x83671231080c1527 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.094444:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4600/0x83671231080c1527 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.094454:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4600/0x83671231080c1527 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.094483:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c152e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.094491:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c152e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.094498:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c152e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787338669.096433:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:3.0:1787338669.096448:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4600/0x83671231080c1527 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.096458:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4600/0x83671231080c1527 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.096465:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4600/0x83671231080c1527 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.096472:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea4600 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:3.0:1787338669.096476:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4600/0x83671231080c1527 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.096483:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4600/0x83671231080c1527 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.096505:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90bbd38d6500) 00010000:00010000:3.0:1787338669.096508:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787338669.096514:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4600/0x83671231080c1527 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.096519:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4600/0x83671231080c1527 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787338669.096547:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000063b3e747 reply state 000000009d56fcd4 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c152e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338669.096555:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787338669.096643:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4095880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+7:9676:x1874160192078464:12345-192.168.201.53@tcp:36:mkdir.0 Request processed in 2899us (3117us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1787338669.096652:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 15 00010000:00010000:1.0:1787338669.101451:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c152e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338669.101469:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c152e lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338669.101477:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c152e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338669.101484:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea5a00 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:1.0:1787338669.101488:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c152e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338669.101496:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c152e lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338669.101517:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff90bbd38d6000) 00010000:00010000:1.0:1787338669.101521:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787338669.101525:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c152e lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338669.101531:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c152e lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338669.119834:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338669.119939:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192078592 00000100:00100000:3.0:1787338669.119948:0:7647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192078592 00000100:00100000:3.0:1787338669.120010:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 16 00000100:00100000:3.0:1787338669.120021:0:7647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4096680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+6:9677:x1874160192078592:12345-192.168.201.53@tcp:101:chmod.0 00010000:00010000:3.0:1787338669.120045:0:7647:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787338669.120070:0:7647:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4600/0x83671231080c1535 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab651 expref: -99 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.120139:0:7647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5c00/0x83671231080c153c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.120152:0:7647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5c00/0x83671231080c153c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.120178:0:7647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5c00/0x83671231080c153c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787338669.120235:0:7647:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1787338669.120237:0:7647:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1787338669.120277:0:7647:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5c00/0x83671231080c153c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.120304:0:7647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4600/0x83671231080c1535 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab651 expref: 8 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.120323:0:7647:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5c00/0x83671231080c153c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab651 expref: 7 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.120332:0:7647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90bbd38d6500) 00010000:00010000:3.0:1787338669.120335:0:7647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787338669.120339:0:7647:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf7ea5c00, rc 0) 00000100:00100000:3.0:1787338669.120400:0:7647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4096680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+7:9677:x1874160192078592:12345-192.168.201.53@tcp:101:chmod.0 Request processed in 380us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338669.120407:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 16 00000100:00100000:3.0:1787338669.123957:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338669.129076:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192078848 00000100:00100000:1.0:1787338669.129109:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192078848 00000100:00100000:1.0:1787338669.129200:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 17 00000100:00100000:1.0:1787338669.129212:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+7:9677:x1874160192078848:12345-192.168.201.53@tcp:36:chmod.0 00010000:00010000:1.0:1787338669.129269:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787338669.129296:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5c00/0x83671231080c153c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab651 expref: 7 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338669.129315:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90bbd38d6500) 00010000:00010000:1.0:1787338669.129325:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787338669.129347:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bc021c8c00/0x83671231080c1543 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338669.129357:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bc021c8c00/0x83671231080c1543 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338669.129364:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bc021c8c00/0x83671231080c1543 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787338669.129696:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000090efd61b reply state 00000000b1df909a transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff90bc021c8c00/0x83671231080c1543 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338669.129705:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1787338669.129717:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:1.0:1787338669.129812:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+8:9677:x1874160192078848:12345-192.168.201.53@tcp:36:chmod.0 Request processed in 601us (5862us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1787338669.129819:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 17 00010000:00010000:3.0:1787338669.137760:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90bc021c8c00/0x83671231080c1543 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.137779:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bc021c8c00/0x83671231080c1543 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.137787:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bc021c8c00/0x83671231080c1543 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.137805:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bc021c8c00 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:3.0:1787338669.137810:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bc021c8c00/0x83671231080c1543 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.137818:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bc021c8c00/0x83671231080c1543 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.137835:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90bbc2a93a00) 00010000:00010000:3.0:1787338669.137839:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787338669.137844:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bc021c8c00/0x83671231080c1543 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.137850:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bc021c8c00/0x83671231080c1543 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338669.161357:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338669.161605:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192078976 00000100:00100000:0.0:1787338669.161616:0:7647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192078976 00000100:00100000:0.0:1787338669.161723:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 18 00000100:00100000:0.0:1787338669.161734:0:7647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+7:9678:x1874160192078976:12345-192.168.201.53@tcp:101:chown.0 00010000:00010000:0.0:1787338669.161758:0:7647:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787338669.161783:0:7647:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c154a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab658 expref: -99 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338669.161861:0:7647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031800/0x83671231080c1551 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338669.161909:0:7647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031800/0x83671231080c1551 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338669.161921:0:7647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031800/0x83671231080c1551 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787338669.161978:0:7647:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1787338669.161982:0:7647:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1787338669.162025:0:7647:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031800/0x83671231080c1551 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338669.162052:0:7647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c154a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab658 expref: 9 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338669.162070:0:7647:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031800/0x83671231080c1551 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab658 expref: 8 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338669.162079:0:7647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90bbeb14dd00) 00010000:00010000:0.0:1787338669.162082:0:7647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787338669.162086:0:7647:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbc0031800, rc 0) 00000100:00100000:2.0:1787338669.162387:0:7647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+8:9678:x1874160192078976:12345-192.168.201.53@tcp:101:chown.0 Request processed in 648us (1032us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338669.162397:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 18 00000100:00100000:2.0:1787338669.163972:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338669.164066:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192079104 00000100:00100000:3.0:1787338669.164075:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192079104 00000100:00100000:3.0:1787338669.164259:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 19 00000100:00100000:3.0:1787338669.164272:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4094700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+8:9678:x1874160192079104:12345-192.168.201.53@tcp:101:chown.0 00010000:00010000:3.0:1787338669.164290:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787338669.164308:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4600/0x83671231080c1558 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab65f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.164361:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4200/0x83671231080c155f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.164374:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4200/0x83671231080c155f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.164401:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4200/0x83671231080c155f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.164414:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c1566 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.164729:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c1566 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.164739:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c1566 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.164826:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4c00/0x83671231080c156d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.164833:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4c00/0x83671231080c156d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.164839:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4c00/0x83671231080c156d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787338669.164870:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:3.0:1787338669.164895:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787338669.164917:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4c00/0x83671231080c156d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.164927:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4200/0x83671231080c155f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.164932:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4200/0x83671231080c155f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.164948:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4200/0x83671231080c155f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.164953:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea4200 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:3.0:1787338669.164956:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4200/0x83671231080c155f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.164963:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4200/0x83671231080c155f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.164973:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90bbeb14dd00) 00010000:00010000:3.0:1787338669.164977:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787338669.164981:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4200/0x83671231080c155f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.164987:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4200/0x83671231080c155f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.165000:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c1566 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.165006:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c1566 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.165012:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c1566 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.165017:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea5800 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:3.0:1787338669.165020:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c1566 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.165037:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c1566 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.165046:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff90bbd38d6b00) 00010000:00010000:3.0:1787338669.165048:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787338669.165051:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c1566 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.165057:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c1566 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.165086:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4600/0x83671231080c1558 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab65f expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.165098:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4c00/0x83671231080c156d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab65f expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.165105:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff90bbd38d6a00) 00010000:00010000:3.0:1787338669.165120:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787338669.165123:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf7ea4c00, rc 0) 00000100:00100000:3.0:1787338669.165185:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4094700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+9:9678:x1874160192079104:12345-192.168.201.53@tcp:101:chown.0 Request processed in 916us (1219us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338669.165192:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 19 00000100:00100000:0.0:1787338669.172849:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338669.173077:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192079360 00000100:00100000:1.0:1787338669.173086:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192079360 00000100:00100000:2.0:1787338669.173683:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 20 00000100:00100000:2.0:1787338669.173695:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbef179f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+9:9678:x1874160192079360:12345-192.168.201.53@tcp:36:chown.0 00010000:00010000:2.0:1787338669.173760:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787338669.173787:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4c00/0x83671231080c156d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab65f expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338669.173807:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff90bbd38d6a00) 00010000:00010000:2.0:1787338669.173816:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787338669.173838:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3600/0x83671231080c1574 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338669.173851:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3600/0x83671231080c1574 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338669.173860:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3600/0x83671231080c1574 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338669.181734:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbffa2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874160212037632:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787338669.181816:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338669.182017:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212037632 00000100:00100000:1.0:1787338669.182026:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212037632 00000100:00100000:1.0:1787338669.182077:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787338669.182086:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4097100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874160212037632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787338669.182117:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787338669.182160:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4097100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874160212037632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338669.182167:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:1.0:1787338669.182214:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbffa2fb80 x1874160212037632/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787338685 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787338669.182233:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbffa2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874160212037632:0@lo:13:osp-pre-1-0.0 00000001:00080000:3.0:1787338669.220437:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000001:00080000:3.0:1787338669.220456:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:0.0:1787338669.220728:0:5840:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bed13885 reply state 000000002c2d3d8d transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3600/0x83671231080c1574 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338669.220745:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1787338669.220944:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00080000:0.0:1787338669.221163:0:5840:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1787338669.221292:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbef179f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+7:9678:x1874160192079360:12345-192.168.201.53@tcp:36:chown.0 Request processed in 47594us (48447us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1787338669.221301:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 20 00010000:00010000:3.0:1787338669.222347:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3600/0x83671231080c1574 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.222361:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3600/0x83671231080c1574 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.222379:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3600/0x83671231080c1574 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.222386:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e3600 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:3.0:1787338669.222392:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3600/0x83671231080c1574 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.222400:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3600/0x83671231080c1574 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.222418:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff90bbdee56100) 00010000:00010000:3.0:1787338669.222434:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787338669.222438:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3600/0x83671231080c1574 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.222445:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3600/0x83671231080c1574 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338669.240553:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338669.240646:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192079488 00000100:00100000:1.0:1787338669.240656:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192079488 00000100:00100000:1.0:1787338669.240707:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 21 00000100:00100000:1.0:1787338669.240717:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbef17b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+6:9679:x1874160192079488:12345-192.168.201.53@tcp:101:touch.500 00010000:00010000:1.0:1787338669.240756:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787338669.240775:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bc021c8800/0x83671231080c157b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab666 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787338669.244208:0:5841:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 3382us 00010000:00010000:3.0:1787338669.265020:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4600/0x83671231080c1582 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.265044:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4600/0x83671231080c1582 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.265057:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4600/0x83671231080c1582 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.265072:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c1589 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.265079:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c1589 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.265094:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c1589 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.265587:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4200/0x83671231080c1590 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.265594:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4200/0x83671231080c1590 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.265601:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4200/0x83671231080c1590 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787338669.265667:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787338669.265670:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787338669.265921:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4200/0x83671231080c1590 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.265937:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4600/0x83671231080c1582 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.265944:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4600/0x83671231080c1582 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.265951:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4600/0x83671231080c1582 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.265956:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea4600 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:3.0:1787338669.265959:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4600/0x83671231080c1582 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.265964:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4600/0x83671231080c1582 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.265981:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90bbeb14dd00) 00010000:00010000:3.0:1787338669.265984:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787338669.265987:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4600/0x83671231080c1582 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.265991:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4600/0x83671231080c1582 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.265999:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c1589 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.266003:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c1589 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.266008:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c1589 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.266013:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea5800 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:3.0:1787338669.266016:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c1589 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.266022:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c1589 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.266029:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff90bbd38d6b00) 00010000:00010000:3.0:1787338669.266032:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787338669.266035:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c1589 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.266041:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c1589 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.266090:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bc021c8800/0x83671231080c157b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab666 expref: 8 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.266102:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4200/0x83671231080c1590 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab666 expref: 7 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.266107:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff90bbd38d6200) 00010000:00010000:3.0:1787338669.266110:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787338669.266112:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf7ea4200, rc 0) 00000100:00100000:3.0:1787338669.266188:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbef17b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+7:9679:x1874160192079488:12345-192.168.201.53@tcp:101:touch.500 Request processed in 25470us (25643us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338669.266197:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 21 00000100:00100000:0.0:1787338669.270709:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338669.270772:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192079744 00000100:00100000:3.0:1787338669.270789:0:7647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192079744 00000100:00100000:3.0:1787338669.270839:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 22 00000100:00100000:3.0:1787338669.270847:0:7647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbef17ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+7:9679:x1874160192079744:12345-192.168.201.53@tcp:101:touch.500 00010000:00010000:3.0:1787338669.270865:0:7647:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787338669.270900:0:7647:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4a00/0x83671231080c1597 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab66d expref: -99 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.271215:0:7647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c159e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.271230:0:7647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c159e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.271239:0:7647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c159e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.271258:0:7647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5000/0x83671231080c15a5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.271263:0:7647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5000/0x83671231080c15a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.271267:0:7647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5000/0x83671231080c15a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787338669.271992:0:7647:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:3.0:1787338669.272232:0:7647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4c00/0x83671231080c15ac lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.272240:0:7647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4c00/0x83671231080c15ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.272246:0:7647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4c00/0x83671231080c15ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.272271:0:7647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c159e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.272276:0:7647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c159e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.272281:0:7647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c159e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.272284:0:7647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea5400 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:3.0:1787338669.272287:0:7647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c159e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.272300:0:7647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c159e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.272310:0:7647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff90bbd38d6200) 00010000:00010000:3.0:1787338669.272312:0:7647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787338669.272315:0:7647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c159e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.272319:0:7647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c159e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787338669.272329:0:7647:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000add6961d reply state 00000000befcc96d transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5000/0x83671231080c15a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338669.272335:0:7647:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787338669.272357:0:7647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4a00/0x83671231080c1597 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab66d expref: 10 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.272366:0:7647:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4c00/0x83671231080c15ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab66d expref: 9 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.272371:0:7647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff90bbd38d6a00) 00010000:00010000:3.0:1787338669.272372:0:7647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787338669.272374:0:7647:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf7ea4c00, rc 0) 00000100:00100000:3.0:1787338669.272452:0:7647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbef17ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+10:9679:x1874160192079744:12345-192.168.201.53@tcp:101:touch.500 Request processed in 1604us (1750us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1787338669.272460:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 22 00000100:00100000:1.0:1787338669.280460:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338669.280502:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192080000 00000100:00100000:2.0:1787338669.280512:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192080000 00000100:00100000:2.0:1787338669.280575:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 23 00000100:00100000:2.0:1787338669.280585:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+10:9679:x1874160192080000:12345-192.168.201.53@tcp:36:touch.500 00010000:00010000:2.0:1787338669.280639:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787338669.280665:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4c00/0x83671231080c15ac lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab66d expref: 10 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338669.280686:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff90bbd38d6a00) 00010000:00010000:2.0:1787338669.280700:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787338669.280720:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5000/0x83671231080c15a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.280750:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5000/0x83671231080c15a5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.280758:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5000/0x83671231080c15a5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338669.280764:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c15ba lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.280766:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea5000 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:3.0:1787338669.280774:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5000/0x83671231080c15a5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338669.280780:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c15ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338669.280795:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c15ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.280798:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5000/0x83671231080c15a5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.280814:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x6fc107fe (ffff90bbd38d6900) 00010000:00010000:3.0:1787338669.280818:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787338669.280822:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5000/0x83671231080c15a5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.280829:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5000/0x83671231080c15a5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787338669.280949:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004bfd490d reply state 000000005ff4ace9 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c15ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338669.280959:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787338669.281061:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+10:9679:x1874160192080000:12345-192.168.201.53@tcp:36:touch.500 Request processed in 477us (612us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1787338669.281068:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 23 00010000:00010000:3.0:1787338669.289273:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c15ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.289292:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c15ba lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.289301:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c15ba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.289308:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e2a00 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:3.0:1787338669.289328:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c15ba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.289336:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c15ba lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.289354:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff90bbdee56300) 00010000:00010000:3.0:1787338669.289358:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787338669.289362:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c15ba lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.289369:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c15ba lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338669.293659:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338669.293738:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192080128 00000100:00100000:3.0:1787338669.293749:0:7647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192080128 00000100:00100000:3.0:1787338669.293809:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 24 00000100:00100000:3.0:1787338669.293820:0:7647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4096300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+9:9679:x1874160192080128:12345-192.168.201.53@tcp:101:touch.500 00010000:00010000:3.0:1787338669.293844:0:7647:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787338669.293868:0:7647:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5000/0x83671231080c15c1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab674 expref: -99 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.293979:0:7647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5000/0x83671231080c15c1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab674 expref: 10 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.294001:0:7647:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5000/0x83671231080c15c1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab674 expref: 10 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.294022:0:7647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff90bbd38d6900) 00010000:00010000:3.0:1787338669.294025:0:7647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787338669.294035:0:7647:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf7ea5000, rc 0) 00000100:00100000:3.0:1787338669.294097:0:7647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4096300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+10:9679:x1874160192080128:12345-192.168.201.53@tcp:101:touch.500 Request processed in 278us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338669.294104:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 24 00000100:00100000:2.0:1787338669.306575:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338669.306932:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192080256 00000100:00100000:0.0:1787338669.306944:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192080256 00000100:00100000:0.0:1787338669.306985:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 16 00000100:00100000:0.0:1787338669.306994:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4096a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2355:x1874160192080256:12345-192.168.201.53@tcp:8:touch.500 00010000:00080000:0.0:1787338669.307028:0:6691:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 83642291-0761-4205-9531-7fd25bc2d48e@192.168.201.53@tcp t0 exp 0000000000000000 cur 322 last 0 00000020:00000080:0.0:1787338669.307072:0:6691:0:(genops.c:1385:class_connect()) connect: client 83642291-0761-4205-9531-7fd25bc2d48e, cookie 0x83671231080c15c8 00002000:00100000:0.0:1787338669.307084:0:6691:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 83642291-0761-4205-9531-7fd25bc2d48e/ffff90bbc416b800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392c ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787338669.307107:0:6691:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787338669.307351:0:6691:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787338669.307381:0:6691:0:(import.c:65:import_set_state_nolock()) ffff90bbc416f000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787338669.307511:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4096a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:83642291-0761-4205-9531-7fd25bc2d48e+6:2355:x1874160192080256:12345-192.168.201.53@tcp:8:touch.500 Request processed in 516us (944us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338669.307519:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 16 00000100:00100000:0.0:1787338669.317562:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338669.317600:0:10743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192080384 00000100:00100000:1.0:1787338669.317612:0:10743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192080384 00000100:00080000:0.0:1787338669.317671:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787338669.317693:0:10743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 17 00000100:00100000:1.0:1787338669.317717:0:10743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbef179880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:83642291-0761-4205-9531-7fd25bc2d48e+6:0:x1874160192080384:12345-192.168.201.53@tcp:2:touch.500 00000001:00100000:1.0:1787338669.440409:0:6714:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 83642291-0761-4205-9531-7fd25bc2d48e 00000001:00080000:2.0:1787338669.440472:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:3.0:1787338669.440673:0:10743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbef179880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:83642291-0761-4205-9531-7fd25bc2d48e+5:0:x1874160192080384:12345-192.168.201.53@tcp:2:touch.500 Request processed in 122963us (123113us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1787338669.440686:0:10743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 17 00000100:00100000:3.0:1787338669.444565:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338669.444802:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192080640 00000100:00100000:0.0:1787338669.444814:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192080640 00000100:00100000:0.0:1787338669.444970:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 2 00000100:00100000:0.0:1787338669.444981:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:83642291-0761-4205-9531-7fd25bc2d48e+10:9679:x1874160192080640:12345-192.168.201.53@tcp:35:touch.500 00000100:00100000:0.0:1787338669.445454:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:83642291-0761-4205-9531-7fd25bc2d48e+11:9679:x1874160192080640:12345-192.168.201.53@tcp:35:touch.500 Request processed in 473us (897us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1787338669.445476:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 2 00000100:00100000:2.0:1787338669.457050:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338669.457263:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192080768 00000100:00100000:0.0:1787338669.457286:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192080768 00000100:00100000:0.0:1787338669.457343:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 25 00000100:00100000:0.0:1787338669.457353:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4095500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+11:9680:x1874160192080768:12345-192.168.201.53@tcp:101:rm.0 00010000:00010000:0.0:1787338669.457377:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787338669.457397:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031a00/0x83671231080c15cf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab67b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338669.457476:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c15d6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338669.457490:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c15d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338669.457501:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c15d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787338669.457574:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787338669.457579:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787338669.457623:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c15d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338669.457650:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031a00/0x83671231080c15cf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab67b expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338669.457668:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c15d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab67b expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338669.457689:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff90bbd38d6200) 00010000:00010000:0.0:1787338669.457691:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787338669.457694:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbc0030a00, rc 0) 00000100:00100000:0.0:1787338669.458094:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4095500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+12:9680:x1874160192080768:12345-192.168.201.53@tcp:101:rm.0 Request processed in 740us (1052us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338669.458101:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 25 00000100:00100000:3.0:1787338669.461658:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338669.461763:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192081024 00000100:00100000:0.0:1787338669.461774:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192081024 00000100:00100000:0.0:1787338669.461866:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 26 00000100:00100000:0.0:1787338669.461909:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+12:9680:x1874160192081024:12345-192.168.201.53@tcp:101:rm.0 00010000:00010000:0.0:1787338669.461930:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787338669.461950:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c15dd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab682 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787338669.462126:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:0.0:1787338669.462284:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c15dd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab682 expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338669.462299:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90bbeb14dd00) 00010000:00010000:0.0:1787338669.462302:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787338669.462308:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c15dd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab682 expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338669.462335:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbc0030800, rc 0) 00000100:00100000:0.0:1787338669.462393:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+13:9680:x1874160192081024:12345-192.168.201.53@tcp:101:rm.0 Request processed in 519us (742us total) trans 4294967303 rc 301/301 00000100:00100000:0.0:1787338669.462409:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 26 00000100:00100000:3.0:1787338669.466496:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338669.466593:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192081152 00000100:00100000:0.0:1787338669.466604:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192081152 00000100:00100000:0.0:1787338669.466664:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 3 00000100:00100000:0.0:1787338669.466675:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:83642291-0761-4205-9531-7fd25bc2d48e+13:9680:x1874160192081152:12345-192.168.201.53@tcp:37:rm.0 00000100:00100000:0.0:1787338669.470690:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:83642291-0761-4205-9531-7fd25bc2d48e+13:9680:x1874160192081152:12345-192.168.201.53@tcp:37:rm.0 Request processed in 4006us (4194us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338669.470703:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 3 00000100:00100000:0.0:1787338669.473780:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338669.473867:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192081408 00000100:00100000:3.0:1787338669.473931:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192081408 00000100:00100000:2.0:1787338669.474184:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 4 00000100:00100000:2.0:1787338669.474194:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbd894e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:83642291-0761-4205-9531-7fd25bc2d48e+13:9680:x1874160192081408:12345-192.168.201.53@tcp:35:rm.0 00000100:00100000:2.0:1787338669.474427:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbd894e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:83642291-0761-4205-9531-7fd25bc2d48e+14:9680:x1874160192081408:12345-192.168.201.53@tcp:35:rm.0 Request processed in 225us (645us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1787338669.474435:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 4 00000100:00100000:2.0:1787338669.477234:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338669.477424:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192081664 00000100:00100000:3.0:1787338669.477434:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192081664 00000100:00100000:3.0:1787338669.477490:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 27 00000100:00100000:3.0:1787338669.477501:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4094e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+14:9680:x1874160192081664:12345-192.168.201.53@tcp:101:rm.0 00010000:00010000:3.0:1787338669.477527:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787338669.477547:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4a00/0x83671231080c15eb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab689 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.477691:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c15f2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.477706:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c15f2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.477717:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c15f2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787338669.477729:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:3.0:1787338669.477962:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4a00/0x83671231080c15eb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab689 expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.477994:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c15f2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab689 expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.478535:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff90bbd38d6200) 00010000:00010000:3.0:1787338669.478540:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787338669.478544:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf7ea5400, rc 0) 00000100:00100000:2.0:1787338669.478723:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4094e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+16:9680:x1874160192081664:12345-192.168.201.53@tcp:101:rm.0 Request processed in 1221us (1493us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1787338669.478731:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 27 00000100:00100000:3.0:1787338669.481582:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338669.481671:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192081792 00000100:00100000:2.0:1787338669.481681:0:7647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192081792 00000100:00100000:2.0:1787338669.481742:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 28 00000100:00100000:2.0:1787338669.481751:0:7647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+16:9680:x1874160192081792:12345-192.168.201.53@tcp:41:rm.0 00000004:00000024:2.0:1787338669.481804:0:7647:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:2.0:1787338669.481904:0:7647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+16:9680:x1874160192081792:12345-192.168.201.53@tcp:41:rm.0 Request processed in 124us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338669.481911:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 28 00000100:00100000:0.0:1787338669.485036:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338669.485183:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192081920 00000100:00100000:3.0:1787338669.485192:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192081920 00000100:00100000:3.0:1787338669.485237:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 29 00000100:00100000:3.0:1787338669.485244:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbef17a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+16:9680:x1874160192081920:12345-192.168.201.53@tcp:101:rm.0 00010000:00010000:3.0:1787338669.485260:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787338669.485277:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c1600 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab690 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.485324:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4a00/0x83671231080c1607 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.485335:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4a00/0x83671231080c1607 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.485342:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4a00/0x83671231080c1607 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.485350:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4600/0x83671231080c160e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.485370:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4600/0x83671231080c160e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.485374:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4600/0x83671231080c160e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.485490:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5c00/0x83671231080c1615 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.485498:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5c00/0x83671231080c1615 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.485503:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5c00/0x83671231080c1615 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787338669.485524:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:3.0:1787338669.485528:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787338669.485539:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5c00/0x83671231080c1615 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.485549:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5c00/0x83671231080c1615 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.485555:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4a00/0x83671231080c1607 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.485559:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4a00/0x83671231080c1607 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.485563:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4a00/0x83671231080c1607 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.485574:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea4a00 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:3.0:1787338669.485578:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4a00/0x83671231080c1607 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.485583:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4a00/0x83671231080c1607 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.485592:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff90bbd38d6200) 00010000:00010000:3.0:1787338669.485594:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787338669.485597:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4a00/0x83671231080c1607 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.485601:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4a00/0x83671231080c1607 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.485610:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4600/0x83671231080c160e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.485613:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4600/0x83671231080c160e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.485617:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4600/0x83671231080c160e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.485620:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea4600 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:3.0:1787338669.485621:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4600/0x83671231080c160e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.485625:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4600/0x83671231080c160e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.485635:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x6fc107fe (ffff90bbd38d6b00) 00010000:00010000:3.0:1787338669.485637:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787338669.485638:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4600/0x83671231080c160e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.485641:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4600/0x83671231080c160e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.485661:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c1600 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab690 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.485670:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5c00/0x83671231080c1615 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab690 expref: 17 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.485674:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff90bbd38d6900) 00010000:00010000:3.0:1787338669.485675:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787338669.485677:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf7ea5c00, rc 0) 00000100:00100000:3.0:1787338669.485734:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbef17a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+17:9680:x1874160192081920:12345-192.168.201.53@tcp:101:rm.0 Request processed in 489us (705us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338669.485741:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 29 00000100:00100000:3.0:1787338669.487786:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338669.487852:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192082176 00000100:00100000:2.0:1787338669.487858:0:7647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192082176 00000100:00100000:2.0:1787338669.487913:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 30 00000100:00100000:2.0:1787338669.487920:0:7647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+17:9680:x1874160192082176:12345-192.168.201.53@tcp:36:rm.0 00010000:00010000:2.0:1787338669.487955:0:7647:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787338669.487973:0:7647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5c00/0x83671231080c1615 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab690 expref: 17 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338669.487997:0:7647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5000/0x83671231080c15c1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab674 expref: 16 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338669.488013:0:7647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff90bbd38d6900) 00010000:00010000:2.0:1787338669.488023:0:7647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c15d6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab67b expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338669.488029:0:7647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff90bbd38d6200) 00010000:00010000:2.0:1787338669.488031:0:7647:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787338669.488045:0:7647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c161c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338669.488053:0:7647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c161c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338669.488058:0:7647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c161c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338669.488066:0:7647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3600/0x83671231080c1623 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338669.488071:0:7647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3600/0x83671231080c1623 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338669.488074:0:7647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3600/0x83671231080c1623 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338669.488187:0:7647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3800/0x83671231080c162a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338669.488199:0:7647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3800/0x83671231080c162a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338669.488204:0:7647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3800/0x83671231080c162a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787338669.488825:0:7647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:2.0:1787338669.488836:0:7647:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 322329960990ns, next at 323329958599ns, rc = 0 00010000:00010000:2.0:1787338669.489222:0:7647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c1631 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338669.489231:0:7647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c1631 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338669.489237:0:7647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c1631 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338669.489243:0:7647:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c1631 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338669.489247:0:7647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c1631 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338669.489250:0:7647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c1631 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338669.489263:0:7647:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787338669.489279:0:7647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3800/0x83671231080c162a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338669.489285:0:7647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3800/0x83671231080c162a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.489288:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787338669.489295:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c1631 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338669.489297:0:7647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3800/0x83671231080c162a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.489301:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e3200 already unused, calling callback (ffffffffc1546230) 00010000:00010000:2.0:1787338669.489303:0:7647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e3800 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:3.0:1787338669.489305:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c1631 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338669.489306:0:7647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3800/0x83671231080c162a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338669.489313:0:7647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3800/0x83671231080c162a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.489323:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c1631 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338669.489324:0:7647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff90bbdee56900) 00010000:00010000:2.0:1787338669.489327:0:7647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787338669.489330:0:7647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3800/0x83671231080c162a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.489331:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff90bbdee56900) 00010000:00010000:3.0:1787338669.489333:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787338669.489337:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c1631 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338669.489337:0:7647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3800/0x83671231080c162a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.489343:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c1631 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.489355:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338669.489356:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787338669.489356:0:7647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c161c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.489358:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787338669.489362:0:7647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c161c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338669.489367:0:7647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c161c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338669.489372:0:7647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e2c00 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:2.0:1787338669.489375:0:7647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c161c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338669.489388:0:7647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c161c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338669.489394:0:7647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff90bbd38d6200) 00010000:00010000:2.0:1787338669.489396:0:7647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787338669.489398:0:7647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c161c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338669.489401:0:7647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c161c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787338669.489408:0:7647:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000055eb4220 reply state 0000000083eb8099 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3600/0x83671231080c1623 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338669.489423:0:7647:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787338669.489504:0:7647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+16:9680:x1874160192082176:12345-192.168.201.53@tcp:36:rm.0 Request processed in 1578us (1717us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1787338669.489512:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 30 00010000:00010000:3.0:1787338669.490715:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3600/0x83671231080c1623 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.490726:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3600/0x83671231080c1623 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.490733:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3600/0x83671231080c1623 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.490738:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e3600 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:3.0:1787338669.490742:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3600/0x83671231080c1623 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.490749:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3600/0x83671231080c1623 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.490762:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x6fc107fe (ffff90bbdee56a00) 00010000:00010000:3.0:1787338669.490775:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787338669.490779:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3600/0x83671231080c1623 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.490785:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3600/0x83671231080c1623 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338669.492077:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338669.492277:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192082432 00000100:00100000:0.0:1787338669.492286:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192082432 00000100:00100000:0.0:1787338669.492343:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 5 00000100:00100000:0.0:1787338669.492354:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:83642291-0761-4205-9531-7fd25bc2d48e+15:9680:x1874160192082432:12345-192.168.201.53@tcp:35:rm.0 00000100:00100000:0.0:1787338669.492621:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:83642291-0761-4205-9531-7fd25bc2d48e+16:9680:x1874160192082432:12345-192.168.201.53@tcp:35:rm.0 Request processed in 268us (548us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1787338669.492629:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 5 00000100:00100000:0.0:1787338669.493924:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338669.493960:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192082688 00000100:00100000:3.0:1787338669.493969:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192082688 00000100:00100000:3.0:1787338669.494323:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 31 00000100:00100000:3.0:1787338669.494331:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbef178700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+16:9680:x1874160192082688:12345-192.168.201.53@tcp:36:rm.0 00010000:00010000:3.0:1787338669.494368:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787338669.494390:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c15f2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab689 expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.494403:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4200/0x83671231080c1590 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab666 expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.494410:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff90bbd38d6200) 00010000:00010000:3.0:1787338669.494438:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031800/0x83671231080c1551 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab658 expref: 14 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.494447:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90bbeb14dd00) 00010000:00010000:3.0:1787338669.494454:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787338669.494476:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c1638 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.494488:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c1638 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.494508:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c1638 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.494518:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4600/0x83671231080c163f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.494522:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4600/0x83671231080c163f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.494526:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4600/0x83671231080c163f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.494735:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4a00/0x83671231080c1646 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.494740:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4a00/0x83671231080c1646 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.494745:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4a00/0x83671231080c1646 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787338669.495437:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:0.0:1787338669.495450:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4a00/0x83671231080c1646 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338669.495455:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4a00/0x83671231080c1646 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338669.495460:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4a00/0x83671231080c1646 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338669.495472:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea4a00 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:0.0:1787338669.495475:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4a00/0x83671231080c1646 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338669.495480:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4a00/0x83671231080c1646 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338669.495487:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff90bbd38d6000) 00010000:00010000:0.0:1787338669.495489:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787338669.495491:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4a00/0x83671231080c1646 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338669.495494:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4a00/0x83671231080c1646 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338669.495507:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c1638 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338669.495511:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c1638 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338669.495515:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c1638 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338669.495517:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea5800 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:0.0:1787338669.495519:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c1638 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338669.495522:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c1638 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338669.495532:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90bbd38d6b00) 00010000:00010000:0.0:1787338669.495534:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787338669.495535:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c1638 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338669.495539:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c1638 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787338669.495546:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000025de373d reply state 0000000015430239 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4600/0x83671231080c163f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338669.495551:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787338669.495611:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbef178700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+15:9680:x1874160192082688:12345-192.168.201.53@tcp:36:rm.0 Request processed in 1279us (1690us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1787338669.495618:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 31 00010000:00010000:3.0:1787338669.499491:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4600/0x83671231080c163f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.499510:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4600/0x83671231080c163f lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.499517:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4600/0x83671231080c163f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.499524:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea4600 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:3.0:1787338669.499530:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4600/0x83671231080c163f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.499552:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4600/0x83671231080c163f lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.499570:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff90bbd38d6500) 00010000:00010000:3.0:1787338669.499574:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787338669.499578:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4600/0x83671231080c163f lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338669.499584:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4600/0x83671231080c163f lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338669.752399:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338670.774170:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338671.799239:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338672.822109:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787338673.270377:0:7058:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 326111470204ns, next at 327111467382ns, rc = 0 00000100:00100000:3.0:1787338673.270485:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc4094000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874160212037760:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787338673.270564:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338673.270694:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212037760 00000100:00100000:2.0:1787338673.270704:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212037760 00000100:00100000:2.0:1787338673.270837:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787338673.270849:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc91ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874160212037760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787338673.270907:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787338673.270971:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc91ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874160212037760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 124us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338673.270978:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:1.0:1787338673.271693:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbc4094000 x1874160212037760/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787338689 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787338673.271730:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc4094000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874160212037760:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787338673.274710:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787338673.783259:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc91de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1874160212038144:0@lo:400:kworker.0 00000100:00100000:1.0:1787338673.783265:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee44d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1874160212038272:0@lo:400:kworker.0 00000100:00100000:2.0:1787338673.783285:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc91dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874160212038016:0@lo:400:kworker.0 00000100:00100000:0.0:1787338673.783329:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc91de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d79243c8-b367-45ff-8d76-fbaa4be8becb:3316:1874160212037888:0@lo:400:kworker.0 00000100:00100000:3.0:1787338673.783713:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338673.783795:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212038144 00000100:00100000:3.0:1787338673.783803:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212038144 00000100:00100000:3.0:1787338673.783853:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787338673.783864:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee44ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874160212038144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787338673.784042:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee44ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874160212038144:12345-0@lo:400:kworker.0 Request processed in 179us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338673.784051:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787338673.784089:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc91de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1874160212038144:0@lo:400:kworker.0 00000100:00080000:3.0:1787338673.784127:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787338673.790849:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338673.791220:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212038272 00000100:00100000:3.0:1787338673.791243:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212038272 00000100:00100000:3.0:1787338673.791318:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787338673.791328:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874160212038272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787338673.791399:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874160212038272:12345-0@lo:400:kworker.0 Request processed in 72us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338673.791406:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:1.0:1787338673.792048:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787338673.792086:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee44d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1874160212038272:0@lo:400:kworker.0 00000100:00100000:2.0:1787338673.797619:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338673.797722:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212038016 00000100:00100000:3.0:1787338673.797733:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212038016 00000100:00100000:3.0:1787338673.797798:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787338673.797808:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4095c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874160212038016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787338673.798052:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc91dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874160212038016:0@lo:400:kworker.0 00000100:00100000:3.0:1787338673.804152:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4095c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874160212038016:12345-0@lo:400:kworker.0 Request processed in 6334us (6528us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338673.804168:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787338673.814496:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338673.815845:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212037888 00000100:00100000:1.0:1787338673.815857:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212037888 00000100:00100000:1.0:1787338673.815958:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1787338673.815969:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc414f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+19:3316:x1874160212037888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787338673.816056:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc414f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+19:3316:x1874160212037888:12345-0@lo:400:kworker.0 Request processed in 88us (1566us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338673.816063:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1787338673.817756:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee44dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874160212038400:0@lo:400:kworker.0 00000100:00100000:0.0:1787338673.817828:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338673.817918:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc91de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d79243c8-b367-45ff-8d76-fbaa4be8becb:3316:1874160212037888:0@lo:400:kworker.0 00000100:00100000:1.0:1787338673.823046:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212038400 00000100:00100000:1.0:1787338673.823062:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212038400 00000100:00100000:1.0:1787338673.823159:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787338673.823170:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbef17b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1874160212038400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787338673.823275:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbef17b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1874160212038400:12345-0@lo:400:kworker.0 Request processed in 107us (5446us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338673.823282:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:0.0:1787338673.823412:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787338673.823459:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbee44dc00 x1874160212038400/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787338689 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787338673.823476:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee44dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874160212038400:0@lo:400:kworker.0 00010000:00010000:3.0:1787338673.847013:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787338674.024693:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338674.024737:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338674.024759:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338674.024923:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192082816 00000100:00100000:1.0:1787338674.024935:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192082816 00000100:00100000:1.0:1787338674.024991:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 251 00000100:00100000:1.0:1787338674.025003:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc414e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+13:2358:x1874160192082816:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:2.0:1787338674.025108:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338674.025131:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192083072 00000100:00100000:2.0:1787338674.025135:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192083072 00000100:00100000:2.0:1787338674.025173:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 50 00000100:00100000:2.0:1787338674.025181:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4097800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:83642291-0761-4205-9531-7fd25bc2d48e+5:2358:x1874160192083072:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:2.0:1787338674.025241:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4097800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:83642291-0761-4205-9531-7fd25bc2d48e+5:2358:x1874160192083072:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 61us (134us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338674.025249:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 50 00000100:00080000:2.0:1787338674.025358:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787338674.025501:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc414e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+13:2358:x1874160192082816:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 500us (817us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338674.025519:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 251 00000100:00100000:0.0:1787338674.035267:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192082944 00000100:00100000:0.0:1787338674.035299:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192082944 00000100:00100000:1.0:1787338674.035474:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192083200 00000100:00100000:1.0:1787338674.035479:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192083200 00000100:00100000:1.0:1787338674.035526:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 104 00000100:00100000:1.0:1787338674.035538:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4095f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+14:2359:x1874160192082944:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:1.0:1787338674.035628:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4095f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+14:2359:x1874160192082944:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 92us (10889us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338674.035635:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 104 00000100:00100000:1.0:1787338674.035652:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 105 00000100:00100000:1.0:1787338674.035658:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4097b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e810cb1b-6993-4b6e-89c4-e8961cf35b35+5:2359:x1874160192083200:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:1.0:1787338674.035679:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4097b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e810cb1b-6993-4b6e-89c4-e8961cf35b35+5:2359:x1874160192083200:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 21us (10919us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338674.035685:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 105 00000100:00080000:2.0:1787338674.035808:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787338674.303340:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee44f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874160212038528:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787338674.303408:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338674.303482:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212038528 00000100:00100000:3.0:1787338674.303490:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212038528 00000100:00100000:3.0:1787338674.303532:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787338674.303552:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee44ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874160212038528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787338674.303586:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787338674.303630:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee44ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874160212038528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338674.303638:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:3.0:1787338674.303676:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbee44f480 x1874160212038528/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787338690 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787338674.303694:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee44f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874160212038528:0@lo:13:osp-pre-1-0.0 00000001:00080000:3.0:1787338674.381695:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:3.0:1787338674.381739:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000004:00080000:3.0:1787338674.381775:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:0.0:1787338674.382121:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee44f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874160212038656:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787338674.382201:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338674.386216:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212038656 00000100:00100000:3.0:1787338674.386233:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212038656 00000100:00100000:3.0:1787338674.386318:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787338674.386339:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbef17a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1874160212038656:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1787338674.386380:0:6691:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:3.0:1787338674.386420:0:6691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a889fad, atime: 0x6a889fad, ctime: 0x6a889fad, blocks: 0x1 00010000:00010000:3.0:1787338674.386430:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000884f449/0x83671231080c164d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338674.386447:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=327s v=(0 0) 00010000:00010000:3.0:1787338674.386452:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787338674.386458:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000884f449/0x83671231080c164d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338674.386476:0:6691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000884f449/0x83671231080c164d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338674.386487:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000884f449/0x83671231080c164d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338674.386494:0:6691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000884f449/0x83671231080c164d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338674.386518:0:6691:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787338674.386651:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787338674.386658:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000884f449/0x83671231080c164d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338674.386666:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea4200 already unused, calling callback (ffffffffc1546230) 00010000:00010000:1.0:1787338674.386670:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000884f449/0x83671231080c164d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338674.386679:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000884f449/0x83671231080c164d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338674.386733:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000884f449/0x83671231080c164d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338674.386741:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000884f449/0x83671231080c164d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338674.386760:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338674.386762:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338674.386763:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787338674.387173:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbef17a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3314:x1874160212038656:12345-0@lo:6:osp-syn-0-0.0 Request processed in 844us (4970us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1787338674.387181:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00080000:0.0:1787338674.387340:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90bbee44f480/2, rc 0, transno 4294967300 00000100:00100000:0.0:1787338674.387348:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee44f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874160212038656:0@lo:6:osp-syn-0-0.0 00000001:00080000:2.0:1787338674.847085:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00010000:00010000:3.0:1787338674.870186:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787338675.195675:0:11626:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:3.0:1787338675.896218:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787338676.255686:0:11674:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffac6d8e30 20000000:00000080:0.0:1787338676.255718:0:11674:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff90bbfbcc2800 uarg=0000000000000000 20000000:01000000:0.0:1787338676.255752:0:11674:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1787338676.255758:0:11674:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1787338676.255763:0:11674:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:0.0:1787338676.260349:0:11675:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:2.0:1787338676.260531:0:11674:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:2.0:1787338676.283234:0:11674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:2.0:1787338676.283293:0:11674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:2.0:1787338676.283368:0:11674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:2.0:1787338676.283386:0:11674:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787338676.283407:0:11674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90bbf40e3800/0x83671231080c1654 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338676.283427:0:11674:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90bbf40e3000/0x83671231080c14ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab643 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338676.283435:0:11674:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90bbf40e3e00/0x83671231080c14f6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab64a expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338676.283461:0:11674:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90bbf40e2800/0x83671231080c1504 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c14fd expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338676.283468:0:11674:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90bbc0030400/0x83671231080c1512 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c150b expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338676.283476:0:11674:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90bbc0031400/0x83671231080c1520 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c1519 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338676.283483:0:11674:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90bbf40e3800/0x83671231080c1654 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338676.283521:0:11674:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90bbc0031400/0x83671231080c1520 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x83671231080c1519 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338676.283537:0:11674:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90bbc0031400/0x83671231080c1520 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x83671231080c1519 expref: 18 pid: 5833 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338676.283550:0:11674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc4096d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11674:1874160212038784:0@lo:104: 00000100:00100000:2.0:1787338676.283613:0:11674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787338676.283700:0:11674:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90bbc0030400/0x83671231080c1512 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x83671231080c150b expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338676.283709:0:11674:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90bbc0030400/0x83671231080c1512 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x83671231080c150b expref: 18 pid: 5834 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338676.283718:0:11674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc4094380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11674:1874160212038912:0@lo:104: 00000100:00100000:2.0:1787338676.283743:0:11674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787338676.283791:0:11674:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90bbf40e2800/0x83671231080c1504 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x83671231080c14fd expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338676.283804:0:11674:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90bbf40e2800/0x83671231080c1504 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x83671231080c14fd expref: 18 pid: 5833 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338676.283814:0:11674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf4102d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11674:1874160212039040:0@lo:104: 00000100:00100000:2.0:1787338676.283841:0:11674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787338676.283917:0:11674:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90bbf40e3e00/0x83671231080c14f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab64a expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338676.283926:0:11674:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90bbf40e3e00/0x83671231080c14f6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab64a expref: 12 pid: 5834 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338676.283932:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787338676.283935:0:11674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf4100a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11674:1874160212039168:192.168.201.53@tcp:104: 00000100:00100000:3.0:1787338676.283944:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212038784 00000100:00100000:3.0:1787338676.283950:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212038784 00000100:00100000:3.0:1787338676.283984:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212038912 00000100:00100000:3.0:1787338676.283987:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212038912 00000100:00100000:3.0:1787338676.283997:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212039040 00000100:00100000:3.0:1787338676.283999:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212039040 00000100:00100000:3.0:1787338676.284012:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787338676.284020:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4094a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d79243c8-b367-45ff-8d76-fbaa4be8becb+5:11674:x1874160212038784:12345-0@lo:104: 00010000:00010000:3.0:1787338676.284033:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.153@tcp lock: ffff90bbf7ea4400/0x83671231080c1519 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x83671231080c1520 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338676.284079:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787338676.284085:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4094a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d79243c8-b367-45ff-8d76-fbaa4be8becb+5:11674:x1874160212038784:12345-0@lo:104: Request processed in 66us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338676.284091:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787338676.284110:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787338676.284115:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4094000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d79243c8-b367-45ff-8d76-fbaa4be8becb+4:11674:x1874160212038912:12345-0@lo:104: 00010000:00010000:3.0:1787338676.284122:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.153@tcp lock: ffff90bc021c9200/0x83671231080c150b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x83671231080c1512 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338676.284153:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787338676.284158:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4094000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d79243c8-b367-45ff-8d76-fbaa4be8becb+4:11674:x1874160212038912:12345-0@lo:104: Request processed in 44us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338676.284173:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787338676.284222:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787338676.284233:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc169c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d79243c8-b367-45ff-8d76-fbaa4be8becb+4:11674:x1874160212039040:12345-0@lo:104: 00010000:00010000:1.0:1787338676.284241:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.153@tcp lock: ffff90bbf7ea5200/0x83671231080c14fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x83671231080c1504 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338676.284269:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787338676.284273:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc169c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d79243c8-b367-45ff-8d76-fbaa4be8becb+4:11674:x1874160212039040:12345-0@lo:104: Request processed in 44us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338676.284279:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:3.0:1787338676.284417:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787338676.284431:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.153@tcp lock: ffff90bbf7ea4400/0x83671231080c1519 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x83671231080c1520 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338676.284439:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea4400 already unused, calling callback (ffffffffc1b2ec20) 10000000:00010000:3.0:1787338676.284443:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.153@tcp lock: ffff90bbf7ea4400/0x83671231080c1519 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x83671231080c1520 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338676.284451:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.153@tcp lock: ffff90bbf7ea4400/0x83671231080c1519 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x83671231080c1520 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787338676.284458:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.153@tcp lock: ffff90bbf7ea4400/0x83671231080c1519 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x83671231080c1520 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787338676.284465:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787338676.284523:0:11674:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90bbf40e3000/0x83671231080c14ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab643 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338676.284533:0:11674:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90bbf40e3000/0x83671231080c14ef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab643 expref: 12 pid: 5833 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338676.284542:0:11674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf4100380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11674:1874160212039296:192.168.201.53@tcp:104: 00000100:00100000:2.0:1787338676.284566:0:11674:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc7c84840 going to sleep for 11 seconds 00000100:00100000:2.0:1787338676.284586:0:11674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc4096d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11674:1874160212038784:0@lo:104: 00000100:00100000:2.0:1787338676.284595:0:11674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc4094380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11674:1874160212038912:0@lo:104: 00000100:00100000:2.0:1787338676.284601:0:11674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf4102d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11674:1874160212039040:0@lo:104: 00010000:00010000:3.0:1787338676.284615:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.153@tcp lock: ffff90bbf7ea4400/0x83671231080c1519 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c1520 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338676.284622:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787338676.284641:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.153@tcp lock: ffff90bbf7ea4400/0x83671231080c1519 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c1520 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338676.284642:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787338676.284648:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.153@tcp lock: ffff90bbf7ea4400/0x83671231080c1519 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c1520 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338676.284660:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787338676.284663:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.153@tcp lock: ffff90bbf7ea5200/0x83671231080c14fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x83671231080c1504 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338676.284679:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea5200 already unused, calling callback (ffffffffc1b2ec20) 10000000:00010000:3.0:1787338676.284682:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.153@tcp lock: ffff90bbf7ea5200/0x83671231080c14fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x83671231080c1504 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338676.284689:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.153@tcp lock: ffff90bbf7ea5200/0x83671231080c14fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x83671231080c1504 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787338676.284695:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.153@tcp lock: ffff90bbf7ea5200/0x83671231080c14fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x83671231080c1504 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787338676.284700:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787338676.284714:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.153@tcp lock: ffff90bbf7ea5200/0x83671231080c14fd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c1504 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338676.284718:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee44dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d79243c8-b367-45ff-8d76-fbaa4be8becb:3315:1874160212039424:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787338676.284720:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787338676.284745:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.153@tcp lock: ffff90bbf7ea5200/0x83671231080c14fd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c1504 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338676.284745:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787338676.284752:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.153@tcp lock: ffff90bbf7ea5200/0x83671231080c14fd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c1504 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338676.284761:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338676.284762:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338676.284764:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787338676.284771:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787338676.284775:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212039424 00000100:00100000:1.0:1787338676.284778:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212039424 00000100:00100000:3.0:1787338676.284779:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee44d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d79243c8-b367-45ff-8d76-fbaa4be8becb:3317:1874160212039552:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787338676.284796:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90bbc0031400/0x83671231080c1520 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x83671231080c1519 expref: 19 pid: 5833 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338676.284802:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338676.284827:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212039552 00000100:00100000:1.0:1787338676.284831:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212039552 00010000:00010000:1.0:1787338676.284843:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90bbf40e2800/0x83671231080c1504 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x83671231080c14fd expref: 20 pid: 5833 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338676.284902:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787338676.284909:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa2df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d79243c8-b367-45ff-8d76-fbaa4be8becb+20:3315:x1874160212039424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787338676.284920:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787338676.284925:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90bbc0031400/0x83671231080c1520 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x83671231080c1519 expref: 20 pid: 5833 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338676.284932:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00010000:00010000:1.0:1787338676.284935:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90bbc0031400/0x83671231080c1520 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x83671231080c1519 expref: 20 pid: 5833 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338676.284939:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbd172c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d79243c8-b367-45ff-8d76-fbaa4be8becb+20:3317:x1874160212039552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787338676.284948:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90bbc0031400/0x83671231080c1520 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x83671231080c1519 expref: 20 pid: 5833 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338676.284951:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787338676.284955:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90bbf40e2800/0x83671231080c1504 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x83671231080c14fd expref: 20 pid: 5833 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338676.284961:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787338676.284962:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90bbf40e2800/0x83671231080c1504 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x83671231080c14fd expref: 19 pid: 5833 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338676.284972:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90bbf40e2800/0x83671231080c1504 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x83671231080c14fd expref: 19 pid: 5833 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338676.284981:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787338676.284999:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa2df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d79243c8-b367-45ff-8d76-fbaa4be8becb+18:3315:x1874160212039424:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338676.285001:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbd172c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d79243c8-b367-45ff-8d76-fbaa4be8becb+18:3317:x1874160212039552:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338676.285005:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787338676.285008:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787338676.285029:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee44d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d79243c8-b367-45ff-8d76-fbaa4be8becb:3317:1874160212039552:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787338676.285029:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee44dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d79243c8-b367-45ff-8d76-fbaa4be8becb:3315:1874160212039424:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787338676.285627:0:11676:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338676.285630:0:11676:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338676.285632:0:11676:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338676.285837:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.153@tcp lock: ffff90bc021c9200/0x83671231080c150b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x83671231080c1512 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338676.285846:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bc021c9200 already unused, calling callback (ffffffffc1b2ec20) 10000000:00010000:1.0:1787338676.285850:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.153@tcp lock: ffff90bc021c9200/0x83671231080c150b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x83671231080c1512 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338676.285898:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.153@tcp lock: ffff90bc021c9200/0x83671231080c150b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x83671231080c1512 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787338676.285906:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.153@tcp lock: ffff90bc021c9200/0x83671231080c150b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x83671231080c1512 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787338676.285920:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787338676.285943:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.153@tcp lock: ffff90bc021c9200/0x83671231080c150b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c1512 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338676.285949:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787338676.285978:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.153@tcp lock: ffff90bc021c9200/0x83671231080c150b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c1512 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338676.285986:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.153@tcp lock: ffff90bc021c9200/0x83671231080c150b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c1512 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338676.286001:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338676.286002:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338676.286004:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787338676.286010:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787338676.286019:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbffa2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d79243c8-b367-45ff-8d76-fbaa4be8becb:3316:1874160212039680:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787338676.286056:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338676.286087:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212039680 00000100:00100000:1.0:1787338676.286092:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212039680 00010000:00010000:1.0:1787338676.286109:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90bbc0030400/0x83671231080c1512 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x83671231080c150b expref: 17 pid: 5834 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338676.286129:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787338676.286136:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbde53c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d79243c8-b367-45ff-8d76-fbaa4be8becb+17:3316:x1874160212039680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787338676.286151:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787338676.286156:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90bbc0030400/0x83671231080c1512 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x83671231080c150b expref: 17 pid: 5834 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338676.286166:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90bbc0030400/0x83671231080c1512 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x83671231080c150b expref: 17 pid: 5834 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338676.286463:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90bbc0030400/0x83671231080c1512 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x83671231080c150b expref: 17 pid: 5834 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338676.286476:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787338676.286513:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbde53c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d79243c8-b367-45ff-8d76-fbaa4be8becb+16:3316:x1874160212039680:12345-0@lo:103:ldlm_bl.0 Request processed in 377us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338676.286520:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787338676.286610:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbffa2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d79243c8-b367-45ff-8d76-fbaa4be8becb:3316:1874160212039680:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787338676.291930:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338676.291986:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338676.292199:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192083328 00000100:00100000:1.0:1787338676.292209:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192083328 00010000:00010000:1.0:1787338676.292246:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90bbf40e3e00/0x83671231080c14f6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab64a expref: 13 pid: 5834 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338676.292275:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192083456 00000100:00100000:1.0:1787338676.292278:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192083456 00010000:00010000:1.0:1787338676.292289:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90bbf40e3000/0x83671231080c14ef lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab643 expref: 14 pid: 5833 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338676.292317:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 33 00000100:00100000:1.0:1787338676.292326:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf4101180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+14:2358:x1874160192083328:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787338676.292339:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787338676.292345:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90bbf40e3e00/0x83671231080c14f6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab64a expref: 14 pid: 5834 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338676.292368:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90bbf40e3e00/0x83671231080c14f6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab64a expref: 14 pid: 5834 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338676.292388:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787338676.292438:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf4101180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+14:2358:x1874160192083328:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 113us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338676.292445:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 33 00000100:00100000:1.0:1787338676.292462:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 34 00000100:00100000:1.0:1787338676.292468:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf4103480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+13:2358:x1874160192083456:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787338676.292475:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787338676.292480:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90bbf40e3000/0x83671231080c14ef lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab643 expref: 13 pid: 5833 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338676.292489:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90bbf40e3000/0x83671231080c14ef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab643 expref: 13 pid: 5833 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338676.292500:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90bbf40e3800/0x83671231080c1654 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338676.292508:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bbf40e3800/0x83671231080c1654 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338676.292522:0:5825:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90bbf40e3800/0x83671231080c1654 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338676.292530:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90bbf40e3800/0x83671231080c1654 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338676.292536:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90bbf40e3800/0x83671231080c1654 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338676.292549:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90bbf40e3800/0x83671231080c1654 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338676.292555:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e3800 already unused, calling callback (ffffffffc1546230) 00010000:00010000:1.0:1787338676.292559:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90bbf40e3800/0x83671231080c1654 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338676.292567:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90bbf40e3800/0x83671231080c1654 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338676.292577:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90bbf40e3800/0x83671231080c1654 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338676.292587:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787338676.292605:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf4103480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+13:2358:x1874160192083456:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 137us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338676.292612:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 34 00010000:00010000:3.0:1787338676.293632:0:11674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90bbf40e3e00/0x83671231080c14f6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab64a expref: 12 pid: 5834 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338676.293648:0:11674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf4100a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11674:1874160212039168:192.168.201.53@tcp:104: 00010000:00010000:3.0:1787338676.293662:0:11674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90bbf40e3000/0x83671231080c14ef lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab643 expref: 11 pid: 5833 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338676.293671:0:11674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf4100380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11674:1874160212039296:192.168.201.53@tcp:104: 00010000:00010000:3.0:1787338676.293700:0:11674:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90bbf40e3800/0x83671231080c1654 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338676.293720:0:11674:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90bbf40e3800/0x83671231080c1654 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338676.293726:0:11674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90bbf40e3800/0x83671231080c1654 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338676.293731:0:11674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90bbf40e3800/0x83671231080c1654 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338676.921548:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787338677.637005:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338677.637221:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192083584 00000100:00100000:2.0:1787338677.637231:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192083584 00000100:00100000:2.0:1787338677.637319:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 252 00000100:00100000:2.0:1787338677.637329:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc414fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+11:5598:x1874160192083584:12345-192.168.201.53@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787338677.637346:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787338677.637365:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90bbf40e2200/0x83671231080c165b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab697 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338677.637404:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bbf40e2200/0x83671231080c165b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab697 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338677.637415:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90bbf40e2200/0x83671231080c165b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab697 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338677.637430:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf40e2200, rc 0) 00000100:00100000:2.0:1787338677.637485:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc414fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+12:5598:x1874160192083584:12345-192.168.201.53@tcp:101:ll_cfg_requeue.0 Request processed in 157us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338677.637492:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 252 00000100:00100000:1.0:1787338677.641834:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338677.642414:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192083712 00000100:00100000:2.0:1787338677.642429:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192083712 00000100:00100000:2.0:1787338677.642476:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 253 00000100:00100000:2.0:1787338677.642486:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc414d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+12:5598:x1874160192083712:12345-192.168.201.53@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787338677.642754:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc414d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+12:5598:x1874160192083712:12345-192.168.201.53@tcp:501:ll_cfg_requeue.0 Request processed in 268us (928us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338677.642762:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 253 00000100:00100000:3.0:1787338677.647848:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338677.647963:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192083840 00000100:00100000:1.0:1787338677.647972:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192083840 00000100:00100000:1.0:1787338677.648023:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 254 00000100:00100000:1.0:1787338677.648033:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc414f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+12:5598:x1874160192083840:12345-192.168.201.53@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787338677.648241:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc414f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+12:5598:x1874160192083840:12345-192.168.201.53@tcp:503:ll_cfg_requeue.0 Request processed in 208us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338677.648249:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 254 00000100:00100000:1.0:1787338677.660904:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338677.660995:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192083968 00000100:00100000:2.0:1787338677.661018:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192083968 00000100:00100000:2.0:1787338677.661071:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 255 00000100:00100000:2.0:1787338677.661081:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc414cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+12:9950:x1874160192083968:12345-192.168.201.53@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787338677.661326:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc414cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+12:9950:x1874160192083968:12345-192.168.201.53@tcp:502:llog_process_th.0 Request processed in 246us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338677.661334:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 255 00000100:00100000:2.0:1787338677.666255:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338677.666333:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192084096 00000100:00100000:0.0:1787338677.666342:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192084096 00000100:00100000:0.0:1787338677.666396:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 256 00000100:00100000:0.0:1787338677.666406:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbde804050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+12:9950:x1874160192084096:12345-192.168.201.53@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787338677.666663:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbde804050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+12:9950:x1874160192084096:12345-192.168.201.53@tcp:502:llog_process_th.0 Request processed in 257us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338677.666671:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 256 00000100:00100000:3.0:1787338677.680189:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338677.680293:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192084224 00000100:00100000:1.0:1787338677.680318:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192084224 00000100:00100000:1.0:1787338677.680381:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 257 00000100:00100000:1.0:1787338677.680392:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbde804450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+12:5598:x1874160192084224:12345-192.168.201.53@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787338677.680417:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787338677.680442:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90bc021c8a00/0x83671231080c1662 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab69e expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338677.680471:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bc021c8a00/0x83671231080c1662 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab69e expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338677.680481:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90bc021c8a00/0x83671231080c1662 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab69e expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338677.680490:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bc021c8a00, rc 0) 00000100:00100000:1.0:1787338677.680555:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbde804450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+13:5598:x1874160192084224:12345-192.168.201.53@tcp:101:ll_cfg_requeue.0 Request processed in 165us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338677.680562:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 257 00000100:00100000:1.0:1787338677.695112:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338677.695287:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192084352 00000100:00100000:0.0:1787338677.695298:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192084352 00000100:00100000:0.0:1787338677.695352:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 258 00000100:00100000:0.0:1787338677.695362:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbde807450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+13:5598:x1874160192084352:12345-192.168.201.53@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787338677.695703:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbde807450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+13:5598:x1874160192084352:12345-192.168.201.53@tcp:501:ll_cfg_requeue.0 Request processed in 340us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338677.695712:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 258 00000100:00100000:3.0:1787338677.728784:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338677.729005:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192084480 00000100:00100000:2.0:1787338677.729015:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192084480 00000100:00100000:2.0:1787338677.729070:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 259 00000100:00100000:2.0:1787338677.729080:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbde807050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+13:5598:x1874160192084480:12345-192.168.201.53@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787338677.729360:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbde807050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+13:5598:x1874160192084480:12345-192.168.201.53@tcp:503:ll_cfg_requeue.0 Request processed in 281us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338677.729370:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 259 00000100:00100000:3.0:1787338677.745428:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338677.747695:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192084608 00000100:00100000:1.0:1787338677.747708:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192084608 00000100:00100000:1.0:1787338677.747780:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 260 00000100:00100000:1.0:1787338677.747790:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbde806850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+13:9953:x1874160192084608:12345-192.168.201.53@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787338677.748077:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbde806850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+13:9953:x1874160192084608:12345-192.168.201.53@tcp:502:llog_process_th.0 Request processed in 288us (2668us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338677.748083:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 260 00000100:00100000:1.0:1787338677.752949:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338677.753035:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192084736 00000100:00100000:0.0:1787338677.753044:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192084736 00000100:00100000:0.0:1787338677.753099:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 261 00000100:00100000:0.0:1787338677.753109:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbde807c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+13:9953:x1874160192084736:12345-192.168.201.53@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787338677.753379:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbde807c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+13:9953:x1874160192084736:12345-192.168.201.53@tcp:502:llog_process_th.0 Request processed in 270us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338677.753387:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 261 00010000:00010000:3.0:1787338677.942251:0:11676:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787338678.198132:0:5836:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787338678.198141:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90bbff941800 from 7 10000000:01000000:2.0:1787338678.198146:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787338678.198463:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbf40e3000/0x83671231080c1669 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338678.198477:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.153@tcp lock: ffff90bbf40e3000/0x83671231080c1669 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338678.198489:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.153@tcp lock: ffff90bbf40e3000/0x83671231080c1669 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338678.198516:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf4101880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212039808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787338678.198593:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338678.198676:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc7c840c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787338678.200324:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212039808 00000100:00100000:1.0:1787338678.200353:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212039808 00000100:00100000:1.0:1787338678.200701:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1787338678.200713:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbde805850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+16:5836:x1874160212039808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787338678.200728:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787338678.200743:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90bc021c8200/0x83671231080c1670 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x83671231080c1669 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338678.200769:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bc021c8200/0x83671231080c1670 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x83671231080c1669 expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338678.200779:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90bc021c8200/0x83671231080c1670 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c1669 expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338678.200788:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bc021c8200, rc 0) 00000100:00100000:1.0:1787338678.200858:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbde805850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+17:5836:x1874160212039808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (2264us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338678.200864:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1787338678.201363:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf4101880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212039808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787338678.201382:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.153@tcp lock: ffff90bbf40e3000/0x83671231080c1669 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c1670 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338678.201497:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.153@tcp lock: ffff90bbf40e3000/0x83671231080c1669 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x83671231080c1670 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338678.201566:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf4101880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212039936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787338678.201601:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338678.201638:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc7c840c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787338678.203314:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212039936 00000100:00100000:1.0:1787338678.203325:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212039936 00000100:00100000:1.0:1787338678.203395:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1787338678.203405:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbde807850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+17:5836:x1874160212039936:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787338678.203700:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbde807850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+17:5836:x1874160212039936:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 295us (2097us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338678.203707:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1787338678.203739:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf4101880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212039936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787338678.203782:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbd172e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212040064:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787338678.206623:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338678.206673:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbf7e2e540 going to sleep for 11 seconds 00000100:00100000:0.0:1787338678.207055:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212040064 00000100:00100000:0.0:1787338678.207064:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212040064 00000100:00100000:0.0:1787338678.207118:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1787338678.207128:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbde804c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+17:5836:x1874160212040064:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787338678.207454:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbde804c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+17:5836:x1874160212040064:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 328us (838us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338678.207463:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1787338678.207761:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbd172e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212040064:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787338678.210816:0:11688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbef17aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d79243c8-b367-45ff-8d76-fbaa4be8becb:11688:1874160212040192:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787338678.211070:0:11688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338678.211121:0:11688:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbfbcd8540 going to sleep for 11 seconds 00000100:00100000:1.0:1787338678.211804:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212040192 00000100:00100000:1.0:1787338678.211814:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212040192 00000100:00100000:1.0:1787338678.211871:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1787338678.212079:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbde805c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+17:11688:x1874160212040192:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787338678.212369:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbde805c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+17:11688:x1874160212040192:12345-0@lo:502:llog_process_th.0 Request processed in 292us (1298us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338678.212443:0:11688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbef17aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d79243c8-b367-45ff-8d76-fbaa4be8becb:11688:1874160212040192:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787338678.212479:0:11688:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787338678.212488:0:11688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787338678.212491:0:11688:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787338678.212498:0:11688:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90bbff941800 00000020:00000080:2.0:1787338678.212500:0:11688:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787338678.212588:0:11688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf4102680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d79243c8-b367-45ff-8d76-fbaa4be8becb:11688:1874160212040320:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787338678.212628:0:11688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338678.212654:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212040320 00000100:00100000:2.0:1787338678.212658:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212040320 00000100:00100000:0.0:1787338678.222247:0:11688:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc7c84000 going to sleep for 11 seconds 00000100:00100000:1.0:1787338678.222520:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1787338678.223063:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1787338678.223080:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc7da4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+17:11688:x1874160212040320:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787338678.223608:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc7da4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+17:11688:x1874160212040320:12345-0@lo:502:llog_process_th.0 Request processed in 534us (10978us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338678.223615:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1787338678.223730:0:11688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf4102680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d79243c8-b367-45ff-8d76-fbaa4be8becb:11688:1874160212040320:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787338678.223762:0:11688:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787338678.223770:0:11688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787338678.223772:0:11688:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1787338678.223776:0:11688:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1787338678.224025:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1787338678.224056:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787338678.224065:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbf40e3000/0x83671231080c1669 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c1670 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338678.224075:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.153@tcp lock: ffff90bbf40e3000/0x83671231080c1669 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c1670 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787338678.224085:0:5836:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787338678.224087:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90bbc9632800 from 7 10000000:01000000:2.0:1787338678.224090:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787338678.224116:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbf40e3e00/0x83671231080c1677 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338678.224124:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.153@tcp lock: ffff90bbf40e3e00/0x83671231080c1677 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338678.224132:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.153@tcp lock: ffff90bbf40e3e00/0x83671231080c1677 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338678.224151:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf4100700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212040448:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787338678.224689:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338678.224755:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc7c84900 going to sleep for 11 seconds 00000100:00100000:1.0:1787338678.240499:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212040448 00000100:00100000:1.0:1787338678.240515:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212040448 00000100:00100000:1.0:1787338678.240580:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1787338678.240593:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc7da4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+17:5836:x1874160212040448:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787338678.240611:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787338678.240631:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90bc021c8c00/0x83671231080c167e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x83671231080c1677 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338678.240659:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bc021c8c00/0x83671231080c167e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x83671231080c1677 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338678.240670:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90bc021c8c00/0x83671231080c167e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c1677 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338678.240680:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bc021c8c00, rc 0) 00000100:00100000:1.0:1787338678.240762:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc7da4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+18:5836:x1874160212040448:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 171us (16073us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338678.240770:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1787338678.240940:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf4100700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212040448:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787338678.240959:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.153@tcp lock: ffff90bbf40e3e00/0x83671231080c1677 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c167e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338678.240969:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.153@tcp lock: ffff90bbf40e3e00/0x83671231080c1677 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x83671231080c167e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338678.241056:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbd172e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212040576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787338678.241090:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338678.241129:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbf7e2e540 going to sleep for 11 seconds 00000100:00100000:2.0:1787338678.241378:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212040576 00000100:00100000:2.0:1787338678.241395:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212040576 00000100:00100000:2.0:1787338678.241427:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1787338678.241435:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc7da4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+18:5836:x1874160212040576:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787338678.241682:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc7da4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+18:5836:x1874160212040576:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 247us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338678.241690:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1787338678.241831:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbd172e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212040576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787338678.241861:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbd172e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212040704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787338678.241926:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338678.242318:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbf7e2e540 going to sleep for 11 seconds 00000100:00100000:1.0:1787338678.243523:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212040704 00000100:00100000:1.0:1787338678.243540:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212040704 00000100:00100000:1.0:1787338678.243599:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1787338678.243609:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc7da7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+18:5836:x1874160212040704:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787338678.243797:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc7da7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+18:5836:x1874160212040704:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 190us (1870us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338678.243805:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1787338678.243847:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbd172e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212040704:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787338678.262662:0:11692:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787338678.267612:0:11691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbd172d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d79243c8-b367-45ff-8d76-fbaa4be8becb:11691:1874160212040832:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787338678.267691:0:11691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338678.267730:0:11691:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbf7e2e780 going to sleep for 11 seconds 00000100:00100000:3.0:1787338678.267760:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212040832 00000100:00100000:3.0:1787338678.267766:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212040832 00000100:00100000:3.0:1787338678.267808:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1787338678.267817:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc7da7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+18:11691:x1874160212040832:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787338678.269259:0:11691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbd172d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d79243c8-b367-45ff-8d76-fbaa4be8becb:11691:1874160212040832:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787338678.270058:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc7da7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+18:11691:x1874160212040832:12345-0@lo:502:llog_process_th.0 Request processed in 2240us (2365us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338678.270069:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000020:01000000:2.0:1787338678.272354:0:11691:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787338678.272732:0:11691:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787338678.272736:0:11691:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787338678.272746:0:11691:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90bbc9632800 00000020:00000080:2.0:1787338678.272749:0:11691:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787338678.272844:0:11691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf4103100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d79243c8-b367-45ff-8d76-fbaa4be8becb:11691:1874160212040960:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787338678.273511:0:11691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338678.273547:0:11691:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc7c84840 going to sleep for 11 seconds 00000100:00100000:1.0:1787338678.274566:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212040960 00000100:00100000:1.0:1787338678.274575:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212040960 00000100:00100000:1.0:1787338678.274623:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1787338678.274633:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc7da6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+18:11691:x1874160212040960:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787338678.274848:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc7da6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+18:11691:x1874160212040960:12345-0@lo:502:llog_process_th.0 Request processed in 216us (1337us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338678.274856:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1787338678.275044:0:11691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf4103100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d79243c8-b367-45ff-8d76-fbaa4be8becb:11691:1874160212040960:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787338678.275074:0:11691:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787338678.275081:0:11691:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787338678.275083:0:11691:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1787338678.275087:0:11691:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1787338678.279001:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1787338678.279033:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787338678.279042:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbf40e3e00/0x83671231080c1677 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c167e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338678.279053:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.153@tcp lock: ffff90bbf40e3e00/0x83671231080c1677 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c167e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787338678.279062:0:5836:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787338678.279064:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90bbd0622000 from 7 10000000:01000000:1.0:1787338678.279066:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787338678.279097:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bc021c8800/0x83671231080c1685 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338678.279107:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.153@tcp lock: ffff90bc021c8800/0x83671231080c1685 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338678.279117:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.153@tcp lock: ffff90bc021c8800/0x83671231080c1685 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338678.279136:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbffa2df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212041088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787338678.283794:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338678.284046:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc61b8900 going to sleep for 11 seconds 00000100:00100000:2.0:1787338678.284934:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212041088 00000100:00100000:2.0:1787338678.284944:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212041088 00000100:00100000:2.0:1787338678.284996:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1787338678.285007:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc7da7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+18:5836:x1874160212041088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787338678.285022:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787338678.285039:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90bbf40e2800/0x83671231080c168c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x83671231080c1685 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338678.285069:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bbf40e2800/0x83671231080c168c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x83671231080c1685 expref: 19 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338678.285080:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90bbf40e2800/0x83671231080c168c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c1685 expref: 19 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338678.285110:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf40e2800, rc 0) 00000100:00100000:2.0:1787338678.286355:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc7da7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+19:5836:x1874160212041088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 183us (1401us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338678.286379:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1787338678.286458:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbffa2df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212041088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787338678.286480:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.153@tcp lock: ffff90bc021c8800/0x83671231080c1685 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c168c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338678.287771:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.153@tcp lock: ffff90bc021c8800/0x83671231080c1685 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x83671231080c168c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338678.287859:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf4103100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212041216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787338678.287938:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338678.287985:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc7c84900 going to sleep for 11 seconds 00000100:00100000:0.0:1787338678.288018:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212041216 00000100:00100000:0.0:1787338678.288025:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212041216 00000100:00100000:0.0:1787338678.288066:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1787338678.288075:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc7da5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+19:5836:x1874160212041216:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787338678.288362:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc7da5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+19:5836:x1874160212041216:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 288us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338678.288381:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1787338678.289987:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf4103100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212041216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787338678.290039:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf4103100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212041344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787338678.290106:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338678.290150:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc7c84900 going to sleep for 11 seconds 00000100:00100000:3.0:1787338678.290844:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212041344 00000100:00100000:3.0:1787338678.290852:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212041344 00000100:00100000:3.0:1787338678.290927:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1787338678.290936:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc7da7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+19:5836:x1874160212041344:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787338678.296904:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc7da7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+19:5836:x1874160212041344:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 5936us (6764us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338678.296918:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1787338678.297134:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf4103100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d79243c8-b367-45ff-8d76-fbaa4be8becb:5836:1874160212041344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787338678.298700:0:11694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbd172fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d79243c8-b367-45ff-8d76-fbaa4be8becb:11694:1874160212041472:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787338678.298775:0:11694:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338678.298819:0:11694:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbf7e2e780 going to sleep for 11 seconds 00000100:00100000:0.0:1787338678.299316:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212041472 00000100:00100000:0.0:1787338678.299323:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212041472 00000100:00100000:0.0:1787338678.299375:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1787338678.299608:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc7da4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+19:11694:x1874160212041472:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787338678.299836:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc7da4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+19:11694:x1874160212041472:12345-0@lo:502:llog_process_th.0 Request processed in 452us (1061us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338678.299843:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1787338678.300236:0:11694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbd172fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d79243c8-b367-45ff-8d76-fbaa4be8becb:11694:1874160212041472:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787338678.300279:0:11694:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787338678.300289:0:11694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787338678.300291:0:11694:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787338678.300355:0:11694:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90bbd0622000 00000020:00000080:3.0:1787338678.300358:0:11694:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787338678.300503:0:11694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbd172fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d79243c8-b367-45ff-8d76-fbaa4be8becb:11694:1874160212041600:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787338678.300543:0:11694:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338678.300581:0:11694:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbf7e2e780 going to sleep for 11 seconds 00000100:00100000:0.0:1787338678.302554:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212041600 00000100:00100000:0.0:1787338678.302568:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212041600 00000100:00100000:0.0:1787338678.302624:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1787338678.302634:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc7da5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+19:11694:x1874160212041600:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787338678.302918:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc7da5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+19:11694:x1874160212041600:12345-0@lo:502:llog_process_th.0 Request processed in 285us (2373us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338678.302926:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1787338678.303224:0:11694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbd172fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d79243c8-b367-45ff-8d76-fbaa4be8becb:11694:1874160212041600:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787338678.303257:0:11694:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787338678.303276:0:11694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787338678.303279:0:11694:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787338678.303283:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1787338678.306422:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1787338678.306470:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787338678.306482:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bc021c8800/0x83671231080c1685 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c168c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338678.306495:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.153@tcp lock: ffff90bc021c8800/0x83671231080c1685 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c168c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338678.390324:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787338678.390348:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf4103100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874160212041728:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787338678.390417:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338678.390580:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212041728 00000100:00100000:2.0:1787338678.390587:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212041728 00000100:00100000:2.0:1787338678.390662:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787338678.390672:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbd172fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874160212041728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787338678.390704:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787338678.390748:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbd172fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874160212041728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338678.390755:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:0.0:1787338678.390913:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787338678.391029:0:3315:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:3.0:1787338678.391034:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90bbee44f480, transno 4294967300 00000100:00100000:3.0:1787338678.391049:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf4103100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874160212041728:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787338678.902407:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbffa2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874160212042240:0@lo:400:kworker.0 00000100:00100000:0.0:1787338678.902487:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338678.902573:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787338678.902581:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbffa2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874160212041856:0@lo:400:kworker.0 00000100:00100000:0.0:1787338678.902606:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338678.902734:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212042240 00000100:00100000:1.0:1787338678.902742:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212042240 00000100:00100000:1.0:1787338678.902802:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787338678.902811:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbef179500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874160212042240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787338678.902870:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbef179500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874160212042240:12345-0@lo:400:kworker.0 Request processed in 60us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338678.902905:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787338678.902928:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212041856 00000100:00100000:1.0:1787338678.902932:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212041856 00000100:00100000:1.0:1787338678.902958:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787338678.902965:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbef178e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874160212041856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787338678.902997:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbef178e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874160212041856:12345-0@lo:400:kworker.0 Request processed in 32us (390us total) trans 0 rc 0/0 00000100:00080000:0.0:1787338678.903174:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787338678.903203:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbffa2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874160212041856:0@lo:400:kworker.0 00010000:00080000:0.0:1787338678.903217:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbffa2e680 x1874160212042240/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787338694 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787338678.903228:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbffa2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874160212042240:0@lo:400:kworker.0 00000100:00100000:1.0:1787338678.903308:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787338678.903376:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbffa2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874160212041984:0@lo:400:kworker.0 00000100:00100000:2.0:1787338678.903407:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338678.903446:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787338678.903452:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbffa2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1874160212042112:0@lo:400:kworker.0 00000100:00100000:2.0:1787338678.903475:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338678.903613:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212041984 00000100:00100000:0.0:1787338678.903617:0:7647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212041984 00000100:00100000:0.0:1787338678.903651:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212042112 00000100:00100000:0.0:1787338678.903655:0:7647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212042112 00000100:00100000:0.0:1787338678.903672:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787338678.903678:0:7647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf4102300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874160212041984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787338678.903713:0:7647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf4102300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874160212041984:12345-0@lo:400:kworker.0 Request processed in 35us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338678.903720:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787338678.903731:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787338678.903736:0:7647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf4102a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874160212042112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787338678.903760:0:7647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf4102a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874160212042112:12345-0@lo:400:kworker.0 Request processed in 25us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338678.903766:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:2.0:1787338678.904198:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787338678.904223:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbffa2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1874160212042112:0@lo:400:kworker.0 00000100:00100000:2.0:1787338678.904232:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbffa2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874160212041984:0@lo:400:kworker.0 00010000:00010000:1.0:1787338678.966238:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787338679.108303:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338679.108511:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192084864 00000100:00100000:0.0:1787338679.108521:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192084864 00000100:00100000:0.0:1787338679.108577:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 277 00000100:00100000:0.0:1787338679.108587:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc7da5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+13:2358:x1874160192084864:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:0.0:1787338679.108679:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc7da5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+13:2358:x1874160192084864:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 93us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338679.108688:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 277 00000100:00100000:3.0:1787338679.114754:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338679.114868:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192084992 00000100:00100000:0.0:1787338679.114902:0:7647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192084992 00000100:00100000:0.0:1787338679.114996:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 109 00000100:00100000:0.0:1787338679.115008:0:7647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbd172c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+5:2358:x1874160192084992:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:0.0:1787338679.115083:0:7647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbd172c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+5:2358:x1874160192084992:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 77us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338679.115091:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 109 00000100:00080000:2.0:1787338679.115574:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787338679.128977:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338679.129021:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338679.129167:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192085120 00000100:00100000:2.0:1787338679.129177:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192085120 00000100:00100000:2.0:1787338679.129262:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 52 00000100:00100000:2.0:1787338679.129273:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:83642291-0761-4205-9531-7fd25bc2d48e+5:2359:x1874160192085120:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:2.0:1787338679.129343:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:83642291-0761-4205-9531-7fd25bc2d48e+5:2359:x1874160192085120:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 72us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338679.129351:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 52 00000100:00080000:0.0:1787338679.129466:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787338679.129720:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192085248 00000100:00100000:3.0:1787338679.129725:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192085248 00000100:00100000:3.0:1787338679.129790:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 110 00000100:00100000:3.0:1787338679.129798:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e810cb1b-6993-4b6e-89c4-e8961cf35b35+5:2359:x1874160192085248:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:3.0:1787338679.129835:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e810cb1b-6993-4b6e-89c4-e8961cf35b35+5:2359:x1874160192085248:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 38us (875us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338679.129842:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 110 00000100:00080000:0.0:1787338679.129940:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:0.0:1787338679.287749:0:11692:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787338679.414445:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787338679.414469:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbffa2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874160212042368:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787338679.414546:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338679.414717:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212042368 00000100:00100000:1.0:1787338679.414739:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212042368 00000100:00100000:1.0:1787338679.414803:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787338679.414813:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf4101500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874160212042368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787338679.414846:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787338679.414916:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf4101500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874160212042368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338679.414923:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:1.0:1787338679.414960:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbffa2e300 x1874160212042368/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787338695 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787338679.414978:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbffa2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874160212042368:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787338679.991627:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338681.015452:0:11676:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338682.040255:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338683.062087:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787338683.513466:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787338683.513493:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf4100e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874160212042496:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787338683.513564:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338683.514082:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212042496 00000100:00100000:1.0:1787338683.514091:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212042496 00000100:00100000:1.0:1787338683.514178:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787338683.514191:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbd172d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874160212042496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787338683.514232:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787338683.514290:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbd172d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874160212042496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (725us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338683.514298:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:0.0:1787338683.514599:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787338683.514755:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf4100e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874160212042496:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787338684.022245:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787338684.022271:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbd172e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d79243c8-b367-45ff-8d76-fbaa4be8becb:3316:1874160212042624:0@lo:400:kworker.0 00000100:00100000:2.0:1787338684.022357:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338684.022429:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212042624 00000100:00100000:2.0:1787338684.022437:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212042624 00000100:00100000:2.0:1787338684.022490:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1787338684.022499:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc7da6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+19:3316:x1874160212042624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787338684.022574:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc7da6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+19:3316:x1874160212042624:12345-0@lo:400:kworker.0 Request processed in 75us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338684.022581:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1787338684.022626:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbd172e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d79243c8-b367-45ff-8d76-fbaa4be8becb:3316:1874160212042624:0@lo:400:kworker.0 00000100:00100000:2.0:1787338684.022658:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787338684.022665:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee44f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874160212042752:0@lo:400:kworker.0 00000100:00100000:2.0:1787338684.022697:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338684.022796:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212042752 00000100:00100000:0.0:1787338684.022801:0:7647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212042752 00000100:00100000:0.0:1787338684.022841:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787338684.022849:0:7647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf4100000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874160212042752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787338684.022915:0:7647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf4100000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874160212042752:12345-0@lo:400:kworker.0 Request processed in 67us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338684.022922:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787338684.022951:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee44f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874160212042752:0@lo:400:kworker.0 00000100:00100000:3.0:1787338684.023063:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee44d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1874160212043008:0@lo:400:kworker.0 00000100:00100000:3.0:1787338684.023092:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338684.023113:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787338684.023119:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee44f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874160212043136:0@lo:400:kworker.0 00000100:00100000:3.0:1787338684.023144:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338684.023187:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212043008 00000100:00100000:3.0:1787338684.023191:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212043008 00000100:00100000:3.0:1787338684.023225:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787338684.023232:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4094380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874160212043008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787338684.023267:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4094380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874160212043008:12345-0@lo:400:kworker.0 Request processed in 36us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338684.023273:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787338684.023290:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212043136 00000100:00100000:3.0:1787338684.023294:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212043136 00000100:00100000:3.0:1787338684.023331:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787338684.023338:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4096d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1874160212043136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787338684.023369:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4096d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1874160212043136:12345-0@lo:400:kworker.0 Request processed in 32us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338684.023375:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:3.0:1787338684.023406:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbee44f480 x1874160212043136/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787338700 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787338684.023417:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee44f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874160212043136:0@lo:400:kworker.0 00000100:00100000:3.0:1787338684.023427:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee44d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1874160212043008:0@lo:400:kworker.0 00000100:00080000:0.0:1787338684.023655:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787338684.023660:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787338684.023669:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee44dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1874160212042880:0@lo:400:kworker.0 00000100:00100000:0.0:1787338684.023698:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338684.023782:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212042880 00000100:00100000:2.0:1787338684.023786:0:7647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212042880 00000100:00100000:2.0:1787338684.023826:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787338684.023833:0:7647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbef17aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874160212042880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787338684.023867:0:7647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbef17aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874160212042880:12345-0@lo:400:kworker.0 Request processed in 35us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338684.023898:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00080000:0.0:1787338684.024082:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787338684.024103:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee44dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1874160212042880:0@lo:400:kworker.0 00010000:00010000:3.0:1787338684.087987:0:11676:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787338684.229036:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338684.229076:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338684.229111:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192085504 00000100:00100000:3.0:1787338684.229112:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338684.229124:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192085504 00000100:00100000:3.0:1787338684.229142:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338684.229200:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192085632 00000100:00100000:2.0:1787338684.229203:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192085760 00000100:00100000:3.0:1787338684.229205:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192085632 00000100:00100000:2.0:1787338684.229209:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192085760 00000100:00100000:2.0:1787338684.229240:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 114 00000100:00100000:2.0:1787338684.229250:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4094a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+5:2357:x1874160192085504:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:1.0:1787338684.229304:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 115 00000100:00100000:1.0:1787338684.229315:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4094000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e810cb1b-6993-4b6e-89c4-e8961cf35b35+5:2357:x1874160192085760:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:2.0:1787338684.229340:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4094a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+5:2357:x1874160192085504:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 89us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338684.229349:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4094000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e810cb1b-6993-4b6e-89c4-e8961cf35b35+5:2357:x1874160192085760:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 36us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338684.229351:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 114 00000100:00100000:1.0:1787338684.229361:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 115 00000100:00100000:3.0:1787338684.229459:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 54 00000100:00100000:3.0:1787338684.229468:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee44dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:83642291-0761-4205-9531-7fd25bc2d48e+5:2357:x1874160192085632:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:3.0:1787338684.229509:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee44dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:83642291-0761-4205-9531-7fd25bc2d48e+5:2357:x1874160192085632:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 43us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338684.229515:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 54 00000100:00100000:0.0:1787338684.230288:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192085376 00000100:00100000:0.0:1787338684.230296:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192085376 00000100:00100000:0.0:1787338684.230341:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 279 00000100:00100000:0.0:1787338684.230348:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc7da5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+13:2357:x1874160192085376:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:0.0:1787338684.230387:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc7da5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+13:2357:x1874160192085376:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 39us (1275us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338684.230393:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 279 00000100:00080000:0.0:1787338684.230422:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787338684.230426:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787338684.535033:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787338684.535062:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbffa2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874160212043264:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787338684.535138:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338684.535213:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212043264 00000100:00100000:1.0:1787338684.535220:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212043264 00000100:00100000:1.0:1787338684.535260:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787338684.535269:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874160212043264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787338684.535302:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787338684.535349:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874160212043264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338684.535356:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:1.0:1787338684.535390:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbffa2e300 x1874160212043264/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787338700 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787338684.535406:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbffa2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874160212043264:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787338685.116559:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338686.136601:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787338687.162019:0:2989:0:(ldlm_pool.c:1330:ldlm_pools_recalc_task()) Negative interval(0) 00010000:00010000:1.0:1787338687.163938:0:11676:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338688.184284:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787338688.632655:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf4101c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874160212043392:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787338688.632726:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338688.632864:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212043392 00000100:00100000:2.0:1787338688.632911:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212043392 00000100:00100000:2.0:1787338688.632978:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787338688.633001:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874160212043392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787338688.633034:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787338688.633108:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874160212043392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338688.633116:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787338688.633164:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf4101c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874160212043392:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787338688.633233:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787338689.142438:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbef17bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1874160212043776:0@lo:400:kworker.0 00000100:00100000:2.0:1787338689.142509:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338689.142590:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787338689.142597:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbef179c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1874160212043904:0@lo:400:kworker.0 00000100:00100000:2.0:1787338689.142622:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338689.142675:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212043776 00000100:00100000:2.0:1787338689.142683:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212043776 00000100:00100000:2.0:1787338689.142728:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212043904 00000100:00100000:2.0:1787338689.142731:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212043904 00000100:00100000:2.0:1787338689.142763:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1787338689.142772:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf4101c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874160212043776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787338689.142820:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf4101c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874160212043776:12345-0@lo:400:kworker.0 Request processed in 49us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338689.142841:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1787338689.142859:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1787338689.142866:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf4101f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874160212043904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787338689.142918:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf4101f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874160212043904:12345-0@lo:400:kworker.0 Request processed in 53us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338689.142925:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1787338689.142962:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbef179c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1874160212043904:0@lo:400:kworker.0 00000100:00100000:2.0:1787338689.142987:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbef17bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1874160212043776:0@lo:400:kworker.0 00000100:00100000:1.0:1787338689.143428:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbef178380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874160212043648:0@lo:400:kworker.0 00000100:00100000:1.0:1787338689.143461:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338689.143481:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787338689.143487:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbef178a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d79243c8-b367-45ff-8d76-fbaa4be8becb:3317:1874160212043520:0@lo:400:kworker.0 00000100:00100000:1.0:1787338689.143515:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338689.143547:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbef178000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874160212044032:0@lo:400:kworker.0 00000100:00100000:1.0:1787338689.143572:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338689.143608:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212043648 00000100:00100000:1.0:1787338689.143613:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212043648 00000100:00100000:1.0:1787338689.143645:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1787338689.143654:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874160212043648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787338689.143690:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874160212043648:12345-0@lo:400:kworker.0 Request processed in 37us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338689.143696:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00080000:1.0:1787338689.143715:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787338689.143735:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbef178380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874160212043648:0@lo:400:kworker.0 00000100:00100000:3.0:1787338689.144105:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212044032 00000100:00100000:3.0:1787338689.144110:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212044032 00000100:00100000:3.0:1787338689.144156:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787338689.144164:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1874160212044032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787338689.144216:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1874160212044032:12345-0@lo:400:kworker.0 Request processed in 53us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338689.144223:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:3.0:1787338689.144256:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbef178000 x1874160212044032/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787338705 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787338689.144268:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbef178000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874160212044032:0@lo:400:kworker.0 00000100:00080000:1.0:1787338689.144424:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787338689.144562:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212043520 00000100:00100000:0.0:1787338689.144567:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212043520 00000100:00100000:0.0:1787338689.144603:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1787338689.144611:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc7da6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+19:3317:x1874160212043520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787338689.144963:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc7da6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+19:3317:x1874160212043520:12345-0@lo:400:kworker.0 Request processed in 352us (1446us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338689.144970:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1787338689.145502:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbef178a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d79243c8-b367-45ff-8d76-fbaa4be8becb:3317:1874160212043520:0@lo:400:kworker.0 00010000:00010000:3.0:1787338689.206170:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787338689.361503:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338689.361559:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338689.362523:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192086016 00000100:00100000:1.0:1787338689.362533:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192086016 00000100:00100000:1.0:1787338689.362629:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 119 00000100:00100000:1.0:1787338689.362640:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf4103b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+5:2358:x1874160192086016:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:1.0:1787338689.362739:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf4103b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+5:2358:x1874160192086016:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 101us (1179us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338689.362746:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 119 00000100:00100000:3.0:1787338689.363214:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338689.363301:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338689.363325:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192086272 00000100:00100000:3.0:1787338689.363329:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192086272 00000100:00100000:3.0:1787338689.363362:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 120 00000100:00100000:3.0:1787338689.363370:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee44f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e810cb1b-6993-4b6e-89c4-e8961cf35b35+5:2359:x1874160192086272:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:3.0:1787338689.363417:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee44f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e810cb1b-6993-4b6e-89c4-e8961cf35b35+5:2359:x1874160192086272:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 47us (115us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338689.363424:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 120 00000100:00100000:0.0:1787338689.363504:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192085888 00000100:00100000:0.0:1787338689.363508:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192085888 00000100:00100000:0.0:1787338689.363545:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 281 00000100:00100000:0.0:1787338689.363552:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc7da6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+13:2358:x1874160192085888:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:0.0:1787338689.363580:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc7da6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+13:2358:x1874160192085888:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 29us (2088us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338689.363587:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 281 00000100:00080000:2.0:1787338689.363763:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787338689.364447:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192086144 00000100:00100000:1.0:1787338689.364454:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192086144 00000100:00100000:1.0:1787338689.364513:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 19 00000100:00100000:1.0:1787338689.364523:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee44d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:83642291-0761-4205-9531-7fd25bc2d48e+5:2355:x1874160192086144:12345-192.168.201.53@tcp:9:kworker.0 00000020:00000080:1.0:1787338689.364544:0:6689:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x83671231080c15c8 00000100:00080000:1.0:1787338689.364552:0:6689:0:(import.c:65:import_set_state_nolock()) ffff90bbc416f000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787338689.364590:0:6689:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00010000:00010000:3.0:1787338689.365015:0:11676:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787338689.365198:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee44d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:83642291-0761-4205-9531-7fd25bc2d48e+2:2355:x1874160192086144:12345-192.168.201.53@tcp:9:kworker.0 Request processed in 674us (1982us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338689.365220:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 19 00000100:00080000:2.0:1787338689.365294:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:0.0:1787338689.528206:0:11692:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787338689.655346:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787338689.655367:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc91dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874160212044160:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787338689.655428:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338689.656183:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212044160 00000100:00100000:2.0:1787338689.656192:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212044160 00000100:00100000:2.0:1787338689.656248:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787338689.656259:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc91dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874160212044160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787338689.656292:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787338689.656350:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc91dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874160212044160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (922us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338689.656358:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:2.0:1787338689.656396:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbc91dc000 x1874160212044160/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787338705 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787338689.656415:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc91dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874160212044160:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787338690.232404:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787338690.248368:0:6714:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 83642291-0761-4205-9531-7fd25bc2d48e 00000020:00000080:3.0:1787338690.248379:0:6714:0:(genops.c:885:class_export_put()) final put ffff90bbc416b800/83642291-0761-4205-9531-7fd25bc2d48e 00000020:00000080:2.0:1787338690.248494:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90bbc416b800/83642291-0761-4205-9531-7fd25bc2d48e for lustre-OST0000 00000020:00000080:2.0:1787338690.248557:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90bbc416f000 for lustre-OST0000 00010000:00010000:3.0:1787338691.254795:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338692.281402:0:11676:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338693.302179:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787338693.750194:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787338693.750215:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf4103800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874160212044288:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787338693.750300:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338693.750617:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212044288 00000100:00100000:2.0:1787338693.750625:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212044288 00000100:00100000:2.0:1787338693.750700:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787338693.750711:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc91de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874160212044288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787338693.750749:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787338693.750796:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc91de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874160212044288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338693.750804:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787338693.750867:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf4103800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874160212044288:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787338693.751093:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787338694.263331:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbef17bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874160212044800:0@lo:400:kworker.0 00000100:00100000:1.0:1787338694.263395:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338694.263466:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787338694.263472:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbef178a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d79243c8-b367-45ff-8d76-fbaa4be8becb:3314:1874160212044416:0@lo:400:kworker.0 00000100:00100000:1.0:1787338694.263497:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338694.263515:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbef179c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1874160212044928:0@lo:400:kworker.0 00000100:00100000:1.0:1787338694.263534:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338694.263577:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212044928 00000100:00100000:1.0:1787338694.263584:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212044928 00000100:00100000:1.0:1787338694.263629:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1787338694.263647:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874160212044928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787338694.263694:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874160212044928:12345-0@lo:400:kworker.0 Request processed in 58us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338694.263701:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:1.0:1787338694.263719:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787338694.263743:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbef179c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1874160212044928:0@lo:400:kworker.0 00000100:00100000:1.0:1787338694.263773:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbef178380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1874160212044672:0@lo:400:kworker.0 00000100:00100000:1.0:1787338694.263794:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338694.263809:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787338694.263813:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbef178000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874160212044544:0@lo:400:kworker.0 00000100:00100000:1.0:1787338694.263829:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338694.264144:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212044800 00000100:00100000:3.0:1787338694.264149:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212044800 00000100:00100000:3.0:1787338694.264183:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787338694.264190:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874160212044800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787338694.264228:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874160212044800:12345-0@lo:400:kworker.0 Request processed in 40us (833us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338694.264234:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787338694.264261:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212044416 00000100:00100000:3.0:1787338694.264265:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212044416 00000100:00100000:3.0:1787338694.264286:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1787338694.264291:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc408b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+19:3314:x1874160212044416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787338694.264317:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc408b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+19:3314:x1874160212044416:12345-0@lo:400:kworker.0 Request processed in 26us (820us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338694.264323:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1787338694.264344:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212044672 00000100:00100000:3.0:1787338694.264347:0:7647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212044672 00000100:00100000:3.0:1787338694.264367:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212044544 00000100:00100000:3.0:1787338694.264370:0:7647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212044544 00000100:00100000:3.0:1787338694.264381:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1787338694.264386:0:7647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874160212044672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787338694.264524:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1787338694.264532:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874160212044544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787338694.264576:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874160212044544:12345-0@lo:400:kworker.0 Request processed in 44us (745us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338694.264581:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1787338694.264606:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbef178000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874160212044544:0@lo:400:kworker.0 00000100:00100000:1.0:1787338694.264623:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbef178a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d79243c8-b367-45ff-8d76-fbaa4be8becb:3314:1874160212044416:0@lo:400:kworker.0 00000100:00100000:1.0:1787338694.264631:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbef17bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874160212044800:0@lo:400:kworker.0 00000100:00100000:3.0:1787338694.264720:0:7647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874160212044672:12345-0@lo:400:kworker.0 Request processed in 332us (924us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338694.264726:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00080000:3.0:1787338694.264742:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787338694.264755:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbef178380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1874160212044672:0@lo:400:kworker.0 00000100:00100000:0.0:1787338694.264828:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee081180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874160212045056:0@lo:400:kworker.0 00000100:00100000:0.0:1787338694.264855:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338694.264893:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212045056 00000100:00100000:0.0:1787338694.264907:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212045056 00000100:00080000:1.0:1787338694.266660:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787338694.266844:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787338694.266858:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee083480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1874160212045056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787338694.267099:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee083480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1874160212045056:12345-0@lo:400:kworker.0 Request processed in 246us (2242us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338694.267106:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:3.0:1787338694.267193:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbee081180 x1874160212045056/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787338710 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787338694.267216:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee081180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874160212045056:0@lo:400:kworker.0 00010000:00010000:3.0:1787338694.336407:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787338694.475254:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338694.475329:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338694.475362:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338694.476629:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192086656 00000100:00100000:0.0:1787338694.476643:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192086656 00000100:00100000:0.0:1787338694.476716:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192086528 00000100:00100000:0.0:1787338694.476719:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192086528 00000100:00100000:0.0:1787338694.476742:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 124 00000100:00100000:0.0:1787338694.476752:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf4103800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e810cb1b-6993-4b6e-89c4-e8961cf35b35+5:2359:x1874160192086656:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:2.0:1787338694.476857:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 125 00000100:00100000:2.0:1787338694.476866:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf4100e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+5:2359:x1874160192086528:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:2.0:1787338694.476976:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf4100e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+5:2359:x1874160192086528:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 112us (1613us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338694.476994:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 125 00000100:00080000:2.0:1787338694.477098:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787338694.477249:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf4103800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e810cb1b-6993-4b6e-89c4-e8961cf35b35+5:2359:x1874160192086656:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 498us (1919us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338694.477256:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 124 00000100:00100000:3.0:1787338694.478143:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192086400 00000100:00100000:3.0:1787338694.478151:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192086400 00000100:00100000:3.0:1787338694.478228:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 283 00000100:00100000:3.0:1787338694.478237:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc408b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+13:2359:x1874160192086400:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:3.0:1787338694.478280:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc408b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+13:2359:x1874160192086400:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 45us (3036us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338694.478288:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 283 00000100:00100000:3.0:1787338694.774367:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787338694.774389:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc91dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874160212045184:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787338694.774460:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338694.774584:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212045184 00000100:00100000:3.0:1787338694.774592:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212045184 00000100:00100000:3.0:1787338694.775091:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787338694.775104:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc91de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874160212045184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787338694.775141:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787338694.775210:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc91de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874160212045184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (751us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338694.775217:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:2.0:1787338694.775336:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbc91dea00 x1874160212045184/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787338710 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787338694.775354:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc91dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874160212045184:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787338695.351334:0:11676:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338696.375277:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338697.414020:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338698.422086:0:11676:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787338698.870610:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf4103100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874160212045312:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787338698.870685:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338698.870845:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212045312 00000100:00100000:0.0:1787338698.870853:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212045312 00000100:00100000:0.0:1787338698.871196:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787338698.871207:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874160212045312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787338698.871243:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787338698.871309:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874160212045312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338698.871317:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787338698.871338:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf4103100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874160212045312:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787338698.872017:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787338699.386323:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbef178a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1874160212045696:0@lo:400:kworker.0 00000100:00100000:1.0:1787338699.386413:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338699.386493:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787338699.386500:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbef17bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874160212045568:0@lo:400:kworker.0 00000100:00100000:1.0:1787338699.386547:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338699.386577:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf3e90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874160212046080:0@lo:400:kworker.0 00000100:00100000:1.0:1787338699.386946:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338699.386990:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212045696 00000100:00100000:1.0:1787338699.386998:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212045696 00000100:00100000:1.0:1787338699.387053:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212045568 00000100:00100000:1.0:1787338699.387057:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212045568 00000100:00100000:1.0:1787338699.387079:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1787338699.387095:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf3e92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874160212045696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787338699.387148:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf3e92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874160212045696:12345-0@lo:400:kworker.0 Request processed in 54us (735us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338699.387155:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1787338699.387175:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1787338699.387181:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbef19e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874160212045568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787338699.387207:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbef19e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874160212045568:12345-0@lo:400:kworker.0 Request processed in 27us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338699.387213:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00080000:1.0:1787338699.387229:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787338699.388130:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbef17bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874160212045568:0@lo:400:kworker.0 00000100:00100000:1.0:1787338699.388143:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbef178a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1874160212045696:0@lo:400:kworker.0 00000100:00100000:0.0:1787338699.389177:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbef178380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d79243c8-b367-45ff-8d76-fbaa4be8becb:3315:1874160212045440:0@lo:400:kworker.0 00000100:00100000:0.0:1787338699.389272:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338699.389319:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbef179c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1874160212045952:0@lo:400:kworker.0 00000100:00100000:0.0:1787338699.389347:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338699.389386:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787338699.389393:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbef178000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874160212045824:0@lo:400:kworker.0 00000100:00100000:0.0:1787338699.389420:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338699.389681:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212045440 00000100:00100000:2.0:1787338699.389689:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212045440 00000100:00100000:2.0:1787338699.389745:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1787338699.389754:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc408a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+19:3315:x1874160212045440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787338699.389811:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc408a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+19:3315:x1874160212045440:12345-0@lo:400:kworker.0 Request processed in 57us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338699.389817:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1787338699.389860:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbef178380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d79243c8-b367-45ff-8d76-fbaa4be8becb:3315:1874160212045440:0@lo:400:kworker.0 00000100:00100000:3.0:1787338699.391078:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212046080 00000100:00100000:3.0:1787338699.391088:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212046080 00000100:00100000:3.0:1787338699.391169:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212045824 00000100:00100000:3.0:1787338699.391173:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212045824 00000100:00100000:3.0:1787338699.391196:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787338699.391220:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbef19ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1874160212046080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787338699.391301:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbef19ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1874160212046080:12345-0@lo:400:kworker.0 Request processed in 98us (4355us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338699.391308:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787338699.391321:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787338699.391327:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee082680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1874160212045824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787338699.391362:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee082680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1874160212045824:12345-0@lo:400:kworker.0 Request processed in 35us (1941us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338699.391846:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787338699.391936:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbef178000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874160212045824:0@lo:400:kworker.0 00010000:00080000:3.0:1787338699.391975:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbf3e90380 x1874160212046080/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787338715 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787338699.391986:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf3e90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874160212046080:0@lo:400:kworker.0 00000100:00100000:1.0:1787338699.392086:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212045952 00000100:00100000:1.0:1787338699.392091:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212045952 00000100:00100000:1.0:1787338699.392140:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787338699.392148:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee081880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874160212045952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787338699.392193:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee081880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874160212045952:12345-0@lo:400:kworker.0 Request processed in 46us (2844us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338699.392199:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00080000:0.0:1787338699.392903:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787338699.392909:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787338699.393607:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbef179c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1874160212045952:0@lo:400:kworker.0 00010000:00010000:1.0:1787338699.451884:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787338699.592801:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338699.592846:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338699.592937:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192087040 00000100:00100000:1.0:1787338699.592950:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192087040 00000100:00100000:1.0:1787338699.593025:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 129 00000100:00100000:1.0:1787338699.593038:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee080700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e810cb1b-6993-4b6e-89c4-e8961cf35b35+5:2356:x1874160192087040:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:1.0:1787338699.593115:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee080700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e810cb1b-6993-4b6e-89c4-e8961cf35b35+5:2356:x1874160192087040:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 80us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338699.593131:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 129 00000100:00080000:1.0:1787338699.593167:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787338699.594484:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192086784 00000100:00100000:3.0:1787338699.594495:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192086784 00000100:00100000:3.0:1787338699.594546:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 285 00000100:00100000:3.0:1787338699.594558:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc408bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+13:2356:x1874160192086784:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:3.0:1787338699.594629:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc408bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+13:2356:x1874160192086784:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 74us (1839us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338699.594637:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 285 00000100:00100000:0.0:1787338699.600563:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338699.601054:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192086912 00000100:00100000:2.0:1787338699.601065:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192086912 00000100:00080000:1.0:1787338699.601117:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787338699.601152:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 130 00000100:00100000:2.0:1787338699.601165:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee083100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+5:2356:x1874160192086912:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:2.0:1787338699.601248:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee083100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+5:2356:x1874160192086912:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 86us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338699.601257:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 130 00000040:00080000:1.0:1787338699.766712:0:11692:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787338699.898009:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc91dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874160212046208:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787338699.898080:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338699.898266:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212046208 00000100:00100000:3.0:1787338699.898280:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212046208 00000100:00100000:3.0:1787338699.898332:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787338699.898342:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf4100700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874160212046208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787338699.898373:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787338699.898426:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf4100700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874160212046208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338699.898433:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:2.0:1787338699.898497:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbc91dea00 x1874160212046208/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787338715 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787338699.898517:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc91dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874160212046208:0@lo:13:osp-pre-1-0.0 00000001:02000400:3.0:1787338700.247197:0:11858:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 14:58:19 (1787338699) 00010000:00010000:3.0:1787338700.472467:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338701.494568:0:11676:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338702.522632:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787338702.679803:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338702.679918:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192087168 00000100:00100000:2.0:1787338702.679928:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192087168 00000100:00100000:2.0:1787338702.680013:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 32 00000100:00100000:2.0:1787338702.680024:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbef19d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+5:10224:x1874160192087168:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787338702.680046:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787338702.680069:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c1693 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab6a5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338702.680133:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3600/0x83671231080c169a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338702.680147:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3600/0x83671231080c169a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338702.680159:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3600/0x83671231080c169a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787338702.680325:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:2.0:1787338702.680524:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787338702.680529:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787338702.680642:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3600/0x83671231080c169a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338702.680667:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c1693 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab6a5 expref: 7 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338702.680685:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3600/0x83671231080c169a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab6a5 expref: 6 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338702.680694:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90bbdee56d00) 00010000:00010000:2.0:1787338702.680697:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787338702.680700:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf40e3600, rc 0) 00000100:00100000:2.0:1787338702.680764:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbef19d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+6:10224:x1874160192087168:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 Request processed in 740us (969us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338702.680772:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 32 00000100:00100000:2.0:1787338702.700679:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338702.702381:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192087296 00000100:00100000:3.0:1787338702.702396:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192087296 00000100:00100000:3.0:1787338702.702481:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 33 00000100:00100000:3.0:1787338702.702493:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf4102680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+6:10225:x1874160192087296:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787338702.702514:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787338702.702540:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5200/0x83671231080c16a1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab6ac expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338702.702625:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4400/0x83671231080c16a8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338702.702640:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4400/0x83671231080c16a8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338702.702651:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4400/0x83671231080c16a8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338702.702667:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c16af lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338702.702693:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c16af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338702.702701:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c16af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338702.703178:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4600/0x83671231080c16b6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338702.703188:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4600/0x83671231080c16b6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338702.703197:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4600/0x83671231080c16b6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787338702.703670:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1787338702.703675:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1787338702.704034:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4600/0x83671231080c16b6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338702.704048:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4400/0x83671231080c16a8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338702.704055:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4400/0x83671231080c16a8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338702.704063:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4400/0x83671231080c16a8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338702.704069:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea4400 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:3.0:1787338702.704073:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4400/0x83671231080c16a8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338702.704088:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4400/0x83671231080c16a8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338702.704102:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90bbdee56d00) 00010000:00010000:3.0:1787338702.704105:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787338702.704110:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4400/0x83671231080c16a8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338702.704116:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4400/0x83671231080c16a8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338702.704130:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c16af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338702.704137:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c16af lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338702.704143:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c16af lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338702.704148:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea5400 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:3.0:1787338702.704151:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c16af lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338702.704157:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c16af lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338702.704164:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff90bbd38d6800) 00010000:00010000:3.0:1787338702.704167:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787338702.704170:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c16af lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338702.704185:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c16af lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338702.704220:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5200/0x83671231080c16a1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab6ac expref: 8 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338702.704234:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4600/0x83671231080c16b6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab6ac expref: 7 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338702.704817:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff90bbd38d6200) 00010000:00010000:3.0:1787338702.704821:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787338702.704825:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf7ea4600, rc 0) 00000100:00100000:3.0:1787338702.704965:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf4102680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+7:10225:x1874160192087296:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 Request processed in 2472us (4293us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338702.704974:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 33 00000100:00100000:0.0:1787338702.717065:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338702.721425:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192087552 00000100:00100000:2.0:1787338702.721441:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192087552 00000100:00100000:2.0:1787338702.721513:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 34 00000100:00100000:2.0:1787338702.721522:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee082300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+7:10225:x1874160192087552:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787338702.721540:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787338702.721565:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c16bd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab6b3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338702.721631:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c16c4 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338702.721645:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c16c4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338702.721675:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c16c4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338702.721707:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3800/0x83671231080c16cb lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338702.721712:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3800/0x83671231080c16cb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338702.721717:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3800/0x83671231080c16cb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338702.722259:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2400/0x83671231080c16d2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338702.722269:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2400/0x83671231080c16d2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338702.722276:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2400/0x83671231080c16d2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787338702.722286:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1787338702.722478:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c16c4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338702.722484:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c16c4 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338702.722489:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c16c4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338702.722493:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e2c00 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:2.0:1787338702.722500:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c16c4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338702.722506:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c16c4 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338702.722516:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff90bbd38d6200) 00010000:00010000:2.0:1787338702.722518:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787338702.722521:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c16c4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338702.722525:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c16c4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338702.722536:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3800/0x83671231080c16cb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338702.722539:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3800/0x83671231080c16cb lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338702.722542:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3800/0x83671231080c16cb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338702.722546:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e3800 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:2.0:1787338702.722547:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3800/0x83671231080c16cb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338702.722550:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3800/0x83671231080c16cb lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338702.722554:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff90bbdee56300) 00010000:00010000:2.0:1787338702.722555:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787338702.722560:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3800/0x83671231080c16cb lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338702.722564:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3800/0x83671231080c16cb lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338702.722956:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c16bd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab6b3 expref: 10 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338702.722972:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2400/0x83671231080c16d2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab6b3 expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338702.722980:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90bbdee56100) 00010000:00010000:2.0:1787338702.722982:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787338702.722985:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf40e2400, rc 0) 00000100:00100000:2.0:1787338702.723051:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee082300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+9:10225:x1874160192087552:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 Request processed in 1529us (5995us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1787338702.723056:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 34 00000100:00100000:0.0:1787338702.733707:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338702.733796:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192087680 00000100:00100000:2.0:1787338702.733805:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192087680 00000100:00100000:2.0:1787338702.733869:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 35 00000100:00100000:2.0:1787338702.733913:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee082a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+9:10225:x1874160192087680:12345-192.168.201.53@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1787338702.734016:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee082a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+9:10225:x1874160192087680:12345-192.168.201.53@tcp:59:lhsmtool_posix.0 Request processed in 106us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338702.734024:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 35 00000040:00080000:1.0:1787338702.838782:0:11692:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787338703.543047:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787338703.992378:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbef19ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874160212046336:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787338703.992455:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338703.992523:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212046336 00000100:00100000:1.0:1787338703.992530:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212046336 00000100:00100000:1.0:1787338703.992599:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787338703.992609:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbef19c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874160212046336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787338703.992654:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787338703.992696:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbef19c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874160212046336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338703.992703:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:1.0:1787338703.992727:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787338703.992763:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbef19ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874160212046336:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787338704.504554:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf4100a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1874160212046720:0@lo:400:kworker.0 00000100:00100000:2.0:1787338704.504652:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338704.504721:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787338704.504737:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf4100380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874160212046592:0@lo:400:kworker.0 00000100:00100000:2.0:1787338704.504764:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338704.504783:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbd172e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874160212047104:0@lo:400:kworker.0 00000100:00100000:2.0:1787338704.504817:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338704.504850:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212046720 00000100:00100000:2.0:1787338704.504856:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212046720 00000100:00100000:2.0:1787338704.504933:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212046592 00000100:00100000:2.0:1787338704.504937:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212046592 00000100:00100000:2.0:1787338704.504961:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1787338704.504970:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbff8fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874160212046720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787338704.505022:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbff8fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874160212046720:12345-0@lo:400:kworker.0 Request processed in 53us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338704.505029:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1787338704.505047:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1787338704.505053:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbff8fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874160212046592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787338704.505084:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbff8fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874160212046592:12345-0@lo:400:kworker.0 Request processed in 31us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338704.505091:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00080000:2.0:1787338704.505121:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787338704.505155:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf4100380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874160212046592:0@lo:400:kworker.0 00000100:00100000:2.0:1787338704.505166:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf4100a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1874160212046720:0@lo:400:kworker.0 00000100:00100000:1.0:1787338704.505545:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf4101880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d79243c8-b367-45ff-8d76-fbaa4be8becb:3315:1874160212046464:0@lo:400:kworker.0 00000100:00100000:1.0:1787338704.505593:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338704.505628:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf4103100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1874160212046976:0@lo:400:kworker.0 00000100:00100000:1.0:1787338704.505651:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338704.505668:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787338704.505680:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf4102d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874160212046848:0@lo:400:kworker.0 00000100:00100000:1.0:1787338704.505702:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338704.505775:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212046464 00000100:00100000:0.0:1787338704.505780:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212046464 00000100:00100000:0.0:1787338704.505826:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1787338704.505834:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4089850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+19:3315:x1874160212046464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787338704.505893:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4089850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+19:3315:x1874160212046464:12345-0@lo:400:kworker.0 Request processed in 60us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338704.505900:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1787338704.505935:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf4101880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d79243c8-b367-45ff-8d76-fbaa4be8becb:3315:1874160212046464:0@lo:400:kworker.0 00000100:00100000:2.0:1787338704.507489:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212046976 00000100:00100000:2.0:1787338704.507499:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212046976 00000100:00100000:2.0:1787338704.507566:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1787338704.507585:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbef19ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874160212046976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787338704.507651:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbef19ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874160212046976:12345-0@lo:400:kworker.0 Request processed in 78us (1999us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338704.507669:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1787338704.508365:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf4103100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1874160212046976:0@lo:400:kworker.0 00000100:00080000:1.0:1787338704.508488:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787338704.510567:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212047104 00000100:00100000:3.0:1787338704.510589:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212047104 00000100:00100000:3.0:1787338704.510722:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212046848 00000100:00100000:3.0:1787338704.510726:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212046848 00000100:00100000:3.0:1787338704.510757:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787338704.510767:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbff8fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1874160212047104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787338704.510866:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbff8fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1874160212047104:12345-0@lo:400:kworker.0 Request processed in 100us (6058us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338704.510893:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787338704.510911:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787338704.510919:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbef19dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1874160212046848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787338704.510970:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbef19dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1874160212046848:12345-0@lo:400:kworker.0 Request processed in 52us (5266us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338704.510977:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787338704.511023:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf4102d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874160212046848:0@lo:400:kworker.0 00010000:00080000:3.0:1787338704.511066:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbd172e680 x1874160212047104/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787338720 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787338704.511076:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbd172e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874160212047104:0@lo:400:kworker.0 00000100:00080000:1.0:1787338704.511241:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787338704.575491:0:11676:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787338704.708515:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338704.708671:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192087808 00000100:00100000:0.0:1787338704.708681:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192087808 00000100:00100000:0.0:1787338704.708738:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 287 00000100:00100000:0.0:1787338704.708749:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc408b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+13:2357:x1874160192087808:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:0.0:1787338704.708846:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc408b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+13:2357:x1874160192087808:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 98us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338704.708855:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 287 00000100:00100000:3.0:1787338704.710119:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338704.710244:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192088064 00000100:00100000:2.0:1787338704.710251:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192088064 00000100:00100000:2.0:1787338704.710312:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 134 00000100:00100000:2.0:1787338704.710321:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc91dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e810cb1b-6993-4b6e-89c4-e8961cf35b35+5:2357:x1874160192088064:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:2.0:1787338704.710376:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc91dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e810cb1b-6993-4b6e-89c4-e8961cf35b35+5:2357:x1874160192088064:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 56us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338704.710383:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 134 00000100:00080000:0.0:1787338704.710957:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787338704.722711:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338704.722953:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192087936 00000100:00100000:3.0:1787338704.722964:0:7647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192087936 00000100:00100000:3.0:1787338704.723736:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 135 00000100:00100000:3.0:1787338704.723754:0:7647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee081500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+9:2356:x1874160192087936:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:3.0:1787338704.723855:0:7647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee081500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+9:2356:x1874160192087936:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 106us (1152us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338704.723863:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 135 00000100:00080000:1.0:1787338704.732351:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787338705.021550:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbff8ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874160212047232:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787338705.021624:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338705.021741:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212047232 00000100:00100000:2.0:1787338705.021748:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212047232 00000100:00100000:2.0:1787338705.021793:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787338705.021814:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbff8fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874160212047232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787338705.021865:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787338705.021926:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbff8fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874160212047232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338705.021933:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:2.0:1787338705.021969:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbff8ff100 x1874160212047232/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787338721 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787338705.021987:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbff8ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874160212047232:0@lo:13:osp-pre-1-0.0 00000001:00080000:3.0:1787338705.103546:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967309 is committed 00000100:00100000:3.0:1787338705.428555:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338705.428629:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192088192 00000100:00100000:1.0:1787338705.428638:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192088192 00000100:00100000:1.0:1787338705.428693:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 36 00000100:00100000:1.0:1787338705.428703:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc91dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+8:10268:x1874160192088192:12345-192.168.201.53@tcp:101:lfs.0 00010000:00010000:1.0:1787338705.428724:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787338705.428742:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9cc00/0x83671231080c16e0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab6ba expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338705.428810:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ca00/0x83671231080c16e7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338705.428824:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ca00/0x83671231080c16e7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338705.428836:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ca00/0x83671231080c16e7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338705.428849:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d400/0x83671231080c16ee lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338705.428856:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d400/0x83671231080c16ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338705.428863:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d400/0x83671231080c16ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338705.429116:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ca00/0x83671231080c16e7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338705.429124:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ca00/0x83671231080c16e7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338705.429130:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ca00/0x83671231080c16e7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338705.429136:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbfbe9ca00 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:1.0:1787338705.429140:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ca00/0x83671231080c16e7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338705.429147:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ca00/0x83671231080c16e7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338705.429159:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90bbdee56d00) 00010000:00010000:1.0:1787338705.429162:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787338705.429166:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ca00/0x83671231080c16e7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338705.429172:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ca00/0x83671231080c16e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338705.429183:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d400/0x83671231080c16ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338705.429189:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d400/0x83671231080c16ee lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338705.429205:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d400/0x83671231080c16ee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338705.429217:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbfbe9d400 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:1.0:1787338705.429220:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d400/0x83671231080c16ee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338705.429226:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d400/0x83671231080c16ee lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338705.429235:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff90bbc2a93500) 00010000:00010000:1.0:1787338705.429237:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787338705.429240:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d400/0x83671231080c16ee lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338705.429246:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d400/0x83671231080c16ee lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338705.429278:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9cc00/0x83671231080c16e0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab6ba expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338705.429288:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90bbdee56d00) 00010000:00010000:1.0:1787338705.429290:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787338705.429293:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9cc00/0x83671231080c16e0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab6ba expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338705.429302:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbfbe9cc00, rc 0) 00000100:00100000:1.0:1787338705.429360:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc91dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+8:10268:x1874160192088192:12345-192.168.201.53@tcp:101:lfs.0 Request processed in 657us (813us total) trans 0 rc 301/301 00000100:00100000:1.0:1787338705.429368:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 36 00000100:00100000:3.0:1787338705.446418:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338705.446503:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192088448 00000100:00100000:1.0:1787338705.446522:0:7647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192088448 00000100:00100000:1.0:1787338705.446590:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 37 00000100:00100000:1.0:1787338705.446601:0:7647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbd172e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+8:10268:x1874160192088448:12345-192.168.201.53@tcp:36:lfs.0 00010000:00010000:1.0:1787338705.446657:0:7647:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787338705.446682:0:7647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3600/0x83671231080c169a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab6a5 expref: 8 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338705.446700:0:7647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90bbdee56d00) 00010000:00010000:1.0:1787338705.446710:0:7647:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787338705.447010:0:7647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9cc00/0x83671231080c16f5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338705.447024:0:7647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9cc00/0x83671231080c16f5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338705.447034:0:7647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9cc00/0x83671231080c16f5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338705.447046:0:7647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d400/0x83671231080c16fc lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338705.447053:0:7647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d400/0x83671231080c16fc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338705.447059:0:7647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d400/0x83671231080c16fc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787338705.449650:0:7647:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1787338705.449670:0:7647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9cc00/0x83671231080c16f5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338705.449681:0:7647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9cc00/0x83671231080c16f5 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338705.449698:0:7647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9cc00/0x83671231080c16f5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338705.449705:0:7647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbfbe9cc00 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:1.0:1787338705.449710:0:7647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9cc00/0x83671231080c16f5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338705.449719:0:7647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9cc00/0x83671231080c16f5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338705.449736:0:7647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90bbc2a93500) 00010000:00010000:1.0:1787338705.449740:0:7647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787338705.449744:0:7647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9cc00/0x83671231080c16f5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338705.449750:0:7647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9cc00/0x83671231080c16f5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787338705.449769:0:7647:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001bea77c6 reply state 000000001bd0776d transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d400/0x83671231080c16fc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338705.449778:0:7647:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787338705.450971:0:7647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbd172e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+9:10268:x1874160192088448:12345-192.168.201.53@tcp:36:lfs.0 Request processed in 4364us (4552us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1787338705.450982:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 37 00010000:00010000:3.0:1787338705.471998:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d400/0x83671231080c16fc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338705.472017:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d400/0x83671231080c16fc lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338705.472043:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d400/0x83671231080c16fc lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338705.472049:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbfbe9d400 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:3.0:1787338705.472054:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d400/0x83671231080c16fc lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338705.472062:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d400/0x83671231080c16fc lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338705.472080:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff90bbc2a93200) 00010000:00010000:3.0:1787338705.472083:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787338705.472088:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d400/0x83671231080c16fc lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338705.472094:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d400/0x83671231080c16fc lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338705.586223:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338705.587417:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192088576 00000100:00100000:2.0:1787338705.587430:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192088576 00000100:00100000:2.0:1787338705.587496:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 38 00000100:00100000:2.0:1787338705.587507:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee080e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+8:10276:x1874160192088576:12345-192.168.201.53@tcp:101:lctl.0 00010000:00010000:2.0:1787338705.587544:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787338705.587679:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c1703 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab6c1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338705.587744:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3800/0x83671231080c170a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338705.587760:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3800/0x83671231080c170a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338705.587771:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3800/0x83671231080c170a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787338705.587841:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787338705.587845:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1787338705.587914:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3800/0x83671231080c170a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338705.587939:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c1703 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab6c1 expref: 10 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338705.587956:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3800/0x83671231080c170a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab6c1 expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338705.587964:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90bbdee56300) 00010000:00010000:2.0:1787338705.587967:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787338705.587970:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf40e3800, rc 0) 00000100:00100000:2.0:1787338705.588028:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee080e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+9:10276:x1874160192088576:12345-192.168.201.53@tcp:101:lctl.0 Request processed in 523us (1813us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338705.588035:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 38 00010000:00010000:1.0:1787338705.593336:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787338705.691021:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338705.691121:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192088704 00000100:00100000:2.0:1787338705.691132:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192088704 00000100:00100000:2.0:1787338705.691195:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 39 00000100:00100000:2.0:1787338705.691205:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbef19df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+9:10282:x1874160192088704:12345-192.168.201.53@tcp:101:bash.0 00010000:00010000:2.0:1787338705.691225:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787338705.691246:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c1711 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab6c8 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338705.691313:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c1718 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338705.691328:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c1718 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338705.691339:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c1718 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338705.691353:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3600/0x83671231080c171f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338705.691361:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3600/0x83671231080c171f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338705.691367:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3600/0x83671231080c171f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338705.691480:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3c00/0x83671231080c1726 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338705.691488:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3c00/0x83671231080c1726 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338705.691512:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3c00/0x83671231080c1726 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787338705.691545:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:2.0:1787338705.691560:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787338705.691604:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3c00/0x83671231080c1726 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338705.691616:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c1718 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338705.691622:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c1718 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338705.691628:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c1718 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338705.691634:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e3200 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:2.0:1787338705.691638:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c1718 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338705.691645:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c1718 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338705.691658:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90bbdee56300) 00010000:00010000:2.0:1787338705.691661:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787338705.691666:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c1718 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338705.691672:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c1718 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338705.691700:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3600/0x83671231080c171f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338705.691706:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3600/0x83671231080c171f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338705.691713:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3600/0x83671231080c171f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338705.691718:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e3600 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:2.0:1787338705.691721:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3600/0x83671231080c171f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338705.691727:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3600/0x83671231080c171f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338705.691734:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff90bbdee56800) 00010000:00010000:2.0:1787338705.691736:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787338705.691739:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3600/0x83671231080c171f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338705.691743:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3600/0x83671231080c171f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338705.691775:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c1711 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab6c8 expref: 11 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338705.691818:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3c00/0x83671231080c1726 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab6c8 expref: 10 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338705.691837:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff90bbdee56e00) 00010000:00010000:2.0:1787338705.691843:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787338705.691846:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf40e3c00, rc 0) 00000100:00100000:2.0:1787338705.691968:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbef19df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+10:10282:x1874160192088704:12345-192.168.201.53@tcp:101:bash.0 Request processed in 762us (957us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338705.691976:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 39 00000100:00100000:2.0:1787338705.697177:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338705.697276:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192088960 00000100:00100000:1.0:1787338705.697286:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192088960 00000100:00100000:1.0:1787338705.697347:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 40 00000100:00100000:1.0:1787338705.697374:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbff8ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+10:10282:x1874160192088960:12345-192.168.201.53@tcp:101:bash.0 00010000:00010000:1.0:1787338705.697395:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787338705.697415:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ca00/0x83671231080c172d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab6cf expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338705.697533:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9de00/0x83671231080c1734 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338705.697544:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9de00/0x83671231080c1734 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338705.697563:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9de00/0x83671231080c1734 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338705.697616:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c173b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338705.697625:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c173b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338705.697632:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c173b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787338705.703005:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:2.0:1787338705.703312:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c1742 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338705.703329:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c1742 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338705.703341:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c1742 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338705.703451:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9de00/0x83671231080c1734 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338705.703460:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9de00/0x83671231080c1734 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338705.703466:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9de00/0x83671231080c1734 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338705.703473:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbfbe9de00 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:2.0:1787338705.703477:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9de00/0x83671231080c1734 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338705.703500:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9de00/0x83671231080c1734 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338705.703513:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff90bbdee56e00) 00010000:00010000:2.0:1787338705.703516:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787338705.703521:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9de00/0x83671231080c1734 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338705.703527:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9de00/0x83671231080c1734 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787338705.703542:0:5840:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000713f5388 reply state 00000000531f8e35 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c173b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338705.703605:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787338705.703644:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ca00/0x83671231080c172d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab6cf expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338705.703661:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c1742 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab6cf expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338705.703669:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90bbdee56800) 00010000:00010000:2.0:1787338705.703672:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787338705.703675:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf40e2c00, rc 0) 00000100:00100000:2.0:1787338705.703844:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbff8ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+13:10282:x1874160192088960:12345-192.168.201.53@tcp:101:bash.0 Request processed in 6445us (6648us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1787338705.703852:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 40 00010000:00010000:1.0:1787338705.708389:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c173b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338705.708409:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c173b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338705.708417:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c173b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338705.708440:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbfbe9d600 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:1.0:1787338705.708445:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c173b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338705.708452:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c173b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338705.708469:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff90bbc2a93500) 00010000:00010000:1.0:1787338705.708472:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787338705.708476:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c173b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338705.708482:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c173b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338705.716061:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338705.716337:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192089088 00000100:00100000:3.0:1787338705.716346:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192089088 00000100:00100000:3.0:1787338705.716402:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 20 00000100:00100000:3.0:1787338705.716410:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbff8fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2355:x1874160192089088:12345-192.168.201.53@tcp:8:bash.0 00010000:00080000:3.0:1787338705.716441:0:6690:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 83642291-0761-4205-9531-7fd25bc2d48e@192.168.201.53@tcp t0 exp 0000000000000000 cur 358 last 0 00000020:00000080:3.0:1787338705.716471:0:6690:0:(genops.c:1385:class_connect()) connect: client 83642291-0761-4205-9531-7fd25bc2d48e, cookie 0x83671231080c1750 00002000:00100000:3.0:1787338705.716484:0:6690:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 83642291-0761-4205-9531-7fd25bc2d48e/ffff90bbedf90000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392c ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787338705.716495:0:6690:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787338705.716739:0:6690:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787338705.716792:0:6690:0:(import.c:65:import_set_state_nolock()) ffff90bbedf92800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787338705.716864:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbff8fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:83642291-0761-4205-9531-7fd25bc2d48e+6:2355:x1874160192089088:12345-192.168.201.53@tcp:8:bash.0 Request processed in 452us (811us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338705.716902:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 20 00000100:00100000:3.0:1787338705.720058:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338705.720159:0:10743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192089216 00000100:00100000:0.0:1787338705.720169:0:10743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192089216 00000100:00100000:0.0:1787338705.720257:0:10743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 21 00000100:00100000:0.0:1787338705.720268:0:10743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf3e90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:83642291-0761-4205-9531-7fd25bc2d48e+6:0:x1874160192089216:12345-192.168.201.53@tcp:101:bash.0 00000100:00080000:1.0:1787338705.720283:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787338705.720286:0:10743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787338705.720308:0:10743:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005a8a3f67/0x83671231080c1757 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab6d6 expref: -99 pid: 10743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787338705.720335:0:10743:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787338705.720367:0:10743:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=358s v=(0 0) 00010000:00010000:0.0:1787338705.720373:0:10743:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787338705.720382:0:10743:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005a8a3f67/0x83671231080c1757 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab6d6 expref: 7 pid: 10743 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338705.720405:0:10743:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005a8a3f67/0x83671231080c1757 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab6d6 expref: 7 pid: 10743 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338705.720419:0:10743:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbc0031400, rc 0) 00000100:00100000:0.0:1787338705.720482:0:10743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf3e90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:83642291-0761-4205-9531-7fd25bc2d48e+7:0:x1874160192089216:12345-192.168.201.53@tcp:101:bash.0 Request processed in 216us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338705.720507:0:10743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 21 00000100:00100000:1.0:1787338705.723715:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338705.724132:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192089344 00000100:00100000:0.0:1787338705.724152:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192089344 00000100:00100000:0.0:1787338705.724398:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 22 00000100:00100000:0.0:1787338705.724409:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbef19fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:83642291-0761-4205-9531-7fd25bc2d48e+7:10282:x1874160192089344:12345-192.168.201.53@tcp:101:bash.0 00010000:00010000:0.0:1787338705.724426:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787338705.724443:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000697ce498/0x83671231080c175e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab6dd expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338705.724473:0:6691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005a8a3f67/0x83671231080c1757 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab6d6 expref: 8 pid: 10743 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338705.724482:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787338705.724486:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787338705.724492:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000697ce498/0x83671231080c175e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab6dd expref: 8 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338705.724527:0:6691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005a8a3f67/0x83671231080c1757 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab6d6 expref: 8 pid: 10743 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338705.724541:0:6691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005a8a3f67/0x83671231080c1757 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab6d6 expref: 8 pid: 10743 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338705.724709:0:6691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee080000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6691:1874160212047360:192.168.201.53@tcp:104: 00000100:00100000:0.0:1787338705.724818:0:6691:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbd8e9ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1787338705.728626:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338705.728725:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192089472 00000100:00100000:2.0:1787338705.728746:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192089472 00010000:00010000:2.0:1787338705.728800:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005a8a3f67/0x83671231080c1757 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab6d6 expref: 9 pid: 10743 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338705.728848:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 35 00000100:00100000:2.0:1787338705.728858:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbef19f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:83642291-0761-4205-9531-7fd25bc2d48e+9:2358:x1874160192089472:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787338705.728903:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1787338705.728910:0:6691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee080000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6691:1874160212047360:192.168.201.53@tcp:104: 00010000:00010000:2.0:1787338705.728925:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005a8a3f67/0x83671231080c1757 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab6d6 expref: 9 pid: 10743 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338705.728936:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005a8a3f67/0x83671231080c1757 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab6d6 expref: 9 pid: 10743 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338705.733045:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000697ce498/0x83671231080c175e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab6dd expref: 9 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338705.733074:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbc0030a00, rc 0) 00000100:00100000:0.0:1787338705.733182:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbef19fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:83642291-0761-4205-9531-7fd25bc2d48e+9:10282:x1874160192089344:12345-192.168.201.53@tcp:101:bash.0 Request processed in 8766us (9466us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338705.733199:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 22 00010000:00010000:2.0:1787338705.735715:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005a8a3f67/0x83671231080c1757 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab6d6 expref: 8 pid: 10743 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338705.735799:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787338705.735804:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787338705.735813:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000697ce498/0x83671231080c175e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab6dd expref: 7 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338705.735824:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000697ce498/0x83671231080c175e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab6dd expref: 7 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338705.735987:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000697ce498/0x83671231080c175e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab6dd expref: 7 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338705.736023:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbff8fd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5824:1874160212047488:192.168.201.53@tcp:105: 00000100:00100000:2.0:1787338705.736165:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbf41c19c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787338705.741321:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338705.741506:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbff8fd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5824:1874160212047488:192.168.201.53@tcp:105: 00010000:00010000:2.0:1787338705.741530:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787338705.741584:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbef19f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:83642291-0761-4205-9531-7fd25bc2d48e+7:2358:x1874160192089472:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 12727us (12966us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338705.741593:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 35 00000100:00100000:0.0:1787338705.746297:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192089728 00000100:00100000:0.0:1787338705.746311:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192089728 00000100:00100000:0.0:1787338705.746857:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 6 00000100:00100000:0.0:1787338705.746870:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbef19ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:83642291-0761-4205-9531-7fd25bc2d48e+12:10282:x1874160192089728:12345-192.168.201.53@tcp:35:bash.0 00000100:00100000:0.0:1787338705.747339:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbef19ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:83642291-0761-4205-9531-7fd25bc2d48e+13:10282:x1874160192089728:12345-192.168.201.53@tcp:35:bash.0 Request processed in 471us (6026us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1787338705.747348:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 6 00000100:00100000:1.0:1787338705.861442:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338705.861855:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192089984 00000100:00100000:2.0:1787338705.861865:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192089984 00000100:00100000:2.0:1787338705.861954:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 41 00000100:00100000:2.0:1787338705.861965:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbef19ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+13:10292:x1874160192089984:12345-192.168.201.53@tcp:101:lfs.0 00010000:00010000:2.0:1787338705.861988:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787338705.862008:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3600/0x83671231080c1765 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab6e4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787338705.862132:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1787338705.862266:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3600/0x83671231080c1765 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab6e4 expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338705.862283:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90bbdee56300) 00010000:00010000:2.0:1787338705.862286:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787338705.862292:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3600/0x83671231080c1765 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab6e4 expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338705.862308:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf40e3600, rc 0) 00000100:00100000:2.0:1787338705.862499:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbef19ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+14:10292:x1874160192089984:12345-192.168.201.53@tcp:101:lfs.0 Request processed in 534us (1065us total) trans 4294967313 rc 301/301 00000100:00100000:2.0:1787338705.862506:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 41 00000100:00100000:1.0:1787338705.877134:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338705.877926:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192090240 00000100:00100000:2.0:1787338705.877947:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192090240 00000100:00100000:2.0:1787338705.878013:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 7 00000100:00100000:2.0:1787338705.878024:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbef19c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:83642291-0761-4205-9531-7fd25bc2d48e+14:10292:x1874160192090240:12345-192.168.201.53@tcp:35:lfs.0 00000100:00100000:2.0:1787338705.878312:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbef19c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:83642291-0761-4205-9531-7fd25bc2d48e+15:10292:x1874160192090240:12345-192.168.201.53@tcp:35:lfs.0 Request processed in 288us (1189us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1787338705.878320:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 7 00000100:00100000:0.0:1787338706.083211:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338706.083597:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192090368 00000100:00100000:3.0:1787338706.083607:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192090368 00000100:00100000:3.0:1787338706.083687:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 42 00000100:00100000:3.0:1787338706.083699:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee080000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+15:10298:x1874160192090368:12345-192.168.201.53@tcp:101:lfs.0 00010000:00010000:3.0:1787338706.083724:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787338706.083744:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5200/0x83671231080c1773 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab6eb expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338706.083841:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c177a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338706.083855:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c177a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338706.083867:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c177a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787338706.083956:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:3.0:1787338706.083960:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787338706.083987:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c177a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338706.084015:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5200/0x83671231080c1773 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab6eb expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338706.084054:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c177a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab6eb expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338706.084064:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff90bbdee56e00) 00010000:00010000:3.0:1787338706.084067:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787338706.084070:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf7ea5400, rc 0) 00000100:00100000:3.0:1787338706.084145:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee080000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+16:10298:x1874160192090368:12345-192.168.201.53@tcp:101:lfs.0 Request processed in 448us (943us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338706.084152:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 42 00000100:00080000:1.0:1787338706.085550:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787338706.090988:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338706.091102:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192090624 00000100:00100000:2.0:1787338706.091113:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192090624 00000100:00100000:2.0:1787338706.091179:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 43 00000100:00100000:2.0:1787338706.091191:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbef19d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+16:10298:x1874160192090624:12345-192.168.201.53@tcp:101:lfs.0 00010000:00010000:2.0:1787338706.091211:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787338706.091231:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3600/0x83671231080c1781 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab6f2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338706.091327:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c1788 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338706.091340:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c1788 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338706.091364:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c1788 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787338706.091382:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787338706.091755:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3600/0x83671231080c1781 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab6f2 expref: 19 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338706.091775:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c1788 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab6f2 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338706.091798:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90bbdee56800) 00010000:00010000:2.0:1787338706.091801:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787338706.091804:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf40e3200, rc 0) 00000100:00100000:2.0:1787338706.091863:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbef19d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+18:10298:x1874160192090624:12345-192.168.201.53@tcp:101:lfs.0 Request processed in 674us (885us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1787338706.091936:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 43 00000100:00100000:0.0:1787338706.096323:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338706.096474:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192090880 00000100:00100000:3.0:1787338706.096485:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192090880 00000100:00100000:3.0:1787338706.096577:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 44 00000100:00100000:3.0:1787338706.096589:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee081c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+18:10298:x1874160192090880:12345-192.168.201.53@tcp:101:lfs.0 00010000:00010000:3.0:1787338706.096614:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787338706.096634:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4400/0x83671231080c1796 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab6f9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338706.096725:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c179d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338706.096739:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c179d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338706.096750:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c179d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787338706.096761:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1787338706.096949:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4400/0x83671231080c1796 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab6f9 expref: 21 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338706.096966:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c179d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab6f9 expref: 20 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338706.096975:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90bbdee56800) 00010000:00010000:3.0:1787338706.096979:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787338706.096982:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf7ea5a00, rc 0) 00000100:00100000:3.0:1787338706.097034:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee081c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+20:10298:x1874160192090880:12345-192.168.201.53@tcp:101:lfs.0 Request processed in 447us (720us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1787338706.097041:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 44 00000100:00100000:0.0:1787338706.106550:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338706.106702:0:10743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192091008 00000100:00100000:1.0:1787338706.106713:0:10743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192091008 00000100:00100000:1.0:1787338706.106773:0:10743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 23 00000100:00100000:1.0:1787338706.106795:0:10743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee081f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:83642291-0761-4205-9531-7fd25bc2d48e+7:2356:x1874160192091008:12345-192.168.201.53@tcp:1:lfs.0 00010000:00010000:1.0:1787338706.106839:0:10743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb7e3e45/0x83671231080c17ab lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338706.106901:0:10743:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000697ce498/0x83671231080c175e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab6dd expref: 7 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338706.106911:0:10743:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787338706.106916:0:10743:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787338706.106921:0:10743:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb7e3e45/0x83671231080c17ab lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338706.107095:0:10743:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000697ce498/0x83671231080c175e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab6dd expref: 7 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338706.107122:0:10743:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000697ce498/0x83671231080c175e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab6dd expref: 7 pid: 6691 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338706.107140:0:10743:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbef19f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10743:1874160212047616:192.168.201.53@tcp:104: 00000100:00100000:1.0:1787338706.107506:0:10743:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbf42dd240 going to sleep for 11 seconds 00000100:00100000:1.0:1787338706.108850:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338706.109048:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192091136 00000100:00100000:2.0:1787338706.109057:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192091136 00000100:00100000:2.0:1787338706.109126:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 2 00000100:00100000:2.0:1787338706.109137:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbef19d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:83642291-0761-4205-9531-7fd25bc2d48e+20:2359:x1874160192091136:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787338706.109151:0:6704:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787338706.109309:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c1788 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab6f2 expref: 20 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338706.109332:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90bbdee56800) 00010000:00010000:2.0:1787338706.109337:0:6704:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787338706.109388:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbef19d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:83642291-0761-4205-9531-7fd25bc2d48e+19:2359:x1874160192091136:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 253us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338706.109396:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 2 00000100:00100000:0.0:1787338706.113315:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338706.113808:0:10743:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbef19f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10743:1874160212047616:192.168.201.53@tcp:104: 00010000:00010000:1.0:1787338706.113836:0:10743:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fb7e3e45/0x83671231080c17ab lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338706.114292:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192091264 00000100:00100000:3.0:1787338706.114300:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192091264 00002000:00100000:3.0:1787338706.114358:0:6694:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff90bbee083b80 x1874160192091264/t0(0) o4->83642291-0761-4205-9531-7fd25bc2d48e@192.168.201.53@tcp:37/0 lens 504/0 e 0 to 0 dl 1787338717 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787338706.114368:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90bbee083b80 with x1874160192091264 ext(0->12) 00010000:00010000:3.0:1787338706.114376:0:6694:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000697ce498/0x83671231080c175e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab6dd expref: 8 pid: 6691 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338706.114399:0:6694:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000697ce498/0x83671231080c175e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab6dd expref: 8 pid: 6691 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787338706.114407:0:6694:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90bbee083b80 00000100:00100000:3.0:1787338706.115329:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 0 00000100:00100000:3.0:1787338706.115352:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee083b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:83642291-0761-4205-9531-7fd25bc2d48e+8:2358:x1874160192091264:12345-192.168.201.53@tcp:4:lfs.0 00000001:00100000:0.0:1787338706.193960:0:7651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 83642291-0761-4205-9531-7fd25bc2d48e 00000001:00080000:1.0:1787338706.281809:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:3.0:1787338706.283572:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee083b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:83642291-0761-4205-9531-7fd25bc2d48e+7:2358:x1874160192091264:12345-192.168.201.53@tcp:4:lfs.0 Request processed in 168223us (170256us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1787338706.283593:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 0 00002000:00100000:3.0:1787338706.283607:0:6694:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff90bbee083b80 x1874160192091264/t4294967299(0) o4->83642291-0761-4205-9531-7fd25bc2d48e@192.168.201.53@tcp:37/0 lens 504/448 e 0 to 0 dl 1787338717 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787338706.283617:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90bbee083b80 with x1874160192091264 ext(0->12) 00010000:00010000:3.0:1787338706.283628:0:6694:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000697ce498/0x83671231080c175e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab6dd expref: 7 pid: 6691 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338706.283646:0:6694:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000697ce498/0x83671231080c175e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab6dd expref: 7 pid: 6691 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787338706.283654:0:6694:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90bbee083b80 00000100:00100000:0.0:1787338706.293754:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338706.296231:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192091392 00000100:00100000:1.0:1787338706.296243:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192091392 00010000:00010000:1.0:1787338706.296286:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000697ce498/0x83671231080c175e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab6dd expref: 7 pid: 6691 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338706.296355:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 36 00000100:00100000:1.0:1787338706.296365:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee083800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:83642291-0761-4205-9531-7fd25bc2d48e+7:2359:x1874160192091392:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787338706.296381:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1787338706.296400:0:5823:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1787338706.296403:0:5823:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1787338705 00002000:00010000:1.0:1787338706.296405:0:5823:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1787338706 00002000:00010000:1.0:1787338706.296407:0:5823:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1787338705 00002000:00010000:1.0:1787338706.296409:0:5823:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:1.0:1787338706.296415:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000697ce498/0x83671231080c175e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab6dd expref: 7 pid: 6691 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338706.296430:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000697ce498/0x83671231080c175e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab6dd expref: 7 pid: 6691 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338706.296606:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000697ce498/0x83671231080c175e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab6dd expref: 7 pid: 6691 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338706.296625:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=1s v=(1 0) 00010000:00010000:1.0:1787338706.296629:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787338706.296635:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fb7e3e45/0x83671231080c17ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338706.296645:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb7e3e45/0x83671231080c17ab lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338706.296696:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787338706.296763:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee083800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:83642291-0761-4205-9531-7fd25bc2d48e+6:2359:x1874160192091392:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 398us (3018us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338706.296771:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 36 00010000:00010000:0.0:1787338706.296866:0:10743:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fb7e3e45/0x83671231080c17ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338706.296911:0:10743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb7e3e45/0x83671231080c17ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338706.296947:0:10743:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb7e3e45/0x83671231080c17ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338706.296953:0:10743:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb7e3e45/0x83671231080c17ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338706.296960:0:10743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb7e3e45/0x83671231080c17ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338706.296967:0:10743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbfbe9dc00 already unused, calling callback (ffffffffc1546230) 00010000:00010000:0.0:1787338706.296971:0:10743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb7e3e45/0x83671231080c17ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338706.296979:0:10743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb7e3e45/0x83671231080c17ab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338706.296990:0:10743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb7e3e45/0x83671231080c17ab lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338706.296997:0:10743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb7e3e45/0x83671231080c17ab lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338706.297045:0:10743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee081f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:83642291-0761-4205-9531-7fd25bc2d48e+5:2356:x1874160192091008:12345-192.168.201.53@tcp:1:lfs.0 Request processed in 190253us (190505us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338706.297052:0:10743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 23 00000100:00100000:1.0:1787338706.299757:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338706.303843:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192091648 00000100:00100000:0.0:1787338706.303859:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192091648 00000100:00100000:0.0:1787338706.303951:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 8 00000100:00100000:0.0:1787338706.303963:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbef19f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:83642291-0761-4205-9531-7fd25bc2d48e+19:10298:x1874160192091648:12345-192.168.201.53@tcp:35:lfs.0 00000004:00010000:0.0:1787338706.304028:0:5842:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c179d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab6f9 expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787338706.304770:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:0.0:1787338706.304844:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:0.0:1787338706.305971:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:0.0:1787338706.306055:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031400/0x83671231080c17b2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338706.306074:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c1742 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab6cf expref: 23 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338706.306083:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031400/0x83671231080c17b2 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338706.306995:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c1742 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab6cf expref: 23 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338706.307014:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c1742 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab6cf expref: 23 pid: 5840 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338706.307029:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee082d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5842:1874160212047744:192.168.201.53@tcp:104: 00000100:00100000:0.0:1787338706.307625:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbd0cea840 going to sleep for 11 seconds 00000100:00100000:3.0:1787338706.319798:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338706.319907:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192091776 00000100:00100000:1.0:1787338706.319916:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192091776 00010000:00010000:1.0:1787338706.319956:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c1742 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab6cf expref: 24 pid: 5840 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338706.320001:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 37 00000100:00100000:1.0:1787338706.320012:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbed9caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:83642291-0761-4205-9531-7fd25bc2d48e+24:2358:x1874160192091776:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787338706.320026:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787338706.320034:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c1742 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab6cf expref: 24 pid: 5840 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338706.320065:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c1742 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab6cf expref: 24 pid: 5840 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338706.320088:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90bbdee56800) 00010000:00010000:1.0:1787338706.320102:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031400/0x83671231080c17b2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338706.320111:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031400/0x83671231080c17b2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338706.320118:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031400/0x83671231080c17b2 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338706.320151:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787338706.320221:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbed9caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:83642291-0761-4205-9531-7fd25bc2d48e+24:2358:x1874160192091776:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 210us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338706.320229:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 37 00010000:00010000:0.0:1787338706.321590:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c1742 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab6cf expref: 23 pid: 5840 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338706.321628:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee082d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5842:1874160212047744:192.168.201.53@tcp:104: 00010000:00010000:0.0:1787338706.321649:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031400/0x83671231080c17b2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338706.321658:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031400/0x83671231080c17b2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338706.321663:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031400/0x83671231080c17b2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787338706.321797:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:0.0:1787338706.322119:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:0.0:1787338706.322632:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee082d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5842:1874160212047872:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787338706.322715:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338706.322809:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbd0cea0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787338706.330427:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212047872 00000100:00100000:2.0:1787338706.330489:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212047872 00000100:00100000:2.0:1787338706.330622:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787338706.330632:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee080a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5842:x1874160212047872:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787338706.330747:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee080a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5842:x1874160212047872:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 116us (8030us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338706.330754:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787338706.331464:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee082d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5842:1874160212047872:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1787338706.332133:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:0.0:1787338706.334722:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee082d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5842:1874160212048000:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787338706.334805:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338706.334839:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbd0cea840 going to sleep for 11 seconds 00000100:00100000:2.0:1787338706.334936:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212048000 00000100:00100000:2.0:1787338706.334944:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212048000 00000100:00100000:2.0:1787338706.334985:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787338706.334993:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee080380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5842:x1874160212048000:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787338706.335283:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee080380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5842:x1874160212048000:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 290us (476us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1787338706.335291:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787338706.335918:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee082d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5842:1874160212048000:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1787338706.335987:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:0.0:1787338706.336052:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031400/0x83671231080c17b2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338706.336063:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031400/0x83671231080c17b2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338706.336083:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031400/0x83671231080c17b2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338706.336098:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbc0031400 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:0.0:1787338706.336102:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031400/0x83671231080c17b2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338706.336110:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031400/0x83671231080c17b2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338706.336124:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90bbdee56800) 00010000:00010000:0.0:1787338706.336127:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1787338706.336131:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031400/0x83671231080c17b2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338706.336137:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031400/0x83671231080c17b2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787338706.336329:0:5842:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1787338706.336574:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:0.0:1787338706.336587:0:5842:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 359177712430ns, next at 360177709676ns, rc = 0 00000001:00080000:0.0:1787338706.336593:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:0.0:1787338706.336626:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90bbdee56800) 00010000:00010000:0.0:1787338706.336629:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787338706.336636:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c179d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab6f9 expref: 27 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338706.336733:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbef19f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:83642291-0761-4205-9531-7fd25bc2d48e+26:10298:x1874160192091648:12345-192.168.201.53@tcp:35:lfs.0 Request processed in 32772us (36983us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1787338706.336752:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 8 00000020:00080000:0.0:1787338706.336757:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00080000:1.0:1787338706.338695:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787338706.345845:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338706.345982:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192091904 00000100:00100000:2.0:1787338706.345992:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192091904 00000100:00100000:2.0:1787338706.346059:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 45 00000100:00100000:2.0:1787338706.346069:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbed9c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+26:10298:x1874160192091904:12345-192.168.201.53@tcp:101:lfs.0 00010000:00010000:2.0:1787338706.346093:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787338706.346114:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3600/0x83671231080c17b9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab700 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338706.346186:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3600/0x83671231080c17b9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab700 expref: 27 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338706.346200:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3600/0x83671231080c17b9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab700 expref: 27 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338706.346220:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90bbdee56600) 00010000:00010000:2.0:1787338706.346236:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787338706.346241:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf40e3600, rc 0) 00000100:00100000:2.0:1787338706.346301:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbed9c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+27:10298:x1874160192091904:12345-192.168.201.53@tcp:101:lfs.0 Request processed in 232us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338706.346308:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 45 00000100:00100000:2.0:1787338706.349381:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338706.349562:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192092160 00000100:00100000:1.0:1787338706.349570:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192092160 00000100:00100000:1.0:1787338706.349625:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 9 00000100:00100000:1.0:1787338706.349634:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbd894d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:83642291-0761-4205-9531-7fd25bc2d48e+27:10298:x1874160192092160:12345-192.168.201.53@tcp:35:lfs.0 00000100:00100000:1.0:1787338706.349855:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbd894d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:83642291-0761-4205-9531-7fd25bc2d48e+28:10298:x1874160192092160:12345-192.168.201.53@tcp:35:lfs.0 Request processed in 221us (481us total) trans 4294967326 rc 0/0 00000100:00100000:1.0:1787338706.349862:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 9 00000100:00100000:3.0:1787338706.499234:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338706.499678:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192092416 00000100:00100000:2.0:1787338706.499688:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192092416 00000100:00100000:2.0:1787338706.499750:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 46 00000100:00100000:2.0:1787338706.499763:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbed9cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+28:10308:x1874160192092416:12345-192.168.201.53@tcp:101:lfs.0 00010000:00010000:2.0:1787338706.499821:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787338706.499841:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c17c0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab707 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787338706.499984:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1787338706.500252:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c17c0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab707 expref: 30 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338706.500266:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90bbdee56300) 00010000:00010000:2.0:1787338706.500270:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787338706.500287:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c17c0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab707 expref: 30 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338706.500302:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf40e2a00, rc 0) 00000100:00100000:2.0:1787338706.500481:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbed9cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+29:10308:x1874160192092416:12345-192.168.201.53@tcp:101:lfs.0 Request processed in 720us (1256us total) trans 4294967327 rc 301/301 00000100:00100000:2.0:1787338706.500488:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 46 00000100:00100000:3.0:1787338706.515854:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338706.516004:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192092544 00000100:00100000:2.0:1787338706.516014:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192092544 00000100:00100000:2.0:1787338706.516074:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 47 00000100:00100000:2.0:1787338706.516093:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbed9c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+29:10308:x1874160192092544:12345-192.168.201.53@tcp:34:lfs.0 00010000:00010000:2.0:1787338706.516180:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c17ce lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338706.516197:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c17ce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338706.516209:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c17ce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338706.516225:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c17d5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338706.516232:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c17d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338706.516239:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c17d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338706.516351:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c17dc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338706.516360:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c17dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338706.516368:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c17dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787338706.516409:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c17dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338706.516437:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c17ce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338706.516444:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c17ce lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338706.516451:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c17ce lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338706.516456:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e2a00 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:2.0:1787338706.516461:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c17ce lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338706.516468:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c17ce lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338706.516481:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff90bbdee56e00) 00010000:00010000:2.0:1787338706.516483:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787338706.516487:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c17ce lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338706.516492:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c17ce lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338706.516505:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c17d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338706.516509:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c17d5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338706.516514:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c17d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338706.516525:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e2600 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:2.0:1787338706.516529:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c17d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338706.516534:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c17d5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338706.516542:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff90bbdee56f00) 00010000:00010000:2.0:1787338706.516545:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787338706.516548:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c17d5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338706.516553:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c17d5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338706.516568:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c17dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338706.516574:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c17dc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338706.516580:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c17dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338706.516585:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e2c00 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:2.0:1787338706.516588:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c17dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338706.516594:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c17dc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338706.516614:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90bbdee56600) 00010000:00010000:2.0:1787338706.516616:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787338706.516619:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c17dc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338706.516625:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c17dc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338706.516700:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbed9c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+29:10308:x1874160192092544:12345-192.168.201.53@tcp:34:lfs.0 Request processed in 617us (855us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338706.516708:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 47 00000100:00100000:0.0:1787338706.519309:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338706.519495:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192092800 00000100:00100000:1.0:1787338706.519505:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192092800 00000100:00100000:1.0:1787338706.519555:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 10 00000100:00100000:1.0:1787338706.519566:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee081180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:83642291-0761-4205-9531-7fd25bc2d48e+29:10308:x1874160192092800:12345-192.168.201.53@tcp:35:lfs.0 00000100:00100000:1.0:1787338706.519800:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee081180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:83642291-0761-4205-9531-7fd25bc2d48e+30:10308:x1874160192092800:12345-192.168.201.53@tcp:35:lfs.0 Request processed in 235us (497us total) trans 4294967328 rc 0/0 00000100:00100000:1.0:1787338706.519807:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 10 00000100:00100000:3.0:1787338706.577179:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338706.577348:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192093056 00000100:00100000:2.0:1787338706.577357:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192093056 00000100:00100000:2.0:1787338706.577415:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 48 00000100:00100000:2.0:1787338706.577427:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbed9c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+30:10311:x1874160192093056:12345-192.168.201.53@tcp:101:lfs.0 00010000:00010000:2.0:1787338706.577451:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787338706.577473:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c17e3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab70e expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338706.577556:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c17ea lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338706.577573:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c17ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338706.577585:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c17ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338706.577600:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c17f1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338706.577625:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c17f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338706.577633:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c17f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338706.577785:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c17f8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338706.577795:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c17f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338706.577802:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c17f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787338706.577811:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787338706.577929:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c17ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338706.577936:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c17ea lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338706.577942:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c17ea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338706.577947:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e2600 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:2.0:1787338706.577951:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c17ea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338706.577958:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c17ea lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338706.577983:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff90bbdee56e00) 00010000:00010000:2.0:1787338706.577986:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787338706.577991:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c17ea lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338706.577996:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c17ea lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338706.578010:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c17f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338706.578015:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c17f1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338706.578019:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c17f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338706.578025:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e2a00 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:2.0:1787338706.578027:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c17f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338706.578033:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c17f1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338706.578039:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff90bbdee56f00) 00010000:00010000:2.0:1787338706.578041:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787338706.578044:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c17f1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338706.578049:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c17f1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338706.578104:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c17e3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab70e expref: 33 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338706.578118:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c17f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab70e expref: 32 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338706.578125:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90bbdee56600) 00010000:00010000:2.0:1787338706.578127:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787338706.578130:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf40e3200, rc 0) 00000100:00100000:2.0:1787338706.578209:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbed9c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+32:10311:x1874160192093056:12345-192.168.201.53@tcp:101:lfs.0 Request processed in 784us (1049us total) trans 4294967329 rc 0/0 00000100:00100000:2.0:1787338706.578217:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 48 00000100:00100000:3.0:1787338706.593748:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338706.593921:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192093184 00000100:00100000:2.0:1787338706.593931:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192093184 00000100:00100000:2.0:1787338706.593995:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 49 00000100:00100000:2.0:1787338706.594006:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbed9ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+32:10311:x1874160192093184:12345-192.168.201.53@tcp:54:lfs.0 00010000:00010000:2.0:1787338706.594103:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c1806 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338706.594135:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c1806 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338706.594148:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c1806 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338706.594182:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c1806 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338706.594206:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c1806 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338706.594213:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c1806 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338706.594219:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e2c00 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:2.0:1787338706.594224:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c1806 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338706.594231:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c1806 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338706.594245:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90bbdee56600) 00010000:00010000:2.0:1787338706.594248:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787338706.594252:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c1806 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338706.594257:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c1806 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338706.594658:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbed9ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+32:10311:x1874160192093184:12345-192.168.201.53@tcp:54:lfs.0 Request processed in 652us (918us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338706.594666:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 49 00000100:00100000:0.0:1787338706.596668:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338706.596751:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192093440 00000100:00100000:1.0:1787338706.596759:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192093440 00000100:00100000:1.0:1787338706.596820:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 11 00000100:00100000:1.0:1787338706.596831:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf7eafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:83642291-0761-4205-9531-7fd25bc2d48e+32:10311:x1874160192093440:12345-192.168.201.53@tcp:35:lfs.0 00000100:00100000:1.0:1787338706.597115:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf7eafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:83642291-0761-4205-9531-7fd25bc2d48e+33:10311:x1874160192093440:12345-192.168.201.53@tcp:35:lfs.0 Request processed in 276us (443us total) trans 4294967330 rc 0/0 00000100:00100000:1.0:1787338706.598568:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 11 00010000:00010000:3.0:1787338706.614443:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787338707.037535:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338707.037666:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192093696 00000100:00100000:2.0:1787338707.037684:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192093696 00000100:00100000:2.0:1787338707.037756:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 50 00000100:00100000:2.0:1787338707.037778:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbed9cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+33:10342:x1874160192093696:12345-192.168.201.53@tcp:101:cat.0 00010000:00010000:2.0:1787338707.037801:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787338707.037832:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c180d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab715 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338707.037952:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c1814 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338707.037966:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c1814 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338707.037977:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c1814 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787338707.037988:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787338707.038136:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c180d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab715 expref: 36 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338707.038167:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c1814 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab715 expref: 35 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338707.038176:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90bbdee56600) 00010000:00010000:2.0:1787338707.038179:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787338707.038182:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf40e2a00, rc 0) 00000100:00100000:2.0:1787338707.038245:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbed9cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+35:10342:x1874160192093696:12345-192.168.201.53@tcp:101:cat.0 Request processed in 470us (939us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1787338707.038253:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 50 00000100:00100000:3.0:1787338707.042751:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338707.042862:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192093952 00000100:00100000:1.0:1787338707.042920:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192093952 00000100:00100000:1.0:1787338707.042974:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 12 00000100:00100000:1.0:1787338707.042984:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbed9ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:83642291-0761-4205-9531-7fd25bc2d48e+35:10342:x1874160192093952:12345-192.168.201.53@tcp:35:cat.0 00000100:00100000:1.0:1787338707.043272:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbed9ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:83642291-0761-4205-9531-7fd25bc2d48e+36:10342:x1874160192093952:12345-192.168.201.53@tcp:35:cat.0 Request processed in 288us (530us total) trans 4294967332 rc 0/0 00000100:00100000:1.0:1787338707.043280:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 12 00000100:00100000:0.0:1787338707.050713:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338707.051605:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192094080 00000100:00100000:1.0:1787338707.051614:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192094080 00000100:00100000:1.0:1787338707.051693:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 3 00000100:00100000:1.0:1787338707.051704:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbde53c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:83642291-0761-4205-9531-7fd25bc2d48e+36:2356:x1874160192094080:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787338707.051721:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787338707.051768:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c1814 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab715 expref: 36 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338707.051787:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90bbdee56600) 00010000:00010000:1.0:1787338707.051792:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787338707.051849:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbde53c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:83642291-0761-4205-9531-7fd25bc2d48e+35:2356:x1874160192094080:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 147us (1144us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338707.051856:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 3 00000100:00100000:3.0:1787338707.145138:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338707.145853:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192094336 00000100:00100000:2.0:1787338707.145863:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192094336 00000100:00100000:2.0:1787338707.146305:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 51 00000100:00100000:2.0:1787338707.146316:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbed9c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+35:10348:x1874160192094336:12345-192.168.201.53@tcp:101:dd.0 00010000:00010000:2.0:1787338707.146364:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787338707.146367:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787338707.146393:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c177a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab6eb expref: 35 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338707.146413:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff90bbdee56e00) 00010000:00010000:2.0:1787338707.146417:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787338707.146442:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c1822 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab71c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338707.146546:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c1829 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338707.146560:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c17f8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab70e expref: 35 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338707.146568:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c1829 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338707.146599:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c17f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab70e expref: 35 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338707.146613:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c17f8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab70e expref: 35 pid: 5840 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338707.146627:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbff8fd500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5841:1874160212048128:192.168.201.53@tcp:104: 00000100:00100000:2.0:1787338707.146725:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbfffc1300 going to sleep for 11 seconds 00000100:00100000:3.0:1787338707.150860:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338707.150970:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192094464 00000100:00100000:0.0:1787338707.150979:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192094464 00010000:00010000:0.0:1787338707.151034:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c17f8 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab70e expref: 36 pid: 5840 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338707.151261:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 38 00000100:00100000:0.0:1787338707.151272:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbed9caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:83642291-0761-4205-9531-7fd25bc2d48e+36:2359:x1874160192094464:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787338707.151285:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787338707.151292:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c17f8 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab70e expref: 36 pid: 5840 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338707.151305:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c17f8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab70e expref: 36 pid: 5840 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338707.151336:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90bbdee56600) 00010000:00010000:0.0:1787338707.151341:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c1829 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338707.151349:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c1829 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338707.151356:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c1829 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338707.151388:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787338707.151496:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbed9caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:83642291-0761-4205-9531-7fd25bc2d48e+36:2359:x1874160192094464:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 224us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338707.151503:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 38 00010000:00010000:2.0:1787338707.151894:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c17f8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab70e expref: 35 pid: 5840 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338707.151919:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbff8fd500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5841:1874160212048128:192.168.201.53@tcp:104: 00010000:00010000:2.0:1787338707.151939:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c1829 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338707.151947:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c1829 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338707.151953:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c1829 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787338707.151971:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787338707.152311:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c1822 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab71c expref: 36 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338707.152794:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c1829 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab71c expref: 35 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338707.152804:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90bbdee56600) 00010000:00010000:2.0:1787338707.152806:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787338707.152808:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf40e2600, rc 0) 00000100:00100000:2.0:1787338707.152845:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbed9c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+35:10348:x1874160192094336:12345-192.168.201.53@tcp:101:dd.0 Request processed in 6531us (7716us total) trans 4294967333 rc 0/0 00000100:00100000:2.0:1787338707.152852:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 51 00000100:00100000:0.0:1787338707.156381:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338707.157091:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192094720 00000100:00100000:1.0:1787338707.157101:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192094720 00000100:00100000:1.0:1787338707.157170:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 52 00000100:00100000:1.0:1787338707.157181:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf7eaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+35:10348:x1874160192094720:12345-192.168.201.53@tcp:36:dd.0 00010000:00010000:1.0:1787338707.157636:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d200/0x83671231080c1837 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338707.157652:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d200/0x83671231080c1837 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338707.157662:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d200/0x83671231080c1837 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787338707.157720:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:1.0:1787338707.157979:0:5840:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009f777fc9 reply state 00000000f026ec03 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d200/0x83671231080c1837 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338707.158094:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787338707.158200:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf7eaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+38:10348:x1874160192094720:12345-192.168.201.53@tcp:36:dd.0 Request processed in 1020us (1827us total) trans 4294967335 rc 0/0 00000100:00100000:1.0:1787338707.158208:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 52 00000020:00080000:1.0:1787338707.158212:0:5840:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787338707.161095:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d200/0x83671231080c1837 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338707.161109:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d200/0x83671231080c1837 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338707.161116:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d200/0x83671231080c1837 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338707.161122:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbfbe9d200 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:0.0:1787338707.161127:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d200/0x83671231080c1837 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338707.161134:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d200/0x83671231080c1837 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338707.161159:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90bbdee56600) 00010000:00010000:0.0:1787338707.161163:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787338707.161167:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d200/0x83671231080c1837 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338707.161173:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d200/0x83671231080c1837 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338707.432842:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338707.433452:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192094848 00000100:00100000:1.0:1787338707.433463:0:7647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192094848 00000100:00100000:1.0:1787338707.433519:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 53 00000100:00100000:1.0:1787338707.433528:0:7647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf7eaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+37:10362:x1874160192094848:12345-192.168.201.53@tcp:101:stat.0 00010000:00010000:1.0:1787338707.433550:0:7647:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787338707.433568:0:7647:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c400/0x83671231080c183e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab723 expref: -99 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338707.433624:0:7647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c800/0x83671231080c1845 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338707.433637:0:7647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c800/0x83671231080c1845 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338707.433655:0:7647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c800/0x83671231080c1845 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338707.433680:0:7647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c184c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338707.433688:0:7647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c184c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338707.433695:0:7647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c184c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338707.433796:0:7647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c000/0x83671231080c1853 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338707.433806:0:7647:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c1829 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab71c expref: 38 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338707.433814:0:7647:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c000/0x83671231080c1853 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338707.433846:0:7647:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c1829 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab71c expref: 38 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338707.433858:0:7647:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c1829 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab71c expref: 38 pid: 5841 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338707.433871:0:7647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbef19f800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7647:1874160212048256:192.168.201.53@tcp:104: 00000100:00100000:1.0:1787338707.434176:0:7647:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbf42dd900 going to sleep for 11 seconds 00000100:00100000:1.0:1787338707.444485:0:7647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbef19f800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7647:1874160212048256:192.168.201.53@tcp:104: 00010000:00010000:1.0:1787338707.444514:0:7647:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c000/0x83671231080c1853 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338707.452404:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338707.452541:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192095104 00000100:00100000:1.0:1787338707.452550:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192095104 00000100:00100000:1.0:1787338707.452604:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 13 00000100:00100000:1.0:1787338707.452615:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf7eaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:83642291-0761-4205-9531-7fd25bc2d48e+39:5596:x1874160192095104:12345-192.168.201.53@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787338707.453635:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf7eaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:83642291-0761-4205-9531-7fd25bc2d48e+40:5596:x1874160192095104:12345-192.168.201.53@tcp:35:ldlm_bl.0 Request processed in 1019us (1236us total) trans 4294967336 rc 0/0 00000100:00100000:1.0:1787338707.453643:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 13 00000100:00100000:0.0:1787338707.469424:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338707.469521:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192095232 00000100:00100000:1.0:1787338707.469531:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192095232 00010000:00010000:1.0:1787338707.469568:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c1829 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab71c expref: 40 pid: 5841 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338707.469607:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 39 00000100:00100000:1.0:1787338707.469616:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf7eac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:83642291-0761-4205-9531-7fd25bc2d48e+40:2358:x1874160192095232:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787338707.469632:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787338707.469638:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c1829 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab71c expref: 40 pid: 5841 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338707.469652:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c1829 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab71c expref: 40 pid: 5841 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338707.469683:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c1829 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab71c expref: 40 pid: 5841 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338707.469717:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90bbdee56600) 00010000:00010000:1.0:1787338707.469722:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c000/0x83671231080c1853 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338707.469827:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c000/0x83671231080c1853 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338707.469835:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c000/0x83671231080c1853 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338707.469865:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787338707.469945:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf7eac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:83642291-0761-4205-9531-7fd25bc2d48e+39:2358:x1874160192095232:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 330us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338707.469952:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 39 00010000:00010000:3.0:1787338707.470061:0:7647:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c000/0x83671231080c1853 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338707.470071:0:7647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c000/0x83671231080c1853 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787338707.470125:0:7647:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1787338707.470129:0:7647:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787338707.470173:0:7647:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c000/0x83671231080c1853 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338707.470186:0:7647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c000/0x83671231080c1853 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338707.470194:0:7647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c800/0x83671231080c1845 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338707.470200:0:7647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c800/0x83671231080c1845 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338707.470206:0:7647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c800/0x83671231080c1845 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338707.470213:0:7647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbfbe9c800 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:3.0:1787338707.470216:0:7647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c800/0x83671231080c1845 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338707.470222:0:7647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c800/0x83671231080c1845 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338707.470231:0:7647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff90bbdee56e00) 00010000:00010000:3.0:1787338707.470234:0:7647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787338707.470237:0:7647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c800/0x83671231080c1845 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338707.470243:0:7647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c800/0x83671231080c1845 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338707.470264:0:7647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c184c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338707.470271:0:7647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c184c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338707.470277:0:7647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c184c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338707.470282:0:7647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbfbe9d600 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:3.0:1787338707.470285:0:7647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c184c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338707.470291:0:7647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c184c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338707.470299:0:7647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff90bbc2a93500) 00010000:00010000:3.0:1787338707.470302:0:7647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787338707.470304:0:7647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c184c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338707.470311:0:7647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c184c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338707.470356:0:7647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c400/0x83671231080c183e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab723 expref: 39 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338707.470372:0:7647:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c000/0x83671231080c1853 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab723 expref: 38 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338707.470391:0:7647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90bbdee56600) 00010000:00010000:3.0:1787338707.470393:0:7647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787338707.470396:0:7647:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbfbe9c000, rc 0) 00000100:00100000:3.0:1787338707.470424:0:7647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf7eaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+38:10362:x1874160192094848:12345-192.168.201.53@tcp:101:stat.0 Request processed in 36898us (37590us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338707.470432:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 53 00000100:00100000:0.0:1787338707.565391:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338707.565511:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192095488 00000100:00100000:3.0:1787338707.565520:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192095488 00000100:00100000:3.0:1787338707.565573:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 54 00000100:00100000:3.0:1787338707.565583:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf7ead180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+38:10368:x1874160192095488:12345-192.168.201.53@tcp:36:truncate.0 00010000:00010000:3.0:1787338707.565633:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787338707.565657:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c000/0x83671231080c1853 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab723 expref: 38 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338707.565687:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90bbdee56600) 00010000:00010000:3.0:1787338707.565691:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787338707.565919:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4400/0x83671231080c185a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338707.565932:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4400/0x83671231080c185a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338707.565941:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4400/0x83671231080c185a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787338707.566089:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:3.0:1787338707.566162:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a48219b6 reply state 000000009a46d76e transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4400/0x83671231080c185a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338707.566183:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787338707.566287:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf7ead180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+40:10368:x1874160192095488:12345-192.168.201.53@tcp:36:truncate.0 Request processed in 705us (903us total) trans 4294967338 rc 0/0 00000100:00100000:3.0:1787338707.566295:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 54 00000020:00080000:3.0:1787338707.566299:0:5839:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787338707.568503:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4400/0x83671231080c185a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338707.568516:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4400/0x83671231080c185a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338707.568522:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4400/0x83671231080c185a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338707.568527:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea4400 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:3.0:1787338707.568531:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4400/0x83671231080c185a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338707.568539:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4400/0x83671231080c185a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338707.568550:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90bbdee56600) 00010000:00010000:3.0:1787338707.568553:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787338707.568556:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4400/0x83671231080c185a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338707.568562:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4400/0x83671231080c185a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338707.639529:0:11676:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787338707.715834:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338707.716079:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192095616 00000100:00100000:2.0:1787338707.716089:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192095616 00000100:00100000:2.0:1787338707.716254:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 55 00000100:00100000:2.0:1787338707.716267:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf7eaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+39:10382:x1874160192095616:12345-192.168.201.53@tcp:101:stat.0 00010000:00010000:2.0:1787338707.716296:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787338707.716325:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c1861 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab72a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338707.716384:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c1868 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338707.716398:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c1868 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338707.716408:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c1868 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338707.716422:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c186f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338707.716429:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c186f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338707.716436:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c186f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338707.716523:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c1876 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338707.716530:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c1876 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338707.716537:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c1876 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787338707.716588:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:2.0:1787338707.716599:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787338707.716621:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c1876 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338707.716633:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c1876 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338707.716641:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c1868 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338707.716648:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c1868 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338707.716653:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c1868 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338707.716660:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e3200 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:2.0:1787338707.716672:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c1868 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338707.716680:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c1868 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338707.716691:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff90bbdee56e00) 00010000:00010000:2.0:1787338707.716694:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787338707.716699:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c1868 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338707.716705:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c1868 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338707.716718:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c186f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338707.716733:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c186f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338707.716738:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c186f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338707.716744:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e2600 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:2.0:1787338707.716757:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c186f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338707.716765:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c186f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338707.716773:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff90bbdee56f00) 00010000:00010000:2.0:1787338707.716775:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787338707.716778:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c186f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338707.716784:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c186f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338707.716813:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c1861 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab72a expref: 41 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338707.716825:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c1876 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab72a expref: 40 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338707.716832:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90bbdee56600) 00010000:00010000:2.0:1787338707.716835:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787338707.716842:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf40e2a00, rc 0) 00000100:00100000:2.0:1787338707.716925:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf7eaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+40:10382:x1874160192095616:12345-192.168.201.53@tcp:101:stat.0 Request processed in 661us (1099us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338707.716933:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 55 00000100:00100000:1.0:1787338707.806545:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338707.806691:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192095872 00000100:00100000:3.0:1787338707.806701:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192095872 00000100:00100000:3.0:1787338707.806766:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 56 00000100:00100000:3.0:1787338707.806777:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbef19f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+40:10392:x1874160192095872:12345-192.168.201.53@tcp:101:lfs.0 00010000:00010000:3.0:1787338707.806795:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787338707.806815:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4400/0x83671231080c187d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab731 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787338707.806957:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:3.0:1787338707.807249:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4400/0x83671231080c187d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab731 expref: 42 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338707.807265:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90bbdee56300) 00010000:00010000:3.0:1787338707.807268:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787338707.807273:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4400/0x83671231080c187d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab731 expref: 42 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338707.807287:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf7ea4400, rc 0) 00000100:00100000:3.0:1787338707.807441:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbef19f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+41:10392:x1874160192095872:12345-192.168.201.53@tcp:101:lfs.0 Request processed in 666us (905us total) trans 4294967339 rc 301/301 00000100:00100000:3.0:1787338707.807449:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 56 00000100:00100000:1.0:1787338707.811078:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338707.811262:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192096128 00000100:00100000:0.0:1787338707.811271:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192096128 00000100:00100000:0.0:1787338707.811334:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 14 00000100:00100000:0.0:1787338707.811344:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbef19d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:83642291-0761-4205-9531-7fd25bc2d48e+41:10392:x1874160192096128:12345-192.168.201.53@tcp:35:lfs.0 00000100:00100000:0.0:1787338707.811579:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbef19d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:83642291-0761-4205-9531-7fd25bc2d48e+42:10392:x1874160192096128:12345-192.168.201.53@tcp:35:lfs.0 Request processed in 236us (509us total) trans 4294967340 rc 0/0 00000100:00100000:0.0:1787338707.811588:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 14 00000100:00100000:0.0:1787338707.885207:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338707.885289:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192096384 00000100:00100000:3.0:1787338707.885298:0:7647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192096384 00000100:00100000:3.0:1787338707.885363:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 57 00000100:00100000:3.0:1787338707.885373:0:7647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf7ead880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+42:10398:x1874160192096384:12345-192.168.201.53@tcp:101:bash.0 00010000:00010000:3.0:1787338707.885397:0:7647:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787338707.885416:0:7647:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4400/0x83671231080c188b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab738 expref: -99 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338707.885519:0:7647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5200/0x83671231080c1892 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338707.885534:0:7647:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c1876 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab72a expref: 43 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338707.885543:0:7647:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5200/0x83671231080c1892 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338707.885574:0:7647:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c1876 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab72a expref: 43 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338707.885586:0:7647:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c1876 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab72a expref: 43 pid: 5840 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338707.885599:0:7647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbedcb5880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7647:1874160212048384:192.168.201.53@tcp:104: 00000100:00100000:3.0:1787338707.885686:0:7647:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbedc57840 going to sleep for 11 seconds 00000100:00100000:2.0:1787338707.889357:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338707.889485:0:7647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbedcb5880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7647:1874160212048384:192.168.201.53@tcp:104: 00010000:00010000:3.0:1787338707.889513:0:7647:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5200/0x83671231080c1892 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338707.889583:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192096512 00000100:00100000:0.0:1787338707.889590:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192096512 00010000:00010000:0.0:1787338707.889624:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c1876 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab72a expref: 44 pid: 5840 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338707.889668:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 40 00000100:00100000:0.0:1787338707.889677:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbff8fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:83642291-0761-4205-9531-7fd25bc2d48e+44:2358:x1874160192096512:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787338707.889692:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787338707.889698:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c1876 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab72a expref: 44 pid: 5840 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338707.889709:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c1876 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab72a expref: 44 pid: 5840 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338707.889730:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c1876 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab72a expref: 44 pid: 5840 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338707.889771:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90bbdee56600) 00010000:00010000:0.0:1787338707.889776:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5200/0x83671231080c1892 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338707.889785:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5200/0x83671231080c1892 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338707.889792:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5200/0x83671231080c1892 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338707.889828:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787338707.889934:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbff8fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:83642291-0761-4205-9531-7fd25bc2d48e+43:2358:x1874160192096512:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 256us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338707.889942:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 40 00010000:00010000:1.0:1787338707.890124:0:7647:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5200/0x83671231080c1892 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338707.890132:0:7647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5200/0x83671231080c1892 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787338707.890149:0:7647:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:1.0:1787338707.890293:0:7647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4400/0x83671231080c188b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab738 expref: 44 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338707.890307:0:7647:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5200/0x83671231080c1892 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab738 expref: 43 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338707.890337:0:7647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90bbdee56600) 00010000:00010000:1.0:1787338707.890340:0:7647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787338707.890343:0:7647:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf7ea5200, rc 0) 00000100:00100000:1.0:1787338707.890370:0:7647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf7ead880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+43:10398:x1874160192096384:12345-192.168.201.53@tcp:101:bash.0 Request processed in 4998us (5173us total) trans 4294967341 rc 0/0 00000100:00100000:1.0:1787338707.890376:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 57 00000100:00100000:1.0:1787338707.896032:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338707.896115:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192096768 00000100:00100000:2.0:1787338707.896126:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192096768 00000100:00100000:2.0:1787338707.896176:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 58 00000100:00100000:2.0:1787338707.896187:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbef19ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+43:10398:x1874160192096768:12345-192.168.201.53@tcp:36:bash.0 00010000:00010000:2.0:1787338707.896443:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c18a0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338707.896459:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c18a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338707.896469:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c18a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787338707.896516:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:2.0:1787338707.896535:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ac8361a3 reply state 0000000029e9fe7c transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c18a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338707.896543:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787338707.896624:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbef19ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+46:10398:x1874160192096768:12345-192.168.201.53@tcp:36:bash.0 Request processed in 439us (667us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1787338707.896631:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 58 00000020:00080000:2.0:1787338707.896636:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787338707.903231:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c18a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338707.903249:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c18a0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338707.903256:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c18a0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338707.903278:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e2600 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:3.0:1787338707.903283:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c18a0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338707.903290:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c18a0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338707.903308:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90bbdee56600) 00010000:00010000:3.0:1787338707.903311:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787338707.903316:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c18a0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338707.903333:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c18a0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338707.908334:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338707.908559:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192096896 00000100:00100000:2.0:1787338707.908568:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192096896 00000100:00100000:2.0:1787338707.908622:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 59 00000100:00100000:2.0:1787338707.908645:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbef19c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+45:10398:x1874160192096896:12345-192.168.201.53@tcp:101:bash.0 00010000:00010000:2.0:1787338707.908678:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787338707.908699:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c18a7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab73f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338707.908786:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c18ae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338707.908801:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5200/0x83671231080c1892 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab738 expref: 46 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338707.908810:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c18ae lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338707.908844:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5200/0x83671231080c1892 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab738 expref: 46 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338707.908858:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5200/0x83671231080c1892 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab738 expref: 46 pid: 7647 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338707.908892:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbff8fce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5840:1874160212048512:192.168.201.53@tcp:104: 00000100:00100000:2.0:1787338707.909127:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbfffc1900 going to sleep for 11 seconds 00000100:00100000:0.0:1787338707.912830:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338707.912911:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192097024 00000100:00100000:1.0:1787338707.912919:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192097024 00010000:00010000:1.0:1787338707.912955:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5200/0x83671231080c1892 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab738 expref: 47 pid: 7647 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338707.913064:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 41 00000100:00100000:1.0:1787338707.913074:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf7eae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:83642291-0761-4205-9531-7fd25bc2d48e+47:2359:x1874160192097024:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787338707.913088:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787338707.913095:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5200/0x83671231080c1892 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab738 expref: 47 pid: 7647 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338707.913108:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5200/0x83671231080c1892 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab738 expref: 47 pid: 7647 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338707.913128:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90bbdee56600) 00010000:00010000:1.0:1787338707.913134:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c18ae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338707.913166:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c18ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338707.913173:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c18ae lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338707.913190:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787338707.913246:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf7eae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:83642291-0761-4205-9531-7fd25bc2d48e+47:2359:x1874160192097024:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 174us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338707.913253:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 41 00010000:00010000:2.0:1787338707.913845:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5200/0x83671231080c1892 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab738 expref: 46 pid: 7647 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338707.913861:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbff8fce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5840:1874160212048512:192.168.201.53@tcp:104: 00010000:00010000:2.0:1787338707.914034:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c18ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338707.914056:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c18ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338707.914062:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c18ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787338707.914102:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1787338707.914106:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787338707.914123:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c18ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338707.914150:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c18a7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab73f expref: 46 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338707.914165:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c18ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab73f expref: 45 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338707.914173:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90bbdee56600) 00010000:00010000:2.0:1787338707.914175:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787338707.914178:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf40e2a00, rc 0) 00000100:00100000:2.0:1787338707.914218:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbef19c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+45:10398:x1874160192096896:12345-192.168.201.53@tcp:101:bash.0 Request processed in 5575us (5893us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338707.914226:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 59 00000100:00100000:0.0:1787338707.918630:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338707.918694:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192097280 00000100:00100000:2.0:1787338707.918703:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192097280 00000100:00100000:2.0:1787338707.918801:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 15 00000100:00100000:2.0:1787338707.918811:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbd894ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:83642291-0761-4205-9531-7fd25bc2d48e+45:10398:x1874160192097280:12345-192.168.201.53@tcp:35:bash.0 00000100:00100000:2.0:1787338707.919122:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbd894ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:83642291-0761-4205-9531-7fd25bc2d48e+46:10398:x1874160192097280:12345-192.168.201.53@tcp:35:bash.0 Request processed in 311us (500us total) trans 4294967344 rc 0/0 00000100:00100000:2.0:1787338707.919148:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 15 00000100:00100000:3.0:1787338708.001953:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338708.002142:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192097536 00000100:00100000:2.0:1787338708.002152:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192097536 00000100:00100000:2.0:1787338708.002221:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 60 00000100:00100000:2.0:1787338708.002232:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbedcb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+46:10408:x1874160192097536:12345-192.168.201.53@tcp:101:lfs.0 00010000:00010000:2.0:1787338708.002255:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787338708.002274:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c18b5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab746 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787338708.002396:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:2.0:1787338708.002622:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1787338708.002722:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c18b5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab746 expref: 48 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338708.002734:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90bbdee56300) 00010000:00010000:2.0:1787338708.002736:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787338708.002740:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c18b5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab746 expref: 48 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338708.002765:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf40e3200, rc 0) 00000100:00100000:2.0:1787338708.002822:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbedcb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+47:10408:x1874160192097536:12345-192.168.201.53@tcp:101:lfs.0 Request processed in 592us (879us total) trans 4294967345 rc 301/301 00000100:00100000:2.0:1787338708.002829:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 60 00000100:00100000:0.0:1787338708.005835:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338708.006507:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192097664 00000100:00100000:1.0:1787338708.006517:0:7647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192097664 00000100:00100000:1.0:1787338708.006589:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 61 00000100:00100000:1.0:1787338708.006599:0:7647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf7eac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+47:10408:x1874160192097664:12345-192.168.201.53@tcp:34:lfs.0 00010000:00010000:1.0:1787338708.006664:0:7647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d400/0x83671231080c18c3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338708.006679:0:7647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d400/0x83671231080c18c3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338708.006690:0:7647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d400/0x83671231080c18c3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338708.006703:0:7647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d000/0x83671231080c18ca lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338708.006710:0:7647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d000/0x83671231080c18ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338708.006729:0:7647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d000/0x83671231080c18ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338708.006840:0:7647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c18d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338708.006849:0:7647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c18d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338708.006856:0:7647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c18d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787338708.006907:0:7647:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c18d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338708.006920:0:7647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d400/0x83671231080c18c3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338708.006926:0:7647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d400/0x83671231080c18c3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338708.006933:0:7647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d400/0x83671231080c18c3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338708.006938:0:7647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbfbe9d400 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:1.0:1787338708.006942:0:7647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d400/0x83671231080c18c3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338708.006950:0:7647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d400/0x83671231080c18c3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338708.006961:0:7647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff90bbdee56e00) 00010000:00010000:1.0:1787338708.007033:0:7647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787338708.007038:0:7647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d400/0x83671231080c18c3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338708.007044:0:7647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d400/0x83671231080c18c3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338708.007057:0:7647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d000/0x83671231080c18ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338708.007063:0:7647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d000/0x83671231080c18ca lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338708.007070:0:7647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d000/0x83671231080c18ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338708.007075:0:7647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbfbe9d000 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:1.0:1787338708.007077:0:7647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d000/0x83671231080c18ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338708.007082:0:7647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d000/0x83671231080c18ca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338708.007090:0:7647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff90bbc2a93800) 00010000:00010000:1.0:1787338708.007092:0:7647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787338708.007094:0:7647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d000/0x83671231080c18ca lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338708.007099:0:7647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d000/0x83671231080c18ca lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338708.007125:0:7647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c18d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338708.007142:0:7647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c18d1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338708.007149:0:7647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c18d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338708.007154:0:7647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbfbe9d800 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:1.0:1787338708.007157:0:7647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c18d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338708.007164:0:7647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c18d1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338708.007172:0:7647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90bbdee56600) 00010000:00010000:1.0:1787338708.007173:0:7647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787338708.007176:0:7647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c18d1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338708.007183:0:7647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c18d1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338708.007288:0:7647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf7eac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+47:10408:x1874160192097664:12345-192.168.201.53@tcp:34:lfs.0 Request processed in 689us (1460us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338708.007295:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 61 00000100:00100000:3.0:1787338708.009380:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338708.009506:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192097920 00000100:00100000:2.0:1787338708.009516:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192097920 00000100:00100000:2.0:1787338708.009561:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 16 00000100:00100000:2.0:1787338708.009570:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbedcb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:83642291-0761-4205-9531-7fd25bc2d48e+47:10408:x1874160192097920:12345-192.168.201.53@tcp:35:lfs.0 00000100:00100000:2.0:1787338708.009898:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbedcb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:83642291-0761-4205-9531-7fd25bc2d48e+48:10408:x1874160192097920:12345-192.168.201.53@tcp:35:lfs.0 Request processed in 328us (524us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1787338708.009905:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 16 00000100:00100000:3.0:1787338708.045170:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338708.045276:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192098176 00000100:00100000:0.0:1787338708.045283:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192098176 00000100:00100000:0.0:1787338708.045347:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 62 00000100:00100000:0.0:1787338708.045355:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbedcb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+48:10411:x1874160192098176:12345-192.168.201.53@tcp:101:lfs.0 00010000:00010000:0.0:1787338708.045379:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787338708.045400:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031400/0x83671231080c18d8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab74d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338708.045473:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c18df lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338708.045506:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c18df lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338708.045517:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c18df lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338708.045532:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031a00/0x83671231080c18e6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338708.045540:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031a00/0x83671231080c18e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338708.045547:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031a00/0x83671231080c18e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338708.045665:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c18ed lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338708.045674:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c18ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338708.045682:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c18ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787338708.045692:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1787338708.045796:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c18df lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338708.045804:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c18df lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338708.045811:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c18df lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338708.045825:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbc0031000 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:0.0:1787338708.045830:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c18df lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338708.045837:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c18df lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338708.045850:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff90bbdee56e00) 00010000:00010000:0.0:1787338708.045853:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787338708.045858:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c18df lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338708.045864:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c18df lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338708.045911:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031a00/0x83671231080c18e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338708.045916:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031a00/0x83671231080c18e6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338708.045921:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031a00/0x83671231080c18e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338708.045926:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbc0031a00 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:0.0:1787338708.045929:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031a00/0x83671231080c18e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338708.045936:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031a00/0x83671231080c18e6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338708.045954:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff90bbeb14d600) 00010000:00010000:0.0:1787338708.045957:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787338708.045960:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031a00/0x83671231080c18e6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338708.046255:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031a00/0x83671231080c18e6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338708.046314:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031400/0x83671231080c18d8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab74d expref: 51 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338708.046328:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c18ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab74d expref: 50 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338708.046441:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90bbdee56600) 00010000:00010000:0.0:1787338708.046444:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787338708.046447:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbc0030800, rc 0) 00000100:00100000:0.0:1787338708.046511:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbedcb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+50:10411:x1874160192098176:12345-192.168.201.53@tcp:101:lfs.0 Request processed in 1154us (1349us total) trans 4294967347 rc 0/0 00000100:00100000:0.0:1787338708.046520:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 62 00000100:00100000:0.0:1787338708.050333:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338708.050670:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192098304 00000100:00100000:2.0:1787338708.050677:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192098304 00000100:00100000:2.0:1787338708.050726:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 63 00000100:00100000:2.0:1787338708.050735:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf7eaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+50:10411:x1874160192098304:12345-192.168.201.53@tcp:54:lfs.0 00010000:00010000:2.0:1787338708.050800:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c18fb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338708.050816:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c18fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338708.050825:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c18fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338708.050846:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c18fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338708.050853:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c18fb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338708.050860:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c18fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338708.050866:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e3200 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:2.0:1787338708.050870:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c18fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338708.050907:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c18fb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338708.050929:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90bbdee56600) 00010000:00010000:2.0:1787338708.050932:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787338708.050936:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c18fb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338708.050941:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c18fb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338708.051084:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf7eaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+50:10411:x1874160192098304:12345-192.168.201.53@tcp:54:lfs.0 Request processed in 349us (772us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338708.051092:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 63 00000100:00100000:1.0:1787338708.052483:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338708.052592:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192098432 00000100:00100000:0.0:1787338708.052599:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192098432 00000100:00100000:0.0:1787338708.052653:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 4 00000100:00100000:0.0:1787338708.052663:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbef19f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:83642291-0761-4205-9531-7fd25bc2d48e+50:2358:x1874160192098432:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787338708.052677:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787338708.052695:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c18ed lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab74d expref: 50 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338708.052720:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90bbdee56600) 00010000:00010000:0.0:1787338708.052724:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787338708.052780:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbef19f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:83642291-0761-4205-9531-7fd25bc2d48e+49:2358:x1874160192098432:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 119us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338708.052788:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 4 00000100:00100000:3.0:1787338708.055732:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338708.055822:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192098688 00000100:00100000:1.0:1787338708.055830:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192098688 00000100:00100000:1.0:1787338708.055915:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 17 00000100:00100000:1.0:1787338708.055925:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbedcb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:83642291-0761-4205-9531-7fd25bc2d48e+49:10411:x1874160192098688:12345-192.168.201.53@tcp:35:lfs.0 00000100:00100000:1.0:1787338708.056636:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbedcb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:83642291-0761-4205-9531-7fd25bc2d48e+50:10411:x1874160192098688:12345-192.168.201.53@tcp:35:lfs.0 Request processed in 710us (907us total) trans 4294967348 rc 0/0 00000100:00100000:1.0:1787338708.056644:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 17 00000100:00100000:1.0:1787338708.210513:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338708.210611:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192098944 00000100:00100000:2.0:1787338708.210620:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192098944 00000100:00100000:2.0:1787338708.210676:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 64 00000100:00100000:2.0:1787338708.210686:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbef19e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+50:10429:x1874160192098944:12345-192.168.201.53@tcp:101:cat.0 00010000:00010000:2.0:1787338708.210707:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787338708.210724:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c1902 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab754 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338708.210821:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c1909 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338708.210835:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c1909 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338708.210847:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c1909 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787338708.210858:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1787338708.211167:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c1902 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab754 expref: 53 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338708.211246:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c1909 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab754 expref: 52 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338708.211255:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90bbdee56600) 00010000:00010000:2.0:1787338708.211258:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787338708.211261:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf40e2c00, rc 0) 00000100:00100000:2.0:1787338708.211369:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbef19e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+52:10429:x1874160192098944:12345-192.168.201.53@tcp:101:cat.0 Request processed in 683us (863us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1787338708.211377:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 64 00000100:00100000:0.0:1787338708.238793:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338708.239048:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192099072 00000100:00100000:2.0:1787338708.239058:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192099072 00000100:00100000:2.0:1787338708.239331:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 65 00000100:00100000:2.0:1787338708.239342:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf7eae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+52:10430:x1874160192099072:12345-192.168.201.53@tcp:101:lfs.0 00010000:00010000:2.0:1787338708.239364:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787338708.239383:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c1917 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab75b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338708.239443:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c191e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338708.239456:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c191e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338708.239466:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c191e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787338708.239535:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:2.0:1787338708.239539:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787338708.239557:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c191e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338708.239580:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c1917 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab75b expref: 54 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338708.239598:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c191e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab75b expref: 53 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338708.239607:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff90bbdee56e00) 00010000:00010000:2.0:1787338708.239610:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787338708.239613:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf40e2600, rc 0) 00000100:00100000:2.0:1787338708.239673:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf7eae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+53:10430:x1874160192099072:12345-192.168.201.53@tcp:101:lfs.0 Request processed in 333us (890us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338708.239679:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 65 00000100:00100000:3.0:1787338708.243447:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338708.243519:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192099456 00000100:00100000:1.0:1787338708.243528:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192099456 00000100:00100000:1.0:1787338708.243574:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 18 00000100:00100000:1.0:1787338708.243584:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbedcb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:83642291-0761-4205-9531-7fd25bc2d48e+53:10430:x1874160192099456:12345-192.168.201.53@tcp:35:lfs.0 00000100:00100000:1.0:1787338708.243953:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbedcb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:83642291-0761-4205-9531-7fd25bc2d48e+54:10430:x1874160192099456:12345-192.168.201.53@tcp:35:lfs.0 Request processed in 370us (513us total) trans 4294967350 rc 0/0 00000100:00100000:1.0:1787338708.244248:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 18 00000100:00100000:0.0:1787338708.246707:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338708.246791:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192099584 00000100:00100000:1.0:1787338708.246800:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192099584 00000100:00100000:1.0:1787338708.246909:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 5 00000100:00100000:1.0:1787338708.246920:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf7eaea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:83642291-0761-4205-9531-7fd25bc2d48e+54:10430:x1874160192099584:12345-192.168.201.53@tcp:103:lfs.0 00010000:00010000:1.0:1787338708.246932:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1787338708.246953:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c18ae lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab73f expref: 54 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338708.247038:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c1909 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab754 expref: 53 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338708.247050:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3600/0x83671231080c17b9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab700 expref: 52 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338708.247060:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90bbdee56600) 00010000:00010000:1.0:1787338708.247082:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787338708.247135:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf7eaea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:83642291-0761-4205-9531-7fd25bc2d48e+51:10430:x1874160192099584:12345-192.168.201.53@tcp:103:lfs.0 Request processed in 217us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338708.247142:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 5 00000100:00100000:0.0:1787338708.248667:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338708.248747:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192099712 00000100:00100000:3.0:1787338708.248754:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192099712 00000100:00100000:3.0:1787338708.248798:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 66 00000100:00100000:3.0:1787338708.248806:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf7ead500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+51:10430:x1874160192099712:12345-192.168.201.53@tcp:58:lfs.0 00010000:00010000:3.0:1787338708.248929:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4800/0x83671231080c1925 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338708.248944:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4800/0x83671231080c1925 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338708.249031:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4800/0x83671231080c1925 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787338708.249799:0:5839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787338708.250460:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:3.0:1787338708.250528:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:3.0:1787338708.250657:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf7ead500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+51:10430:x1874160192099712:12345-192.168.201.53@tcp:58:lfs.0 Request processed in 1849us (1991us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338708.250665:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 66 00000100:00100000:0.0:1787338708.267067:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338708.267227:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192099840 00000100:00100000:1.0:1787338708.267237:0:7647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192099840 00000100:00100000:1.0:1787338708.267294:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 67 00000100:00100000:1.0:1787338708.267304:0:7647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf7eace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+51:10432:x1874160192099840:12345-192.168.201.53@tcp:101:lfs.0 00010000:00010000:1.0:1787338708.267492:0:7647:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787338708.267513:0:7647:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d400/0x83671231080c192c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab762 expref: -99 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338708.267575:0:7647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d000/0x83671231080c1933 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338708.267589:0:7647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d000/0x83671231080c1933 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338708.267598:0:7647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d000/0x83671231080c1933 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338708.267612:0:7647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c193a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338708.267618:0:7647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c193a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338708.267624:0:7647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c193a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338708.267717:0:7647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9cc00/0x83671231080c1941 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338708.267749:0:7647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9cc00/0x83671231080c1941 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338708.267757:0:7647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9cc00/0x83671231080c1941 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787338708.267791:0:7647:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1787338708.267795:0:7647:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787338708.267812:0:7647:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9cc00/0x83671231080c1941 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338708.267823:0:7647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9cc00/0x83671231080c1941 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338708.267830:0:7647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d000/0x83671231080c1933 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338708.267837:0:7647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d000/0x83671231080c1933 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338708.267843:0:7647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d000/0x83671231080c1933 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338708.267848:0:7647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbfbe9d000 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:1.0:1787338708.267852:0:7647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d000/0x83671231080c1933 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338708.267859:0:7647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d000/0x83671231080c1933 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338708.267870:0:7647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff90bbdee56e00) 00010000:00010000:1.0:1787338708.267892:0:7647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787338708.267903:0:7647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d000/0x83671231080c1933 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338708.267909:0:7647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d000/0x83671231080c1933 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338708.267922:0:7647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c193a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338708.267928:0:7647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c193a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338708.267934:0:7647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c193a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338708.267940:0:7647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbfbe9d800 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:1.0:1787338708.267943:0:7647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c193a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338708.267948:0:7647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c193a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338708.267956:0:7647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff90bbc2a93800) 00010000:00010000:1.0:1787338708.267958:0:7647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787338708.268029:0:7647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c193a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338708.268036:0:7647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c193a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338708.268066:0:7647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d400/0x83671231080c192c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab762 expref: 53 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338708.268091:0:7647:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9cc00/0x83671231080c1941 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab762 expref: 52 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338708.268097:0:7647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90bbd38d6800) 00010000:00010000:1.0:1787338708.268099:0:7647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787338708.268101:0:7647:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbfbe9cc00, rc 0) 00000100:00100000:1.0:1787338708.268368:0:7647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf7eace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+52:10432:x1874160192099840:12345-192.168.201.53@tcp:101:lfs.0 Request processed in 1063us (1307us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338708.268375:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 67 00010000:00010000:1.0:1787338708.671170:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787338708.984486:0:11692:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787338708.984494:0:11692:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787338708.984537:0:11692:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1787338708.984555:0:11692:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787338708.984665:0:11692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbff8fce00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11692:1874160212048640:192.168.201.53@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787338708.984755:0:11692:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbfffc1780 going to sleep for 11 seconds 00000100:00100000:3.0:1787338708.991267:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338708.991310:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192099968 00000100:00100000:3.0:1787338708.991318:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192099968 00000100:00100000:3.0:1787338708.991361:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 1 00000100:00100000:3.0:1787338708.991370:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf41b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:83642291-0761-4205-9531-7fd25bc2d48e+53:10443:x1874160192099968:12345-192.168.201.53@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1787338708.991440:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf41b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:83642291-0761-4205-9531-7fd25bc2d48e+53:10443:x1874160192099968:12345-192.168.201.53@tcp:900:lhsmtool_posix.0 Request processed in 70us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338708.991448:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 1 00000100:00100000:2.0:1787338708.991831:0:11692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbff8fce00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11692:1874160212048640:192.168.201.53@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787338708.994089:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338708.994168:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192100096 00000100:00100000:2.0:1787338708.994176:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192100096 00000100:00100000:2.0:1787338708.994235:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 68 00000100:00100000:2.0:1787338708.994244:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf41b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+52:10443:x1874160192100096:12345-192.168.201.53@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787338708.994269:0:5841:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787338708.994355:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf41b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+52:10443:x1874160192100096:12345-192.168.201.53@tcp:53:lhsmtool_posix.0 Request processed in 112us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338708.994362:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 68 00000100:00100000:0.0:1787338709.002084:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338709.003119:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192100224 00000100:00100000:1.0:1787338709.003128:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192100224 00000100:00100000:1.0:1787338709.003193:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 69 00000100:00100000:1.0:1787338709.003209:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf7eac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+52:10443:x1874160192100224:12345-192.168.201.53@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787338709.003289:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d000/0x83671231080c1948 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338709.003308:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d000/0x83671231080c1948 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338709.003320:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d000/0x83671231080c1948 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338709.003336:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ce00/0x83671231080c194f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338709.003344:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ce00/0x83671231080c194f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338709.003356:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ce00/0x83671231080c194f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338709.003382:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9de00/0x83671231080c1956 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338709.003391:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9de00/0x83671231080c1956 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338709.003398:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9de00/0x83671231080c1956 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787338709.003438:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1787338709.003444:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787338709.003462:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9de00/0x83671231080c1956 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338709.003475:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d000/0x83671231080c1948 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338709.003482:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d000/0x83671231080c1948 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338709.003489:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d000/0x83671231080c1948 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338709.003495:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbfbe9d000 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:1.0:1787338709.003500:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d000/0x83671231080c1948 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338709.003507:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d000/0x83671231080c1948 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338709.003533:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90bbdee56100) 00010000:00010000:1.0:1787338709.003537:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787338709.003542:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d000/0x83671231080c1948 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338709.003549:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d000/0x83671231080c1948 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338709.003560:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ce00/0x83671231080c194f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338709.003566:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ce00/0x83671231080c194f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338709.003572:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ce00/0x83671231080c194f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338709.003578:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbfbe9ce00 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:1.0:1787338709.003581:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ce00/0x83671231080c194f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338709.003587:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ce00/0x83671231080c194f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338709.003594:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff90bbc2a93800) 00010000:00010000:1.0:1787338709.003596:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787338709.003599:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ce00/0x83671231080c194f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338709.003604:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ce00/0x83671231080c194f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338709.003628:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9de00/0x83671231080c1956 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338709.003633:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9de00/0x83671231080c1956 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338709.003639:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9de00/0x83671231080c1956 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338709.003644:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbfbe9de00 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:1.0:1787338709.003647:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9de00/0x83671231080c1956 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338709.003652:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9de00/0x83671231080c1956 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338709.003660:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90bbd38d6800) 00010000:00010000:1.0:1787338709.003662:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787338709.003665:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9de00/0x83671231080c1956 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338709.003671:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9de00/0x83671231080c1956 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338709.009533:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf7eac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+52:10443:x1874160192100224:12345-192.168.201.53@tcp:34:lhsmtool_posix.0 Request processed in 6315us (7442us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338709.009548:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 69 00000100:00100000:1.0:1787338709.021207:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338709.021818:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192100480 00000100:00100000:2.0:1787338709.021831:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192100480 00000100:00100000:2.0:1787338709.021919:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 70 00000100:00100000:2.0:1787338709.021935:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbef19c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+52:10443:x1874160192100480:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787338709.021958:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787338709.021979:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3600/0x83671231080c195d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab769 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338709.022074:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c1964 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338709.022093:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c1964 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338709.022105:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c1964 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787338709.022119:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1787338709.022237:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c1964 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338709.022248:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c1964 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338709.022270:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c1964 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338709.022277:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e2c00 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:2.0:1787338709.022282:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c1964 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338709.022290:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c1964 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338709.022303:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90bbd38d6800) 00010000:00010000:2.0:1787338709.022306:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787338709.022310:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c1964 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338709.022316:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c1964 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338709.022357:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3600/0x83671231080c195d lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab769 expref: 54 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338709.022370:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90bbdee56100) 00010000:00010000:2.0:1787338709.022373:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787338709.022378:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3600/0x83671231080c195d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab769 expref: 54 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338709.022391:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf40e3600, rc 0) 00000100:00100000:2.0:1787338709.022460:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbef19c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+53:10443:x1874160192100480:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 Request processed in 529us (1258us total) trans 4294967351 rc 301/301 00000100:00100000:2.0:1787338709.022482:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 70 00000100:00100000:1.0:1787338709.031104:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338709.043401:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192100608 00000100:00100000:2.0:1787338709.043415:0:7647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192100608 00000100:00100000:2.0:1787338709.043508:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 71 00000100:00100000:2.0:1787338709.043518:0:7647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbef19f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+53:10443:x1874160192100608:12345-192.168.201.53@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787338709.043562:0:7647:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787338709.043674:0:7647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbef19f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+53:10443:x1874160192100608:12345-192.168.201.53@tcp:53:lhsmtool_posix.0 Request processed in 157us (12578us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338709.043682:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 71 00000100:00100000:1.0:1787338709.060331:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338709.060425:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192100864 00000100:00100000:0.0:1787338709.060434:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192100864 00000100:00100000:0.0:1787338709.060490:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 72 00000100:00100000:0.0:1787338709.060499:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbef19d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+53:10443:x1874160192100864:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787338709.060518:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787338709.060521:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787338709.060553:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c191e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab75b expref: 53 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338709.060573:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff90bbdee56e00) 00010000:00010000:0.0:1787338709.060577:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787338709.060588:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c1972 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab770 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787338709.061112:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:0.0:1787338709.061314:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c1979 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338709.061335:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c1979 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338709.061344:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c1979 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338709.061397:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c1972 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab770 expref: 55 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338709.061413:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c1979 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab770 expref: 54 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338709.061420:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff90bbeb14da00) 00010000:00010000:0.0:1787338709.061422:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787338709.061425:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbc0030400, rc 0) 00000100:00100000:0.0:1787338709.061482:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbef19d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+54:10443:x1874160192100864:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 Request processed in 983us (1159us total) trans 4294967352 rc 0/0 00000100:00100000:0.0:1787338709.061489:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 72 00000100:00100000:0.0:1787338709.066129:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338709.066187:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192101120 00000100:00100000:1.0:1787338709.066195:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192101120 00000100:00100000:1.0:1787338709.066248:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 73 00000100:00100000:1.0:1787338709.066258:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf7eadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+54:10443:x1874160192101120:12345-192.168.201.53@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787338709.066316:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787338709.066342:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c1979 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab770 expref: 54 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338709.066359:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff90bbeb14da00) 00010000:00010000:1.0:1787338709.066369:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787338709.066388:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9de00/0x83671231080c1987 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338709.066400:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9de00/0x83671231080c1987 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338709.066409:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9de00/0x83671231080c1987 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338709.066421:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ce00/0x83671231080c198e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x3ce2ee11 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338709.066429:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ce00/0x83671231080c198e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x3ce2ee11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338709.066435:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ce00/0x83671231080c198e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x3ce2ee11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338709.066499:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9de00/0x83671231080c1987 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338709.066515:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9de00/0x83671231080c1987 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338709.066522:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9de00/0x83671231080c1987 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338709.066528:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbfbe9de00 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:1.0:1787338709.066532:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9de00/0x83671231080c1987 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338709.066550:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9de00/0x83671231080c1987 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338709.066560:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff90bbdee56e00) 00010000:00010000:1.0:1787338709.066563:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787338709.066567:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9de00/0x83671231080c1987 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338709.066573:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9de00/0x83671231080c1987 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338709.066583:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ce00/0x83671231080c198e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x3ce2ee11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338709.066588:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ce00/0x83671231080c198e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x3ce2ee11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338709.066595:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ce00/0x83671231080c198e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x3ce2ee11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338709.066600:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbfbe9ce00 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:1.0:1787338709.066609:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ce00/0x83671231080c198e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x3ce2ee11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338709.066615:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ce00/0x83671231080c198e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x3ce2ee11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338709.066622:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x3ce2ee11 (ffff90bbc2a93800) 00010000:00010000:1.0:1787338709.066625:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787338709.066628:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ce00/0x83671231080c198e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x3ce2ee11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338709.066633:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ce00/0x83671231080c198e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x3ce2ee11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338709.066699:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf7eadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+53:10443:x1874160192101120:12345-192.168.201.53@tcp:36:lhsmtool_posix.0 Request processed in 442us (587us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787338709.066707:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 73 00000100:00100000:0.0:1787338709.070245:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338709.070549:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192101248 00000100:00100000:3.0:1787338709.070558:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192101248 00000100:00100000:3.0:1787338709.070606:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 74 00000100:00100000:3.0:1787338709.070615:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf7eadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+53:10443:x1874160192101248:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787338709.070632:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787338709.070652:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4000/0x83671231080c1995 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab777 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338709.070697:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5200/0x83671231080c199c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338709.070708:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5200/0x83671231080c199c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338709.070718:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5200/0x83671231080c199c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338709.070809:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4000/0x83671231080c1995 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab777 expref: 55 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338709.070824:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5200/0x83671231080c199c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab777 expref: 54 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338709.070833:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff90bbd38d6500) 00010000:00010000:3.0:1787338709.070836:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787338709.070839:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf7ea5200, rc 0) 00000100:00100000:3.0:1787338709.070905:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf7eadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+54:10443:x1874160192101248:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 Request processed in 291us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338709.070913:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 74 00000100:00100000:3.0:1787338709.073315:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338709.073362:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192101504 00000100:00100000:3.0:1787338709.073370:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192101504 00000100:00100000:3.0:1787338709.073405:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 75 00000100:00100000:3.0:1787338709.073413:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf41b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+54:10443:x1874160192101504:12345-192.168.201.53@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787338709.073474:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4400/0x83671231080c19a3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338709.073498:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4400/0x83671231080c19a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338709.073509:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4400/0x83671231080c19a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787338709.073777:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:3.0:1787338709.073786:0:5840:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 361914911460ns, next at 362914909514ns, rc = 0 00000004:00010000:3.0:1787338709.073859:0:5840:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000aed0ac5 reply state 00000000087bc6f2 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4400/0x83671231080c19a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338709.073867:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787338709.074227:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf41b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+56:10443:x1874160192101504:12345-192.168.201.53@tcp:36:lhsmtool_posix.0 Request processed in 812us (916us total) trans 4294967353 rc 0/0 00000100:00100000:3.0:1787338709.074235:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 75 00010000:00010000:2.0:1787338709.077852:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4400/0x83671231080c19a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338709.077867:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4400/0x83671231080c19a3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338709.077889:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4400/0x83671231080c19a3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338709.077896:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea4400 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:2.0:1787338709.077901:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4400/0x83671231080c19a3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338709.077908:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4400/0x83671231080c19a3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338709.077926:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff90bbd38d6500) 00010000:00010000:2.0:1787338709.077928:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787338709.077932:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4400/0x83671231080c19a3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338709.077966:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4400/0x83671231080c19a3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338709.078347:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338709.078406:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192101632 00000100:00100000:2.0:1787338709.078413:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192101632 00000100:00100000:2.0:1787338709.078458:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 76 00000100:00100000:2.0:1787338709.078467:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf41b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+55:10443:x1874160192101632:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787338709.078487:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787338709.078502:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c19aa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab77e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338709.078557:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c19aa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab77e expref: 56 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338709.078570:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c19aa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab77e expref: 56 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338709.078587:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff90bbd38d6500) 00010000:00010000:2.0:1787338709.078590:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787338709.078592:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf40e2c00, rc 0) 00000100:00100000:2.0:1787338709.078638:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf41b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+56:10443:x1874160192101632:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 Request processed in 173us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338709.078644:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 76 00000100:00100000:2.0:1787338709.098910:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338709.100075:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192101760 00000100:00100000:2.0:1787338709.100085:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192101760 00000100:00100000:2.0:1787338709.100148:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 24 00000100:00100000:2.0:1787338709.100165:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbff8fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2355:x1874160192101760:12345-192.168.201.53@tcp:8:lhsmtool_posix.0 00010000:00080000:2.0:1787338709.100192:0:6690:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 83642291-0761-4205-9531-7fd25bc2d48e@192.168.201.53@tcp t0 exp 0000000000000000 cur 361 last 0 00000020:00000080:2.0:1787338709.100223:0:6690:0:(genops.c:1385:class_connect()) connect: client 83642291-0761-4205-9531-7fd25bc2d48e, cookie 0x83671231080c19b1 00002000:00100000:2.0:1787338709.100233:0:6690:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 83642291-0761-4205-9531-7fd25bc2d48e/ffff90bbfdb73000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392c ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787338709.100253:0:6690:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787338709.100448:0:6690:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787338709.100475:0:6690:0:(import.c:65:import_set_state_nolock()) ffff90bbfdb70000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787338709.100549:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbff8fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:83642291-0761-4205-9531-7fd25bc2d48e+6:2355:x1874160192101760:12345-192.168.201.53@tcp:8:lhsmtool_posix.0 Request processed in 372us (1635us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338709.100557:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 24 00000100:00100000:1.0:1787338709.115043:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338709.115074:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192101888 00000100:00100000:1.0:1787338709.115083:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192101888 00000100:00100000:1.0:1787338709.115137:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 25 00000100:00100000:1.0:1787338709.115147:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee081180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:83642291-0761-4205-9531-7fd25bc2d48e+6:0:x1874160192101888:12345-192.168.201.53@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1787338709.115373:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787338709.120854:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbff8fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874160212048768:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787338709.120934:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338709.121677:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212048768 00000100:00100000:2.0:1787338709.121684:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212048768 00000100:00100000:2.0:1787338709.121748:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787338709.121758:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbff8fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874160212048768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787338709.121778:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787338709.121820:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbff8fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874160212048768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (886us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338709.121826:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787338709.121868:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbff8fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874160212048768:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787338709.124927:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:2.0:1787338709.206935:0:12011:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787338709.208245:0:12011:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787338709.208291:0:12011:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1787338709.208298:0:12011:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787338709.260338:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee081180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:83642291-0761-4205-9531-7fd25bc2d48e+7:0:x1874160192101888:12345-192.168.201.53@tcp:2:lhsmtool_posix.0 Request processed in 145182us (145292us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1787338709.260350:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 25 00000001:00080000:1.0:1787338709.260382:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00100000:1.0:1787338709.260391:0:6714:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 83642291-0761-4205-9531-7fd25bc2d48e 00000100:00100000:0.0:1787338709.293325:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338709.331656:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192102144 00000100:00100000:0.0:1787338709.331670:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192102144 00000100:00100000:0.0:1787338709.331745:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 19 00000100:00100000:0.0:1787338709.331756:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf7eafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:83642291-0761-4205-9531-7fd25bc2d48e+56:10443:x1874160192102144:12345-192.168.201.53@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787338709.331979:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf7eafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:83642291-0761-4205-9531-7fd25bc2d48e+57:10443:x1874160192102144:12345-192.168.201.53@tcp:35:lhsmtool_posix.0 Request processed in 224us (38663us total) trans 4294967354 rc 0/0 00000100:00100000:0.0:1787338709.332000:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 19 00000100:00100000:2.0:1787338709.334322:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338709.334471:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192102400 00000100:00100000:3.0:1787338709.334482:0:7647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192102400 00000100:00100000:3.0:1787338709.334572:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 77 00000100:00100000:3.0:1787338709.334582:0:7647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbff8fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+57:10443:x1874160192102400:12345-192.168.201.53@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787338709.334665:0:7647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbff8fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+57:10443:x1874160192102400:12345-192.168.201.53@tcp:57:lhsmtool_posix.0 Request processed in 85us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338709.334672:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 77 00000100:00100000:0.0:1787338709.352044:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338709.352105:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192102528 00000100:00100000:3.0:1787338709.352126:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192102528 00000100:00100000:3.0:1787338709.352192:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 78 00000100:00100000:3.0:1787338709.352205:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf7eaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+57:10443:x1874160192102528:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787338709.352235:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787338709.352256:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4000/0x83671231080c19b8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab785 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338709.352344:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c19bf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338709.352358:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c19bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338709.352371:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c19bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787338709.352405:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787338709.352422:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c19bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338709.352458:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4000/0x83671231080c19b8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab785 expref: 59 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338709.352476:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c19bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab785 expref: 58 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338709.352485:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff90bbd38d6500) 00010000:00010000:3.0:1787338709.352488:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787338709.352492:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf7ea5400, rc 0) 00000100:00100000:3.0:1787338709.352555:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf7eaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+58:10443:x1874160192102528:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 Request processed in 353us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338709.352563:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 78 00000100:00100000:3.0:1787338709.357312:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338709.357847:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192102656 00000100:00100000:1.0:1787338709.357866:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192102656 00000100:00100000:1.0:1787338709.357934:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 26 00000100:00100000:1.0:1787338709.357945:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf41b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:83642291-0761-4205-9531-7fd25bc2d48e+5:2358:x1874160192102656:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787338709.357962:0:6690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787338709.357981:0:6690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004f8e51d1/0x83671231080c19c6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab78c expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787338709.358008:0:6690:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a889fd5, blocks: 0x1 00010000:00010000:1.0:1787338709.358024:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=362s v=(0 0) 00010000:00010000:1.0:1787338709.358029:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787338709.358039:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f8e51d1/0x83671231080c19c6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab78c expref: 6 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338709.358057:0:6690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004f8e51d1/0x83671231080c19c6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab78c expref: 6 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338709.358071:0:6690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbfbe9ce00, rc 0) 00000100:00100000:1.0:1787338709.358254:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf41b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:83642291-0761-4205-9531-7fd25bc2d48e+6:2358:x1874160192102656:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 Request processed in 310us (948us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338709.358261:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 26 00000100:00100000:2.0:1787338709.372019:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338709.372341:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192102912 00000100:00100000:3.0:1787338709.372351:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192102912 00000100:00100000:3.0:1787338709.372410:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 79 00000100:00100000:3.0:1787338709.372421:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbff8fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+58:10443:x1874160192102912:12345-192.168.201.53@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787338709.372528:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbff8fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+58:10443:x1874160192102912:12345-192.168.201.53@tcp:57:lhsmtool_posix.0 Request processed in 108us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338709.372536:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 79 00000100:00100000:2.0:1787338709.381442:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338709.381522:0:10743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192103040 00000100:00100000:1.0:1787338709.381532:0:10743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192103040 00000100:00100000:1.0:1787338709.381590:0:10743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 27 00000100:00100000:1.0:1787338709.381601:0:10743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbff8ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:83642291-0761-4205-9531-7fd25bc2d48e+6:10443:x1874160192103040:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787338709.381617:0:10743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787338709.381642:0:10743:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036bdb84e/0x83671231080c19cd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab793 expref: -99 pid: 10743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338709.381671:0:10743:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004f8e51d1/0x83671231080c19c6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab78c expref: 7 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338709.381680:0:10743:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787338709.381684:0:10743:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787338709.381689:0:10743:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036bdb84e/0x83671231080c19cd lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab793 expref: 7 pid: 10743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338709.381738:0:10743:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004f8e51d1/0x83671231080c19c6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab78c expref: 7 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338709.381752:0:10743:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004f8e51d1/0x83671231080c19c6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab78c expref: 7 pid: 6690 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338709.381765:0:10743:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee083800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10743:1874160212048896:192.168.201.53@tcp:104: 00000100:00100000:1.0:1787338709.381854:0:10743:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbffa4c6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787338709.398401:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338709.398748:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192103168 00000100:00100000:3.0:1787338709.398759:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192103168 00010000:00010000:3.0:1787338709.398797:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004f8e51d1/0x83671231080c19c6 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab78c expref: 8 pid: 6690 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338709.398840:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 42 00000100:00100000:3.0:1787338709.398851:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbde53c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:83642291-0761-4205-9531-7fd25bc2d48e+8:2359:x1874160192103168:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787338709.398895:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787338709.398920:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004f8e51d1/0x83671231080c19c6 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab78c expref: 8 pid: 6690 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338709.398935:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004f8e51d1/0x83671231080c19c6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab78c expref: 8 pid: 6690 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338709.398961:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787338709.398966:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787338709.398975:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000036bdb84e/0x83671231080c19cd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab793 expref: 8 pid: 10743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338709.399000:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036bdb84e/0x83671231080c19cd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab793 expref: 8 pid: 10743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338709.399037:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000036bdb84e/0x83671231080c19cd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab793 expref: 8 pid: 10743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338709.399052:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf46f8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5825:1874160212049024:192.168.201.53@tcp:105: 00000100:00100000:3.0:1787338709.399219:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbedc57900 going to sleep for 11 seconds 00000100:00100000:1.0:1787338709.402317:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf46f8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5825:1874160212049024:192.168.201.53@tcp:105: 00010000:00010000:1.0:1787338709.402986:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787338709.403043:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbde53c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:83642291-0761-4205-9531-7fd25bc2d48e+8:2359:x1874160192103168:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 4192us (4648us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338709.403053:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 42 00010000:00010000:1.0:1787338709.409034:0:10743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004f8e51d1/0x83671231080c19c6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab78c expref: 7 pid: 6690 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338709.409066:0:10743:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee083800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10743:1874160212048896:192.168.201.53@tcp:104: 00010000:00010000:1.0:1787338709.409385:0:10743:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000036bdb84e/0x83671231080c19cd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab793 expref: 6 pid: 10743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338709.409403:0:10743:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbfbe9de00, rc 0) 00000100:00100000:1.0:1787338709.409467:0:10743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbff8ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:83642291-0761-4205-9531-7fd25bc2d48e+6:10443:x1874160192103040:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 Request processed in 27867us (28031us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338709.409476:0:10743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 27 00000100:00100000:0.0:1787338709.414039:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338709.414373:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192103296 00000100:00100000:3.0:1787338709.414383:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192103296 00002000:00100000:3.0:1787338709.414429:0:6696:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff90bbf7eac380 x1874160192103296/t0(0) o4->83642291-0761-4205-9531-7fd25bc2d48e@192.168.201.53@tcp:40/0 lens 504/0 e 0 to 0 dl 1787338720 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787338709.414441:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90bbf7eac380 with x1874160192103296 ext(0->8) 00002000:00010000:3.0:1787338709.414446:0:6696:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90bbf7eac380 00000100:00100000:3.0:1787338709.414478:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 0 00000100:00100000:3.0:1787338709.414487:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf7eac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:83642291-0761-4205-9531-7fd25bc2d48e+6:2358:x1874160192103296:12345-192.168.201.53@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1787338709.415426:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf7eac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:83642291-0761-4205-9531-7fd25bc2d48e+8:2358:x1874160192103296:12345-192.168.201.53@tcp:4:lhsmtool_posix.0 Request processed in 937us (1393us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1787338709.415436:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 0 00002000:00100000:3.0:1787338709.415443:0:6696:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff90bbf7eac380 x1874160192103296/t4294967302(0) o4->83642291-0761-4205-9531-7fd25bc2d48e@192.168.201.53@tcp:40/0 lens 504/448 e 0 to 0 dl 1787338720 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787338709.415453:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90bbf7eac380 with x1874160192103296 ext(0->8) 00002000:00010000:3.0:1787338709.415457:0:6696:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90bbf7eac380 00000100:00100000:1.0:1787338709.421031:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338709.421213:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192103424 00000100:00100000:3.0:1787338709.421222:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192103424 00000100:00100000:3.0:1787338709.421272:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 80 00000100:00100000:3.0:1787338709.421282:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee083800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+58:10443:x1874160192103424:12345-192.168.201.53@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1787338709.531690:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee083800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+58:10443:x1874160192103424:12345-192.168.201.53@tcp:44:lhsmtool_posix.0 Request processed in 110399us (110658us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338709.532265:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 80 00000001:00080000:0.0:1787338709.532315:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:0.0:1787338709.532665:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:0.0:1787338709.532683:0:5861:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90bbd0cea0c0 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:0.0:1787338709.532687:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90bbf4183c00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90bbd0cea180 00000020:00080000:0.0:1787338709.532690:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90bbf4183400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90bbfbb77400 00000004:00080000:0.0:1787338709.533044:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:1.0:1787338709.535750:0:5872:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:1.0:1787338709.535889:0:5872:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:0.0:1787338709.536059:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf7eaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874160212049280:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1787338709.536150:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338709.536171:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf7eae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874160212049152:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787338709.537012:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212049280 00000100:00100000:0.0:1787338709.537021:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212049280 00000100:00100000:2.0:1787338709.537024:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338709.537047:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192103552 00000100:00100000:2.0:1787338709.537050:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192103552 00000100:00100000:0.0:1787338709.538272:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787338709.538502:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc01dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1874160212049280:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1787338709.538656:0:6690:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1787338709.538660:0:6690:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787338709 00002000:00010000:0.0:1787338709.538663:0:6690:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787338709.538665:0:6690:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1787338709 -> 1787338709 00002000:00010000:0.0:1787338709.538668:0:6690:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1787338709.538736:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc01dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3316:x1874160212049280:12345-0@lo:2:osp-syn-0-0.0 Request processed in 454us (2586us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1787338709.538752:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787338709.538771:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 29 00000100:00100000:0.0:1787338709.538778:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbff8ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:83642291-0761-4205-9531-7fd25bc2d48e+8:2358:x1874160192103552:12345-192.168.201.53@tcp:16:lhsmtool_posix.0 00000004:00080000:0.0:1787338709.539518:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90bbf7eaea00/2, rc 0, transno 4294967303 00000100:00100000:0.0:1787338709.539526:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf7eaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874160212049280:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1787338709.543340:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338709.543409:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212049152 00000100:00100000:2.0:1787338709.543418:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212049152 00000100:00100000:2.0:1787338709.543463:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787338709.543474:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbff8fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3315:x1874160212049152:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1787338709.543503:0:6691:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:2.0:1787338709.543643:0:6691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a889fd1, atime: 0x6a889fd2, ctime: 0x6a889fd1, blocks: 0xb 00010000:00010000:2.0:1787338709.543655:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0b9c1b0/0x83671231080c19d4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338709.543670:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=362s v=(0 0) 00010000:00010000:2.0:1787338709.543675:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787338709.543681:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0b9c1b0/0x83671231080c19d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338709.543697:0:6691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0b9c1b0/0x83671231080c19d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338709.543707:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0b9c1b0/0x83671231080c19d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338709.543738:0:6691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b0b9c1b0/0x83671231080c19d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338709.543757:0:6691:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787338709.545523:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbff8fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3315:x1874160212049152:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2047us (2185us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1787338709.545534:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1787338709.545561:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787338709.545576:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787338709.545582:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b0b9c1b0/0x83671231080c19d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338709.545593:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e2a00 already unused, calling callback (ffffffffc1546230) 00010000:00010000:2.0:1787338709.545598:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0b9c1b0/0x83671231080c19d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338709.545608:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0b9c1b0/0x83671231080c19d4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338709.545625:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b0b9c1b0/0x83671231080c19d4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338709.545633:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0b9c1b0/0x83671231080c19d4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338709.545661:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787338709.545663:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787338709.545665:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787338709.545697:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90bbf7eae680/2, rc 0, transno 4294967301 00000100:00100000:2.0:1787338709.545703:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf7eae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874160212049152:0@lo:6:osp-syn-1-0.0 00000001:00080000:1.0:1787338709.610498:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:1.0:1787338709.610525:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:0.0:1787338709.610755:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbff8ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:83642291-0761-4205-9531-7fd25bc2d48e+6:2358:x1874160192103552:12345-192.168.201.53@tcp:16:lhsmtool_posix.0 Request processed in 71970us (73726us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338709.610766:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 29 00000100:00100000:0.0:1787338709.619822:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338709.623489:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc01fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d79243c8-b367-45ff-8d76-fbaa4be8becb:3317:1874160212049408:0@lo:400:kworker.0 00000100:00100000:0.0:1787338709.623552:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338709.623608:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787338709.623615:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc01ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1874160212049792:0@lo:400:kworker.0 00000100:00100000:0.0:1787338709.623642:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338709.623671:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc01f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874160212049536:0@lo:400:kworker.0 00000100:00100000:0.0:1787338709.623691:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338709.623707:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787338709.623711:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc01ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1874160212049664:0@lo:400:kworker.0 00000100:00100000:0.0:1787338709.623746:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338709.623776:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212049408 00000100:00100000:0.0:1787338709.623784:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212049408 00000100:00100000:0.0:1787338709.623820:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1787338709.623829:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4088c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+19:3317:x1874160212049408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787338709.623896:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4088c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+19:3317:x1874160212049408:12345-0@lo:400:kworker.0 Request processed in 68us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338709.623917:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1787338709.623949:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192103808 00000100:00100000:0.0:1787338709.623953:0:7647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192103808 00000100:00100000:0.0:1787338709.623971:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212049792 00000100:00100000:0.0:1787338709.623974:0:7647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212049792 00000100:00100000:0.0:1787338709.623995:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212049536 00000100:00100000:0.0:1787338709.623998:0:7647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212049536 00000100:00100000:0.0:1787338709.624009:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212049664 00000100:00100000:0.0:1787338709.624011:0:7647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212049664 00000100:00100000:0.0:1787338709.624023:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1787338709.624028:0:7647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc01c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1874160212049792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787338709.624057:0:7647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc01c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1874160212049792:12345-0@lo:400:kworker.0 Request processed in 29us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338709.624064:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1787338709.624665:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1787338709.624675:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc01d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874160212049536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787338709.624732:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc01d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874160212049536:12345-0@lo:400:kworker.0 Request processed in 60us (1039us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338709.624739:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1787338709.624753:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1787338709.624759:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc01f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874160212049664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787338709.624787:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc01f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874160212049664:12345-0@lo:400:kworker.0 Request processed in 29us (1040us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338709.624793:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1787338709.624805:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 81 00000100:00100000:3.0:1787338709.624812:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc01df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+13:10443:x1874160192103808:12345-192.168.201.53@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787338709.624851:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787338709.624910:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c19bf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab785 expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338709.624927:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff90bbd38d6500) 00010000:00010000:3.0:1787338709.624932:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787338709.624960:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4000/0x83671231080c19db lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338709.624974:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4000/0x83671231080c19db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338709.624992:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4000/0x83671231080c19db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338709.625181:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc01ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1874160212049664:0@lo:400:kworker.0 00000100:00100000:1.0:1787338709.625193:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc01f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874160212049536:0@lo:400:kworker.0 00000100:00080000:0.0:1787338709.625528:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787338709.625551:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc01ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1874160212049792:0@lo:400:kworker.0 00000100:00100000:0.0:1787338709.625561:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc01fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d79243c8-b367-45ff-8d76-fbaa4be8becb:3317:1874160212049408:0@lo:400:kworker.0 00000004:00010000:3.0:1787338709.628480:0:5840:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a4a0033e reply state 0000000010cb137a transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4000/0x83671231080c19db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338709.628498:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787338709.628619:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc01df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+14:10443:x1874160192103808:12345-192.168.201.53@tcp:36:lhsmtool_posix.0 Request processed in 3803us (8801us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1787338709.628628:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 81 00010000:00010000:3.0:1787338709.636407:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4000/0x83671231080c19db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338709.636425:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4000/0x83671231080c19db lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338709.636432:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4000/0x83671231080c19db lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338709.636439:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea4000 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:3.0:1787338709.636444:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4000/0x83671231080c19db lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338709.636452:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4000/0x83671231080c19db lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338709.636468:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff90bbd38d6500) 00010000:00010000:3.0:1787338709.636471:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787338709.636476:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4000/0x83671231080c19db lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338709.636500:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4000/0x83671231080c19db lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338709.647780:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338709.647905:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192103936 00000100:00100000:1.0:1787338709.647916:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192103936 00000100:00100000:1.0:1787338709.647972:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 31 00000100:00100000:1.0:1787338709.647983:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc01fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:83642291-0761-4205-9531-7fd25bc2d48e+6:2359:x1874160192103936:12345-192.168.201.53@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787338709.648378:0:6689:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1787338709.648382:0:6689:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1787338709 -> 1787338707 00002000:00010000:1.0:1787338709.648385:0:6689:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787338706 00002000:00010000:1.0:1787338709.648387:0:6689:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1787338709 -> 1787338707 00002000:00010000:1.0:1787338709.648403:0:6689:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1787338709.648464:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc01fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:83642291-0761-4205-9531-7fd25bc2d48e+7:2359:x1874160192103936:12345-192.168.201.53@tcp:2:lhsmtool_posix.0 Request processed in 483us (692us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1787338709.648473:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 31 00000100:00100000:3.0:1787338709.654570:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338709.654731:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192104192 00000100:00100000:1.0:1787338709.654740:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192104192 00000100:00100000:1.0:1787338709.654799:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 82 00000100:00100000:1.0:1787338709.654809:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf46f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+13:10443:x1874160192104192:12345-192.168.201.53@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1787338709.655019:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c000/0x83671231080c19e2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338709.655037:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5200/0x83671231080c199c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab777 expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338709.655045:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c000/0x83671231080c19e2 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338709.655189:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5200/0x83671231080c199c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab777 expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338709.655204:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5200/0x83671231080c199c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab777 expref: 13 pid: 5841 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338709.655219:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbef19f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5841:1874160212049920:192.168.201.53@tcp:104: 00000100:00100000:1.0:1787338709.655337:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc818c9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787338709.674008:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbef19f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5841:1874160212049920:192.168.201.53@tcp:104: 00010000:00010000:1.0:1787338709.674059:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c000/0x83671231080c19e2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338709.674996:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338709.676267:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192104320 00000100:00100000:2.0:1787338709.676292:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192104320 00010000:00010000:2.0:1787338709.676336:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5200/0x83671231080c199c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab777 expref: 14 pid: 5841 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338709.676381:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 43 00000100:00100000:2.0:1787338709.676392:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf46f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:83642291-0761-4205-9531-7fd25bc2d48e+14:2358:x1874160192104320:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787338709.676407:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787338709.676413:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5200/0x83671231080c199c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab777 expref: 14 pid: 5841 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338709.676427:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5200/0x83671231080c199c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab777 expref: 14 pid: 5841 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338709.676448:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5200/0x83671231080c199c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab777 expref: 14 pid: 5841 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338709.676464:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff90bbd38d6500) 00010000:00010000:2.0:1787338709.676470:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c000/0x83671231080c19e2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338709.676495:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c000/0x83671231080c19e2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338709.676502:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c000/0x83671231080c19e2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338709.676524:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787338709.676586:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf46f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:83642291-0761-4205-9531-7fd25bc2d48e+13:2358:x1874160192104320:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 196us (1592us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338709.676595:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 43 00010000:00010000:0.0:1787338709.678280:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c000/0x83671231080c19e2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338709.678300:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c000/0x83671231080c19e2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338709.678329:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c000/0x83671231080c19e2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338709.678337:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c000/0x83671231080c19e2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338709.678363:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c000/0x83671231080c19e2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338709.678369:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbfbe9c000 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:0.0:1787338709.678373:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c000/0x83671231080c19e2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338709.678381:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c000/0x83671231080c19e2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338709.678393:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff90bbd38d6500) 00010000:00010000:0.0:1787338709.678397:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787338709.678400:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c000/0x83671231080c19e2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338709.678406:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c000/0x83671231080c19e2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338709.678479:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf46f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+12:10443:x1874160192104192:12345-192.168.201.53@tcp:55:lhsmtool_posix.0 Request processed in 23668us (23914us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787338709.678488:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 82 00000100:00100000:3.0:1787338709.684756:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338709.684826:0:10743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192104448 00000100:00100000:2.0:1787338709.684836:0:10743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192104448 00000100:00100000:0.0:1787338709.684979:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 32 00000100:00100000:0.0:1787338709.684990:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf46f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:83642291-0761-4205-9531-7fd25bc2d48e+7:2358:x1874160192104448:12345-192.168.201.53@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787338709.685032:0:6690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000085548f5e/0x83671231080c19e9 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338709.685051:0:6690:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000036bdb84e/0x83671231080c19cd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab793 expref: 7 pid: 10743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338709.685075:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787338709.685080:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787338709.685085:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000085548f5e/0x83671231080c19e9 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338709.685133:0:6690:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000036bdb84e/0x83671231080c19cd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab793 expref: 7 pid: 10743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338709.685148:0:6690:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000036bdb84e/0x83671231080c19cd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab793 expref: 7 pid: 10743 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338709.685171:0:6690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc01ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6690:1874160212050048:192.168.201.53@tcp:104: 00000100:00100000:0.0:1787338709.685253:0:6690:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbf42dd480 going to sleep for 11 seconds 00010000:00010000:3.0:1787338709.686906:0:11676:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787338709.690394:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338709.690512:0:6690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc01ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6690:1874160212050048:192.168.201.53@tcp:104: 00010000:00010000:0.0:1787338709.690541:0:6690:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000085548f5e/0x83671231080c19e9 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338709.690633:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192104576 00000100:00100000:2.0:1787338709.690640:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192104576 00010000:00010000:2.0:1787338709.690673:0:6704:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000036bdb84e/0x83671231080c19cd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab793 expref: 8 pid: 10743 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338709.690749:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 44 00000100:00100000:2.0:1787338709.690758:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf46f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:83642291-0761-4205-9531-7fd25bc2d48e+8:2359:x1874160192104576:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787338709.690770:0:6704:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787338709.690790:0:6704:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000036bdb84e/0x83671231080c19cd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab793 expref: 8 pid: 10743 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338709.690813:0:6704:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000036bdb84e/0x83671231080c19cd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab793 expref: 8 pid: 10743 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338709.690836:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036bdb84e/0x83671231080c19cd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab793 expref: 8 pid: 10743 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338709.690864:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787338709.690869:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787338709.690903:0:6704:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000085548f5e/0x83671231080c19e9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338709.690914:0:6704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000085548f5e/0x83671231080c19e9 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338709.690942:0:6704:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787338709.690982:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf46f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:83642291-0761-4205-9531-7fd25bc2d48e+7:2359:x1874160192104576:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 225us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338709.690989:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 44 00010000:00010000:3.0:1787338709.691100:0:6690:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000085548f5e/0x83671231080c19e9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338709.691116:0:6690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000085548f5e/0x83671231080c19e9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338709.691140:0:6690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000085548f5e/0x83671231080c19e9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338709.691148:0:6690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000085548f5e/0x83671231080c19e9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338709.691166:0:6690:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000085548f5e/0x83671231080c19e9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338709.691174:0:6690:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbc0030800 already unused, calling callback (ffffffffc1546230) 00010000:00010000:3.0:1787338709.691178:0:6690:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000085548f5e/0x83671231080c19e9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338709.691198:0:6690:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000085548f5e/0x83671231080c19e9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338709.691212:0:6690:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000085548f5e/0x83671231080c19e9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338709.691219:0:6690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000085548f5e/0x83671231080c19e9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338709.691268:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf46f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:83642291-0761-4205-9531-7fd25bc2d48e+6:2358:x1874160192104448:12345-192.168.201.53@tcp:1:lhsmtool_posix.0 Request processed in 6280us (6522us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338709.691288:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 32 00000100:00100000:3.0:1787338709.696921:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338709.697000:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192104832 00000100:00100000:0.0:1787338709.697010:0:7647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192104832 00000100:00100000:0.0:1787338709.697065:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 83 00000100:00100000:0.0:1787338709.697075:0:7647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc283800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+12:10443:x1874160192104832:12345-192.168.201.53@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787338709.697164:0:7647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c19f0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338709.697195:0:7647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c19f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338709.697207:0:7647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c19f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338709.697426:0:7647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c19f7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338709.697437:0:7647:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c19aa lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab77e expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338709.697445:0:7647:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c19f7 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338709.697475:0:7647:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c19aa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab77e expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338709.697488:0:7647:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c19aa lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab77e expref: 13 pid: 5841 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338709.697500:0:7647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc01ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7647:1874160212050176:192.168.201.53@tcp:104: 00000100:00100000:0.0:1787338709.697582:0:7647:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbf42dd480 going to sleep for 11 seconds 00000100:00100000:0.0:1787338709.701419:0:7647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc01ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7647:1874160212050176:192.168.201.53@tcp:104: 00010000:00010000:0.0:1787338709.701448:0:7647:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c19f7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338709.703163:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338709.703251:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192104960 00000100:00100000:2.0:1787338709.703259:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192104960 00010000:00010000:2.0:1787338709.703296:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c19aa lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab77e expref: 14 pid: 5841 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338709.703336:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 45 00000100:00100000:2.0:1787338709.703346:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc282d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:83642291-0761-4205-9531-7fd25bc2d48e+14:2359:x1874160192104960:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787338709.703360:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787338709.703367:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c19aa lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab77e expref: 14 pid: 5841 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338709.703379:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c19aa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab77e expref: 14 pid: 5841 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338709.703421:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c19aa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab77e expref: 14 pid: 5841 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338709.703438:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff90bbd38d6500) 00010000:00010000:2.0:1787338709.703443:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c19f7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338709.703451:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c19f7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338709.703458:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c19f7 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338709.703487:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787338709.703548:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc282d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:83642291-0761-4205-9531-7fd25bc2d48e+13:2359:x1874160192104960:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 195us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338709.703556:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 45 00010000:00010000:0.0:1787338709.703774:0:7647:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c19f7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338709.703789:0:7647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c19f7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787338709.704003:0:7647:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:0.0:1787338709.704137:0:7647:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:0.0:1787338709.704180:0:7647:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:0.0:1787338709.704258:0:7647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc01ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7647:1874160212050304:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787338709.704317:0:7647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338709.704346:0:7647:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbf42dd3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787338709.704600:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212050304 00000100:00100000:2.0:1787338709.704605:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212050304 00000100:00100000:2.0:1787338709.704639:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787338709.704647:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc01d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7647:x1874160212050304:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787338709.704711:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc01d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7647:x1874160212050304:12345-0@lo:1000:mdt00_003.0 Request processed in 65us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338709.704730:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787338709.705675:0:7647:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:0.0:1787338709.705682:0:7647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90bbf7eaea00, transno 4294967303 00000100:00100000:0.0:1787338709.705703:0:7647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc01ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7647:1874160212050304:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1787338709.706165:0:7647:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:0.0:1787338709.706225:0:7647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc01ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7647:1874160212050432:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787338709.706270:0:7647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338709.706415:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212050432 00000100:00100000:1.0:1787338709.706419:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212050432 00000100:00100000:1.0:1787338709.706451:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787338709.706459:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc01e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7647:x1874160212050432:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787338709.712675:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc01e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7647:x1874160212050432:12345-0@lo:1000:mdt00_003.0 Request processed in 6207us (6394us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1787338709.712690:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787338709.714422:0:7647:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbf41c1e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787338709.714465:0:7647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc01ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7647:1874160212050432:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1787338709.714508:0:7647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c19f7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338709.714519:0:7647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c19f7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338709.714528:0:7647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c19f7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338709.714534:0:7647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbc0030400 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:0.0:1787338709.715340:0:7647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c19f7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338709.715368:0:7647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c19f7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338709.715384:0:7647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff90bbd38d6500) 00010000:00010000:0.0:1787338709.715388:0:7647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787338709.715392:0:7647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c19f7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338709.715399:0:7647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c19f7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338709.715441:0:7647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4800/0x83671231080c1925 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338709.715448:0:7647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4800/0x83671231080c1925 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338709.715453:0:7647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4800/0x83671231080c1925 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338709.715458:0:7647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea4800 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:0.0:1787338709.715461:0:7647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4800/0x83671231080c1925 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338709.715468:0:7647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4800/0x83671231080c1925 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338709.715482:0:7647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90bbd38d6800) 00010000:00010000:0.0:1787338709.715484:0:7647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787338709.715487:0:7647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4800/0x83671231080c1925 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338709.715503:0:7647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4800/0x83671231080c1925 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338709.715530:0:7647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031400/0x83671231080c19fe lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338709.715618:0:7647:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9cc00/0x83671231080c1941 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab762 expref: 16 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338709.715628:0:7647:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031400/0x83671231080c19fe lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338709.715663:0:7647:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9cc00/0x83671231080c1941 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab762 expref: 16 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338709.715678:0:7647:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9cc00/0x83671231080c1941 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab762 expref: 16 pid: 7647 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338709.715693:0:7647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc01c700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7647:1874160212050560:192.168.201.53@tcp:104: 00000100:00100000:0.0:1787338709.715788:0:7647:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbf41c1e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787338709.718703:0:7647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc01c700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7647:1874160212050560:192.168.201.53@tcp:104: 00010000:00010000:0.0:1787338709.718741:0:7647:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031400/0x83671231080c19fe lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338709.719121:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338709.719197:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192105088 00000100:00100000:1.0:1787338709.719206:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192105088 00010000:00010000:1.0:1787338709.719240:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9cc00/0x83671231080c1941 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab762 expref: 17 pid: 7647 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338709.719281:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 46 00000100:00100000:1.0:1787338709.719290:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc283480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:83642291-0761-4205-9531-7fd25bc2d48e+17:2358:x1874160192105088:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787338709.719303:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787338709.719310:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9cc00/0x83671231080c1941 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab762 expref: 17 pid: 7647 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338709.719322:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9cc00/0x83671231080c1941 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab762 expref: 17 pid: 7647 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338709.719342:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9cc00/0x83671231080c1941 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab762 expref: 17 pid: 7647 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338709.719357:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90bbd38d6800) 00010000:00010000:1.0:1787338709.719362:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031400/0x83671231080c19fe lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338709.719383:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031400/0x83671231080c19fe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338709.719390:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031400/0x83671231080c19fe lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338709.719418:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787338709.719462:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc283480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:83642291-0761-4205-9531-7fd25bc2d48e+16:2358:x1874160192105088:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 172us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338709.719469:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 46 00010000:00010000:0.0:1787338709.719484:0:7647:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031400/0x83671231080c19fe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338709.719490:0:7647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031400/0x83671231080c19fe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338709.719508:0:7647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031400/0x83671231080c19fe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338709.719515:0:7647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031400/0x83671231080c19fe lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338709.719521:0:7647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031400/0x83671231080c19fe lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338709.719526:0:7647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbc0031400 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:0.0:1787338709.719530:0:7647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031400/0x83671231080c19fe lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338709.719537:0:7647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031400/0x83671231080c19fe lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338709.719546:0:7647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90bbd38d6800) 00010000:00010000:0.0:1787338709.719549:0:7647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787338709.719552:0:7647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031400/0x83671231080c19fe lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338709.719558:0:7647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031400/0x83671231080c19fe lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338709.719568:0:7647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c19f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338709.719574:0:7647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c19f0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338709.719580:0:7647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c19f0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338709.719591:0:7647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbc0030a00 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:0.0:1787338709.719594:0:7647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c19f0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338709.719599:0:7647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c19f0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338709.719607:0:7647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90bbd38d6800) 00010000:00010000:0.0:1787338709.719610:0:7647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787338709.719613:0:7647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c19f0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338709.719618:0:7647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c19f0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338709.719838:0:7647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc283800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+15:10443:x1874160192104832:12345-192.168.201.53@tcp:57:lhsmtool_posix.0 Request processed in 22763us (22925us total) trans 4294967360 rc 0/0 00000100:00100000:0.0:1787338709.719846:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 83 00000020:00080000:0.0:1787338709.719850:0:7647:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1787338709.719975:0:11692:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787338709.719981:0:11692:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787338709.720023:0:11692:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1787338709.720033:0:11692:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787338709.723769:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338709.723919:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192105344 00000100:00100000:0.0:1787338709.723929:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192105344 00000100:00100000:0.0:1787338709.723982:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 20 00000100:00100000:0.0:1787338709.723992:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc283100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:83642291-0761-4205-9531-7fd25bc2d48e+15:10443:x1874160192105344:12345-192.168.201.53@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1787338709.724566:0:5842:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787338709.724672:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:0.0:1787338709.724726:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c1a05 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338709.724742:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c1a05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338709.724760:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c1a05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338709.724768:0:5842:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c1a05 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338709.724774:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c1a05 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338709.724779:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c1a05 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338709.726370:0:5842:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787338709.726382:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787338709.726389:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c1a05 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338709.726397:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbc0030400 already unused, calling callback (ffffffffc1546230) 00010000:00010000:1.0:1787338709.726401:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c1a05 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338709.726408:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c1a05 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338709.726420:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff90bbeb14d300) 00010000:00010000:1.0:1787338709.726423:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787338709.726427:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c1a05 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338709.726432:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c1a05 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338709.726449:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338709.726459:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338709.726461:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787338709.726471:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc283100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:83642291-0761-4205-9531-7fd25bc2d48e+17:10443:x1874160192105344:12345-192.168.201.53@tcp:35:lhsmtool_posix.0 Request processed in 2477us (2707us total) trans 4294967362 rc 0/0 00000100:00100000:0.0:1787338709.726480:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 20 00000020:00080000:0.0:1787338709.726485:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787338709.834451:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338709.834634:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192105472 00000100:00100000:2.0:1787338709.834644:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192105472 00000100:00100000:2.0:1787338709.834702:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 289 00000100:00100000:2.0:1787338709.834723:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4089c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+13:2358:x1874160192105472:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:2.0:1787338709.834795:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4089c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+13:2358:x1874160192105472:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 84us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338709.834803:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 289 00000100:00100000:3.0:1787338709.841312:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338709.841439:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192105600 00000100:00100000:2.0:1787338709.841449:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192105600 00000100:00100000:2.0:1787338709.841525:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 62 00000100:00100000:2.0:1787338709.841536:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc280700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:83642291-0761-4205-9531-7fd25bc2d48e+5:2359:x1874160192105600:12345-192.168.201.53@tcp:400:kworker.0 00000100:00080000:0.0:1787338709.841561:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787338709.841617:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc280700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:83642291-0761-4205-9531-7fd25bc2d48e+5:2359:x1874160192105600:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 82us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338709.841625:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 62 00000100:00100000:3.0:1787338709.873815:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338709.873951:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192105728 00000100:00100000:1.0:1787338709.873961:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192105728 00000100:00100000:1.0:1787338709.874048:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 139 00000100:00100000:1.0:1787338709.874059:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc281500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e810cb1b-6993-4b6e-89c4-e8961cf35b35+5:2358:x1874160192105728:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:1.0:1787338709.874371:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc281500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e810cb1b-6993-4b6e-89c4-e8961cf35b35+5:2358:x1874160192105728:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 312us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338709.874379:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 139 00000100:00080000:0.0:1787338709.874943:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787338710.134833:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbff8fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874160212050688:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787338710.134927:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338710.137728:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212050688 00000100:00100000:2.0:1787338710.137742:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212050688 00000100:00100000:2.0:1787338710.137849:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787338710.137862:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc01c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3317:x1874160212050688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787338710.137920:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787338710.137987:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc01c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3317:x1874160212050688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 128us (3059us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338710.137994:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787338710.138284:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbff8fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874160212050688:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787338710.711849:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787338711.301539:0:12063:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787338711.301548:0:12063:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787338711.301587:0:12063:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1787338711.301593:0:12063:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787338711.477945:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338711.478127:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192105984 00000100:00100000:2.0:1787338711.478135:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192105984 00000100:00100000:2.0:1787338711.478229:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 84 00000100:00100000:2.0:1787338711.478240:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc282680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+17:10462:x1874160192105984:12345-192.168.201.53@tcp:101:lfs.0 00010000:00010000:2.0:1787338711.478286:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787338711.478315:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c1a0c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab79a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338711.478569:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3600/0x83671231080c1a13 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338711.478583:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3600/0x83671231080c1a13 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338711.478595:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3600/0x83671231080c1a13 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787338711.478605:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:2.0:1787338711.478801:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c1a0c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab79a expref: 20 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338711.478819:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3600/0x83671231080c1a13 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab79a expref: 19 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338711.478829:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff90bbdee56e00) 00010000:00010000:2.0:1787338711.478832:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787338711.478835:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf40e3600, rc 0) 00000100:00100000:2.0:1787338711.478909:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc282680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+19:10462:x1874160192105984:12345-192.168.201.53@tcp:101:lfs.0 Request processed in 670us (973us total) trans 4294967363 rc 0/0 00000100:00100000:2.0:1787338711.478916:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 84 00000100:00080000:0.0:1787338711.479134:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787338711.490536:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338711.490670:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192106112 00000100:00100000:2.0:1787338711.490678:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192106112 00000100:00100000:2.0:1787338711.490744:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 85 00000100:00100000:2.0:1787338711.490761:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc01f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+19:10462:x1874160192106112:12345-192.168.201.53@tcp:34:lfs.0 00010000:00010000:2.0:1787338711.490833:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c1a21 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338711.490848:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c1a21 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338711.490859:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c1a21 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338711.490895:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c1a28 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338711.490904:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c1a28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338711.490910:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c1a28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338711.491208:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c1a2f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338711.491218:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c1a2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338711.491226:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c1a2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787338711.491486:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c1a2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338711.491499:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c1a21 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338711.491512:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c1a21 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338711.491519:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c1a21 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338711.491525:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e2600 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:2.0:1787338711.491529:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c1a21 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338711.491537:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c1a21 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338711.491549:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff90bbdee56e00) 00010000:00010000:2.0:1787338711.491552:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787338711.491557:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c1a21 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338711.491564:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c1a21 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338711.491577:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c1a28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338711.491583:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c1a28 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338711.491589:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c1a28 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338711.491594:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e2a00 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:2.0:1787338711.491603:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c1a28 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338711.491610:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c1a28 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338711.491618:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff90bbdee56f00) 00010000:00010000:2.0:1787338711.491621:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787338711.491624:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c1a28 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338711.491629:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c1a28 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338711.491642:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c1a2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338711.491648:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c1a2f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338711.491653:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c1a2f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338711.491659:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e3200 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:2.0:1787338711.491662:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c1a2f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338711.491668:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c1a2f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338711.491675:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90bbdee56b00) 00010000:00010000:2.0:1787338711.491677:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787338711.491698:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c1a2f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338711.491705:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c1a2f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338711.491783:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc01f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+19:10462:x1874160192106112:12345-192.168.201.53@tcp:34:lfs.0 Request processed in 1022us (1256us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338711.491791:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 85 00000100:00100000:0.0:1787338711.602438:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338711.602507:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192106368 00000100:00100000:3.0:1787338711.602516:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192106368 00000100:00100000:3.0:1787338711.602573:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 86 00000100:00100000:3.0:1787338711.602596:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc01e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+19:10465:x1874160192106368:12345-192.168.201.53@tcp:101:lfs.0 00010000:00010000:3.0:1787338711.602616:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787338711.602636:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4000/0x83671231080c1a36 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab7a1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338711.602710:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c1a3d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338711.602732:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c1a3d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338711.602744:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c1a3d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338711.602757:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c1a44 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338711.602764:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c1a44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338711.602771:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c1a44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338711.603220:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4200/0x83671231080c1a4b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338711.603230:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4200/0x83671231080c1a4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338711.603238:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4200/0x83671231080c1a4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787338711.603311:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1787338711.603401:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c1a3d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338711.603408:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c1a3d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338711.603413:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c1a3d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338711.603418:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea5400 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:3.0:1787338711.603422:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c1a3d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338711.603428:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c1a3d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338711.603440:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff90bbdee56e00) 00010000:00010000:3.0:1787338711.603443:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787338711.603448:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c1a3d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338711.603454:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c1a3d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338711.603465:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c1a44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338711.603470:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c1a44 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338711.603485:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c1a44 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338711.603491:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea5a00 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:3.0:1787338711.603493:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c1a44 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338711.603499:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c1a44 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338711.603507:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff90bbd38d6000) 00010000:00010000:3.0:1787338711.603509:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787338711.603512:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c1a44 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338711.603518:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c1a44 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338711.603556:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4000/0x83671231080c1a36 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab7a1 expref: 22 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338711.603570:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4200/0x83671231080c1a4b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab7a1 expref: 21 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338711.603577:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90bbd38d6900) 00010000:00010000:3.0:1787338711.603579:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787338711.603581:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf7ea4200, rc 0) 00000100:00100000:3.0:1787338711.603640:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc01e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+21:10465:x1874160192106368:12345-192.168.201.53@tcp:101:lfs.0 Request processed in 1046us (1209us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1787338711.603656:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 86 00000100:00100000:0.0:1787338711.619445:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338711.619531:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192106496 00000100:00100000:2.0:1787338711.619542:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192106496 00000100:00100000:2.0:1787338711.619596:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 87 00000100:00100000:2.0:1787338711.619606:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc01ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+21:10465:x1874160192106496:12345-192.168.201.53@tcp:54:lfs.0 00010000:00010000:2.0:1787338711.619669:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c1a59 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338711.619696:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c1a59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338711.619709:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c1a59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338711.620429:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c1a59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338711.620439:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c1a59 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338711.620447:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c1a59 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338711.620454:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e3200 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:2.0:1787338711.620467:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c1a59 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338711.620475:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c1a59 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338711.620488:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90bbd38d6900) 00010000:00010000:2.0:1787338711.620492:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787338711.620496:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c1a59 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338711.620503:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c1a59 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338711.620580:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc01ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+21:10465:x1874160192106496:12345-192.168.201.53@tcp:54:lfs.0 Request processed in 974us (1144us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338711.620588:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 87 00000100:00100000:0.0:1787338711.624691:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338711.625259:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192106752 00000100:00100000:1.0:1787338711.625269:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192106752 00000100:00100000:1.0:1787338711.625323:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 21 00000100:00100000:1.0:1787338711.625335:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbd894e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:83642291-0761-4205-9531-7fd25bc2d48e+21:10465:x1874160192106752:12345-192.168.201.53@tcp:35:lfs.0 00000100:00100000:1.0:1787338711.625553:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbd894e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:83642291-0761-4205-9531-7fd25bc2d48e+22:10465:x1874160192106752:12345-192.168.201.53@tcp:35:lfs.0 Request processed in 220us (879us total) trans 4294967365 rc 0/0 00000100:00100000:1.0:1787338711.625561:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 21 00000100:00100000:1.0:1787338711.687670:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338711.687755:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192107008 00000100:00100000:3.0:1787338711.687764:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192107008 00000100:00100000:3.0:1787338711.687824:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 88 00000100:00100000:3.0:1787338711.687836:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbef19f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+22:9984:x1874160192107008:12345-192.168.201.53@tcp:101:bash.0 00010000:00010000:3.0:1787338711.687860:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787338711.687908:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4000/0x83671231080c1a60 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab7a8 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338711.688004:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c1a67 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338711.688019:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4200/0x83671231080c1a4b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab7a1 expref: 23 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338711.688028:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c1a67 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338711.688063:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4200/0x83671231080c1a4b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab7a1 expref: 23 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338711.688078:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4200/0x83671231080c1a4b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab7a1 expref: 23 pid: 5840 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338711.688091:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc280e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5840:1874160212050816:192.168.201.53@tcp:104: 00000100:00100000:3.0:1787338711.688482:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbedc57b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787338711.692167:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc280e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5840:1874160212050816:192.168.201.53@tcp:104: 00010000:00010000:0.0:1787338711.692198:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c1a67 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338711.692990:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338711.693061:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192107136 00000100:00100000:3.0:1787338711.693080:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192107136 00010000:00010000:3.0:1787338711.693168:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4200/0x83671231080c1a4b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab7a1 expref: 24 pid: 5840 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338711.693206:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 47 00000100:00100000:3.0:1787338711.693216:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbedcb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:83642291-0761-4205-9531-7fd25bc2d48e+24:2359:x1874160192107136:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787338711.693230:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787338711.693237:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4200/0x83671231080c1a4b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab7a1 expref: 24 pid: 5840 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338711.693249:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4200/0x83671231080c1a4b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab7a1 expref: 24 pid: 5840 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338711.693271:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4200/0x83671231080c1a4b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab7a1 expref: 24 pid: 5840 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338711.693286:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90bbd38d6900) 00010000:00010000:3.0:1787338711.693292:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c1a67 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338711.693300:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c1a67 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338711.693308:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c1a67 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338711.693326:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787338711.693372:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbedcb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:83642291-0761-4205-9531-7fd25bc2d48e+23:2359:x1874160192107136:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 156us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338711.693389:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 47 00010000:00010000:0.0:1787338711.693467:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c1a67 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338711.693523:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c1a67 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787338711.693551:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:0.0:1787338711.693675:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4000/0x83671231080c1a60 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab7a8 expref: 24 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338711.693701:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c1a67 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab7a8 expref: 23 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338711.693709:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90bbd38d6900) 00010000:00010000:0.0:1787338711.693711:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787338711.693713:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf7ea5a00, rc 0) 00000100:00100000:0.0:1787338711.693749:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbef19f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+23:9984:x1874160192107008:12345-192.168.201.53@tcp:101:bash.0 Request processed in 5916us (6087us total) trans 4294967366 rc 0/0 00000100:00100000:0.0:1787338711.693756:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 88 00000100:00100000:0.0:1787338711.698623:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338711.698698:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192107392 00000100:00100000:2.0:1787338711.698707:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192107392 00000100:00100000:2.0:1787338711.698767:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 89 00000100:00100000:2.0:1787338711.698777:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc01d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+23:9984:x1874160192107392:12345-192.168.201.53@tcp:36:bash.0 00010000:00010000:2.0:1787338711.699026:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c1a75 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338711.699042:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c1a75 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338711.699054:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c1a75 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787338711.699104:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:2.0:1787338711.699391:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e25c6df6 reply state 00000000ddcd695d transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c1a75 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338711.699400:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1787338711.699447:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:2.0:1787338711.699545:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc01d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+27:9984:x1874160192107392:12345-192.168.201.53@tcp:36:bash.0 Request processed in 768us (929us total) trans 4294967369 rc 0/0 00000100:00100000:2.0:1787338711.699552:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 89 00000020:00080000:2.0:1787338711.699557:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1787338711.701690:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338711.701845:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192107520 00000100:00100000:0.0:1787338711.701854:0:7647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192107520 00000100:00100000:0.0:1787338711.701929:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 90 00000100:00100000:0.0:1787338711.701939:0:7647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbff8fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+27:9984:x1874160192107520:12345-192.168.201.53@tcp:101:bash.0 00010000:00010000:0.0:1787338711.701971:0:7647:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787338711.701988:0:7647:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c1a7c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab7af expref: -99 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338711.702037:0:7647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c1a7c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab7af expref: 28 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338711.702051:0:7647:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c1a7c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab7af expref: 28 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338711.702077:0:7647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90bbd38d6900) 00010000:00010000:0.0:1787338711.702080:0:7647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787338711.702084:0:7647:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbc0030800, rc 0) 00000100:00100000:0.0:1787338711.702130:0:7647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbff8fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+28:9984:x1874160192107520:12345-192.168.201.53@tcp:101:bash.0 Request processed in 193us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338711.702137:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 90 00010000:00010000:3.0:1787338711.702785:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c1a75 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338711.702796:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c1a75 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338711.702802:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c1a75 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338711.702807:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e3200 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:3.0:1787338711.702812:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c1a75 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338711.702819:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c1a75 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338711.702833:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90bbd38d6900) 00010000:00010000:3.0:1787338711.702835:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787338711.702839:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c1a75 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338711.702845:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c1a75 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338711.704773:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338711.704836:0:10743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192107648 00000100:00100000:3.0:1787338711.704844:0:10743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192107648 00000100:00100000:3.0:1787338711.704917:0:10743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 33 00000100:00100000:3.0:1787338711.704927:0:10743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc01ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:83642291-0761-4205-9531-7fd25bc2d48e+6:9984:x1874160192107648:12345-192.168.201.53@tcp:101:bash.0 00010000:00010000:3.0:1787338711.704943:0:10743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787338711.704971:0:10743:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000884f449/0x83671231080c1a83 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab7b6 expref: -99 pid: 10743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787338711.704994:0:10743:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a889fd3, atime: 0x6a889fd2, ctime: 0x6a889fd3, blocks: 0xb 00010000:00010000:3.0:1787338711.705011:0:10743:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=364s v=(0 0) 00010000:00010000:3.0:1787338711.705016:0:10743:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787338711.705024:0:10743:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000884f449/0x83671231080c1a83 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab7b6 expref: 7 pid: 10743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338711.705039:0:10743:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000884f449/0x83671231080c1a83 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab7b6 expref: 7 pid: 10743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338711.705051:0:10743:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf7ea4200, rc 0) 00000100:00100000:3.0:1787338711.705108:0:10743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc01ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:83642291-0761-4205-9531-7fd25bc2d48e+7:9984:x1874160192107648:12345-192.168.201.53@tcp:101:bash.0 Request processed in 182us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338711.705115:0:10743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 33 00000100:00080000:0.0:1787338711.705270:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787338711.709092:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338711.709133:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192107776 00000100:00100000:0.0:1787338711.709141:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192107776 00002000:00010000:0.0:1787338711.709176:0:6694:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:0.0:1787338711.709181:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90bbfc01c000 with x1874160192107776 ext(0->18446744073709551615) 00002000:00010000:0.0:1787338711.709192:0:6694:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90bbfc01c000. 00000100:00100000:0.0:1787338711.709217:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 1 00000100:00100000:0.0:1787338711.709227:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc01c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:83642291-0761-4205-9531-7fd25bc2d48e+7:2357:x1874160192107776:12345-192.168.201.53@tcp:10:bash.0 00002000:00010000:0.0:1787338711.709460:0:6694:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1787338711.709474:0:6694:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1787338707 -> 1787338711 00002000:00010000:0.0:1787338711.709477:0:6694:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1787338706 -> 1787338706 00002000:00010000:0.0:1787338711.709479:0:6694:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1787338707 -> 1787338711 00002000:00010000:0.0:1787338711.709481:0:6694:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1787338711.709532:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc01c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:83642291-0761-4205-9531-7fd25bc2d48e+8:2357:x1874160192107776:12345-192.168.201.53@tcp:10:bash.0 Request processed in 305us (458us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1787338711.709539:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 1 00002000:00010000:0.0:1787338711.709543:0:6694:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:0.0:1787338711.709546:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90bbfc01c000 with x1874160192107776 ext(0->18446744073709551615) 00002000:00010000:0.0:1787338711.709551:0:6694:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90bbfc01c000. 00010000:00010000:2.0:1787338711.735041:0:11676:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787338711.738565:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000100:00100000:2.0:1787338711.851739:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338711.852215:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192107904 00000100:00100000:0.0:1787338711.852227:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192107904 00000100:00100000:0.0:1787338711.852300:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 91 00000100:00100000:0.0:1787338711.852311:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbff8fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+27:10479:x1874160192107904:12345-192.168.201.53@tcp:34:lfs.0 00010000:00010000:0.0:1787338711.852383:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c1a8a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338711.852400:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c1a8a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338711.852412:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c1a8a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338711.852427:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031a00/0x83671231080c1a91 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338711.852434:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031a00/0x83671231080c1a91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338711.852441:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031a00/0x83671231080c1a91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338711.852743:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c1a98 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338711.852753:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c1a98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338711.852761:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c1a98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787338711.852800:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c1a98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338711.852811:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c1a8a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338711.852818:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c1a8a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338711.852824:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c1a8a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338711.852830:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbc0031000 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:0.0:1787338711.852834:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c1a8a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338711.852842:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c1a8a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338711.852853:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff90bbdee56e00) 00010000:00010000:0.0:1787338711.852857:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787338711.852861:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c1a8a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338711.852911:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c1a8a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338711.852926:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031a00/0x83671231080c1a91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338711.852932:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031a00/0x83671231080c1a91 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338711.852938:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031a00/0x83671231080c1a91 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338711.852943:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbc0031a00 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:0.0:1787338711.852946:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031a00/0x83671231080c1a91 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338711.852952:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031a00/0x83671231080c1a91 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338711.852960:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff90bbeb14d500) 00010000:00010000:0.0:1787338711.852963:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787338711.852966:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031a00/0x83671231080c1a91 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338711.852972:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031a00/0x83671231080c1a91 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338711.852986:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c1a98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338711.852992:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c1a98 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338711.853004:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c1a98 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338711.853009:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbc0030400 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:0.0:1787338711.853012:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c1a98 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338711.853018:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c1a98 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338711.853025:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90bbd38d6900) 00010000:00010000:0.0:1787338711.853028:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787338711.853031:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c1a98 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338711.853036:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c1a98 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338711.853132:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbff8fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+27:10479:x1874160192107904:12345-192.168.201.53@tcp:34:lfs.0 Request processed in 821us (1406us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338711.853140:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 91 00000100:00100000:0.0:1787338711.923480:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338711.923590:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192108160 00000100:00100000:1.0:1787338711.923600:0:7647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192108160 00000100:00100000:1.0:1787338711.923664:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 92 00000100:00100000:1.0:1787338711.923684:0:7647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc01f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+27:10482:x1874160192108160:12345-192.168.201.53@tcp:101:lfs.0 00010000:00010000:1.0:1787338711.923704:0:7647:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787338711.923725:0:7647:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9da00/0x83671231080c1a9f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab7bd expref: -99 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338711.923801:0:7647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c600/0x83671231080c1aa6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338711.923827:0:7647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c600/0x83671231080c1aa6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338711.923839:0:7647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c600/0x83671231080c1aa6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338711.923854:0:7647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c200/0x83671231080c1aad lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338711.923862:0:7647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c200/0x83671231080c1aad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338711.923869:0:7647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c200/0x83671231080c1aad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338711.924516:0:7647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9dc00/0x83671231080c1ab4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338711.924527:0:7647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9dc00/0x83671231080c1ab4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338711.924536:0:7647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9dc00/0x83671231080c1ab4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787338711.924545:0:7647:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1787338711.924633:0:7647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c600/0x83671231080c1aa6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338711.924641:0:7647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c600/0x83671231080c1aa6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338711.924648:0:7647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c600/0x83671231080c1aa6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338711.924661:0:7647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbfbe9c600 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:1.0:1787338711.924666:0:7647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c600/0x83671231080c1aa6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338711.924673:0:7647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c600/0x83671231080c1aa6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338711.924697:0:7647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff90bbdee56e00) 00010000:00010000:1.0:1787338711.924700:0:7647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787338711.924706:0:7647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c600/0x83671231080c1aa6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338711.924711:0:7647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c600/0x83671231080c1aa6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338711.924726:0:7647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c200/0x83671231080c1aad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338711.924732:0:7647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c200/0x83671231080c1aad lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338711.924738:0:7647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c200/0x83671231080c1aad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338711.924743:0:7647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbfbe9c200 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:1.0:1787338711.924746:0:7647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c200/0x83671231080c1aad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338711.924753:0:7647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c200/0x83671231080c1aad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338711.924771:0:7647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff90bbc2a93800) 00010000:00010000:1.0:1787338711.924774:0:7647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787338711.924777:0:7647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c200/0x83671231080c1aad lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338711.924782:0:7647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c200/0x83671231080c1aad lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338711.924830:0:7647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9da00/0x83671231080c1a9f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab7bd expref: 30 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338711.924843:0:7647:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9dc00/0x83671231080c1ab4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab7bd expref: 29 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338711.924851:0:7647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90bbd38d6900) 00010000:00010000:1.0:1787338711.924853:0:7647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787338711.924856:0:7647:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbfbe9dc00, rc 0) 00000100:00100000:1.0:1787338711.925118:0:7647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc01f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+29:10482:x1874160192108160:12345-192.168.201.53@tcp:101:lfs.0 Request processed in 1435us (1636us total) trans 4294967370 rc 0/0 00000100:00100000:1.0:1787338711.925128:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 92 00000100:00100000:1.0:1787338711.932239:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338711.932437:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192108288 00000100:00100000:0.0:1787338711.932447:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192108288 00000100:00100000:0.0:1787338711.932510:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 93 00000100:00100000:0.0:1787338711.932521:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbedcb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+29:10482:x1874160192108288:12345-192.168.201.53@tcp:54:lfs.0 00010000:00010000:0.0:1787338711.932599:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c1ac2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338711.932634:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c1a67 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab7a8 expref: 29 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338711.932643:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c1ac2 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338711.932690:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c1a67 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab7a8 expref: 29 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338711.932704:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c1a67 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab7a8 expref: 29 pid: 5840 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338711.932717:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc01ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5841:1874160212050944:192.168.201.53@tcp:104: 00000100:00100000:0.0:1787338711.932811:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbf43d8480 going to sleep for 11 seconds 00000100:00100000:3.0:1787338711.936446:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338711.936657:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc01ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5841:1874160212050944:192.168.201.53@tcp:104: 00010000:00010000:0.0:1787338711.936698:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c1ac2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338711.936813:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192108544 00000100:00100000:1.0:1787338711.936821:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192108544 00000100:00100000:1.0:1787338711.936902:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 22 00000100:00100000:1.0:1787338711.936913:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc280380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:83642291-0761-4205-9531-7fd25bc2d48e+30:5595:x1874160192108544:12345-192.168.201.53@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787338711.937505:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc280380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:83642291-0761-4205-9531-7fd25bc2d48e+31:5595:x1874160192108544:12345-192.168.201.53@tcp:35:ldlm_bl.0 Request processed in 592us (1066us total) trans 4294967371 rc 0/0 00000100:00100000:1.0:1787338711.937528:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 22 00000100:00100000:1.0:1787338711.945611:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338711.945732:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192108672 00000100:00100000:3.0:1787338711.945753:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192108672 00010000:00010000:3.0:1787338711.945797:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c1a67 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab7a8 expref: 31 pid: 5840 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338711.945913:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 48 00000100:00100000:3.0:1787338711.945924:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbedcb4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:83642291-0761-4205-9531-7fd25bc2d48e+31:2358:x1874160192108672:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787338711.945939:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787338711.945946:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c1a67 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab7a8 expref: 31 pid: 5840 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338711.945974:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c1a67 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab7a8 expref: 31 pid: 5840 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338711.945996:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c1a67 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab7a8 expref: 31 pid: 5840 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338711.946013:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90bbd38d6900) 00010000:00010000:3.0:1787338711.946018:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c1ac2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338711.946027:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c1ac2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338711.946046:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c1ac2 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338711.946438:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787338711.946503:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbedcb4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:83642291-0761-4205-9531-7fd25bc2d48e+30:2358:x1874160192108672:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 579us (901us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338711.946512:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 48 00010000:00010000:0.0:1787338711.948000:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c1ac2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338711.948014:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c1ac2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338711.948332:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c1ac2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338711.948341:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c1ac2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338711.948363:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c1ac2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338711.948370:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbc0030400 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:0.0:1787338711.948374:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c1ac2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338711.948382:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c1ac2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338711.948396:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90bbd38d6900) 00010000:00010000:0.0:1787338711.948400:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787338711.948403:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c1ac2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338711.948410:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c1ac2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338711.948537:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbedcb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+29:10482:x1874160192108288:12345-192.168.201.53@tcp:54:lfs.0 Request processed in 16014us (16315us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338711.948546:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 93 00000100:00100000:1.0:1787338711.951642:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338711.951752:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192108928 00000100:00100000:3.0:1787338711.951764:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192108928 00000100:00100000:3.0:1787338711.951862:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 23 00000100:00100000:3.0:1787338711.951913:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:83642291-0761-4205-9531-7fd25bc2d48e+29:10482:x1874160192108928:12345-192.168.201.53@tcp:35:lfs.0 00000100:00100000:3.0:1787338711.952171:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:83642291-0761-4205-9531-7fd25bc2d48e+30:10482:x1874160192108928:12345-192.168.201.53@tcp:35:lfs.0 Request processed in 298us (538us total) trans 4294967372 rc 0/0 00000100:00100000:3.0:1787338711.952179:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 23 00000100:00100000:1.0:1787338712.110838:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338712.110969:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192109184 00000100:00100000:2.0:1787338712.110979:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192109184 00000100:00100000:2.0:1787338712.111051:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 94 00000100:00100000:2.0:1787338712.111063:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbef179c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+30:10493:x1874160192109184:12345-192.168.201.53@tcp:101:cat.0 00010000:00010000:2.0:1787338712.111087:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787338712.111107:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c1ac9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab7c4 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338712.111193:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c1ad0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338712.111208:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c1ad0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338712.111219:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c1ad0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338712.111233:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c1ad7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338712.111253:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c1ad7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338712.111260:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c1ad7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338712.114687:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c1ade lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338712.114708:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c1ade lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338712.114722:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c1ade lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787338712.114738:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:2.0:1787338712.114847:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c1ad0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338712.114856:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c1ad0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338712.114864:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c1ad0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338712.114870:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e3200 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:2.0:1787338712.114908:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c1ad0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338712.114916:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c1ad0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338712.114944:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff90bbdee56e00) 00010000:00010000:2.0:1787338712.114947:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787338712.114952:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c1ad0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338712.114958:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c1ad0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338712.114973:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c1ad7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338712.114979:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c1ad7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338712.114984:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c1ad7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338712.114989:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e2a00 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:2.0:1787338712.114992:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c1ad7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338712.114997:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c1ad7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338712.115004:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff90bbdee56f00) 00010000:00010000:2.0:1787338712.115006:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787338712.115009:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c1ad7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338712.115013:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c1ad7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338712.119559:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c1ac9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab7c4 expref: 33 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338712.119582:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c1ade lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab7c4 expref: 32 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338712.119591:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90bbd38d6900) 00010000:00010000:2.0:1787338712.119594:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787338712.119597:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf40e2c00, rc 0) 00000100:00100000:2.0:1787338712.119668:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbef179c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+32:10493:x1874160192109184:12345-192.168.201.53@tcp:101:cat.0 Request processed in 8607us (8839us total) trans 4294967373 rc 0/0 00000100:00100000:2.0:1787338712.119685:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 94 00000100:00100000:1.0:1787338712.138080:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338712.138411:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192109440 00000100:00100000:2.0:1787338712.138422:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192109440 00000100:00100000:2.0:1787338712.138496:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 24 00000100:00100000:2.0:1787338712.138508:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbef178000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:83642291-0761-4205-9531-7fd25bc2d48e+32:10493:x1874160192109440:12345-192.168.201.53@tcp:35:cat.0 00000100:00100000:2.0:1787338712.138760:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbef178000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:83642291-0761-4205-9531-7fd25bc2d48e+33:10493:x1874160192109440:12345-192.168.201.53@tcp:35:cat.0 Request processed in 254us (690us total) trans 4294967374 rc 0/0 00000100:00100000:2.0:1787338712.138769:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 24 00000100:00100000:1.0:1787338712.210983:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338712.211384:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192109696 00000100:00100000:3.0:1787338712.211394:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192109696 00000100:00100000:3.0:1787338712.211467:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 95 00000100:00100000:3.0:1787338712.211478:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbef178380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+33:10494:x1874160192109696:12345-192.168.201.53@tcp:36:rm.0 00010000:00010000:3.0:1787338712.211537:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787338712.211567:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c1ade lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab7c4 expref: 33 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.211593:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9dc00/0x83671231080c1ab4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab7bd expref: 32 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.211607:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c1a7c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab7af expref: 31 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.211620:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90bbd38d6900) 00010000:00010000:3.0:1787338712.211631:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787338712.211653:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c1aec lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.211666:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c1aec lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.211688:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c1aec lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.211703:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c1af3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.211711:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c1af3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.211736:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c1af3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.212789:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c1afa lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.212801:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c1afa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.212894:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c1afa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787338712.218752:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:3.0:1787338712.218766:0:5839:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 365059891689ns, next at 366059888390ns, rc = 0 00010000:00010000:3.0:1787338712.218868:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4a00/0x83671231080c1b01 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.218912:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4a00/0x83671231080c1b01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.218924:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4a00/0x83671231080c1b01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.218932:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4a00/0x83671231080c1b01 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.218938:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4a00/0x83671231080c1b01 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.218944:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4a00/0x83671231080c1b01 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.218981:0:5839:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787338712.220153:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787338712.220163:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4a00/0x83671231080c1b01 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338712.220174:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea4a00 already unused, calling callback (ffffffffc1546230) 00010000:00010000:1.0:1787338712.220178:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4a00/0x83671231080c1b01 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338712.220187:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4a00/0x83671231080c1b01 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338712.220202:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90bbd38d6800) 00010000:00010000:1.0:1787338712.220205:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787338712.220210:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4a00/0x83671231080c1b01 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338712.220217:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4a00/0x83671231080c1b01 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338712.220235:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338712.220237:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338712.220239:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338712.221048:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c1afa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.221058:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c1afa lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.221064:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c1afa lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.221070:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea5800 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:3.0:1787338712.221073:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c1afa lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.221080:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c1afa lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.221090:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90bbd38d6800) 00010000:00010000:3.0:1787338712.221093:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787338712.221096:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c1afa lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.221102:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c1afa lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.221653:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c1aec lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.221660:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c1aec lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.221665:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c1aec lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.221696:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea5a00 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:3.0:1787338712.221699:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c1aec lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.221705:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c1aec lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.221715:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff90bbdee56e00) 00010000:00010000:3.0:1787338712.221717:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787338712.221721:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c1aec lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.221726:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c1aec lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787338712.221737:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e14e1ae5 reply state 000000008435e222 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c1af3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338712.221747:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787338712.222353:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbef178380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+32:10494:x1874160192109696:12345-192.168.201.53@tcp:36:rm.0 Request processed in 10870us (11375us total) trans 4294967375 rc 0/0 00000100:00100000:3.0:1787338712.222745:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 95 00010000:00010000:3.0:1787338712.226474:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c1af3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.226492:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c1af3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.226499:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c1af3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.226523:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea5400 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:3.0:1787338712.226528:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c1af3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.226535:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c1af3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.226551:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff90bbd38d6b00) 00010000:00010000:3.0:1787338712.226554:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787338712.226559:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c1af3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.226565:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c1af3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338712.347954:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338712.348552:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192109952 00000100:00100000:0.0:1787338712.348563:0:7647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192109952 00000100:00100000:0.0:1787338712.348627:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 96 00000100:00100000:0.0:1787338712.348639:0:7647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbef178a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+31:10500:x1874160192109952:12345-192.168.201.53@tcp:101:bash.0 00010000:00010000:0.0:1787338712.348665:0:7647:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787338712.348698:0:7647:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c1b08 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab7cb expref: -99 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338712.348861:0:7647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c1b0f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338712.348900:0:7647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c1b0f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338712.348913:0:7647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c1b0f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338712.348929:0:7647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031400/0x83671231080c1b16 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338712.348937:0:7647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031400/0x83671231080c1b16 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338712.348944:0:7647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031400/0x83671231080c1b16 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787338712.349517:0:7647:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:0.0:1787338712.349690:0:7647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031800/0x83671231080c1b1d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338712.349699:0:7647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031800/0x83671231080c1b1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338712.349707:0:7647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031800/0x83671231080c1b1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338712.349742:0:7647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c1b0f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338712.349760:0:7647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c1b0f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338712.349767:0:7647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c1b0f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338712.349773:0:7647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbc0030a00 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:0.0:1787338712.349778:0:7647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c1b0f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338712.349785:0:7647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c1b0f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338712.349799:0:7647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff90bbdee56e00) 00010000:00010000:0.0:1787338712.349802:0:7647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787338712.349806:0:7647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c1b0f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338712.349812:0:7647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c1b0f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787338712.349826:0:7647:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000046a85e9e reply state 000000002cc29d34 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031400/0x83671231080c1b16 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338712.349834:0:7647:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787338712.349863:0:7647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c1b08 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab7cb expref: 34 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338712.349936:0:7647:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031800/0x83671231080c1b1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab7cb expref: 33 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338712.349955:0:7647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90bbeb14d900) 00010000:00010000:0.0:1787338712.349958:0:7647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787338712.349960:0:7647:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbc0031800, rc 0) 00000100:00100000:0.0:1787338712.350038:0:7647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbef178a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+34:10500:x1874160192109952:12345-192.168.201.53@tcp:101:bash.0 Request processed in 1400us (2094us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1787338712.350046:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 96 00010000:00010000:3.0:1787338712.362006:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031400/0x83671231080c1b16 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.362026:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031400/0x83671231080c1b16 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.362034:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031400/0x83671231080c1b16 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.362041:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbc0031400 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:3.0:1787338712.362046:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031400/0x83671231080c1b16 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.362054:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031400/0x83671231080c1b16 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.362101:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff90bbeb14d500) 00010000:00010000:3.0:1787338712.362104:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787338712.362110:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031400/0x83671231080c1b16 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.362116:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031400/0x83671231080c1b16 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338712.362314:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338712.363097:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192110080 00000100:00100000:3.0:1787338712.363108:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192110080 00000100:00100000:3.0:1787338712.363214:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 34 00000100:00100000:3.0:1787338712.363225:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbef17bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:83642291-0761-4205-9531-7fd25bc2d48e+5:2359:x1874160192110080:12345-192.168.201.53@tcp:101:bash.0 00010000:00010000:3.0:1787338712.363252:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787338712.363282:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000099903cb8/0x83671231080c1b2b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab7d2 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787338712.363309:0:6691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787338712.363329:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=365s v=(0 0) 00010000:00010000:3.0:1787338712.363334:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787338712.363343:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000099903cb8/0x83671231080c1b2b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab7d2 expref: 6 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.363362:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000099903cb8/0x83671231080c1b2b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab7d2 expref: 6 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.363376:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf7ea5400, rc 0) 00000100:00100000:3.0:1787338712.363434:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbef17bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:83642291-0761-4205-9531-7fd25bc2d48e+6:2359:x1874160192110080:12345-192.168.201.53@tcp:101:bash.0 Request processed in 211us (1125us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338712.363450:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 34 00000100:00080000:0.0:1787338712.363995:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787338712.367625:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338712.368004:0:10743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192110208 00000100:00100000:3.0:1787338712.368015:0:10743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192110208 00000100:00100000:3.0:1787338712.368066:0:10743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 35 00000100:00100000:3.0:1787338712.368077:0:10743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc122d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:83642291-0761-4205-9531-7fd25bc2d48e+6:10500:x1874160192110208:12345-192.168.201.53@tcp:101:bash.0 00010000:00010000:3.0:1787338712.368095:0:10743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787338712.368114:0:10743:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002f3186d5/0x83671231080c1b32 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab7d9 expref: -99 pid: 10743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.368147:0:10743:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000099903cb8/0x83671231080c1b2b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab7d2 expref: 7 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.368156:0:10743:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787338712.368160:0:10743:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787338712.368165:0:10743:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f3186d5/0x83671231080c1b32 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab7d9 expref: 7 pid: 10743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.368202:0:10743:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000099903cb8/0x83671231080c1b2b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab7d2 expref: 7 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.368215:0:10743:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000099903cb8/0x83671231080c1b2b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab7d2 expref: 7 pid: 6691 timeout: 465 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338712.368228:0:10743:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc281180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10743:1874160212051072:192.168.201.53@tcp:104: 00000100:00100000:3.0:1787338712.368484:0:10743:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbedc57240 going to sleep for 11 seconds 00000100:00100000:1.0:1787338712.373557:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338712.374047:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192110336 00000100:00100000:2.0:1787338712.374057:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192110336 00010000:00010000:2.0:1787338712.374115:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000099903cb8/0x83671231080c1b2b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab7d2 expref: 8 pid: 6691 timeout: 465 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338712.374159:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 49 00000100:00100000:2.0:1787338712.374171:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbde53f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:83642291-0761-4205-9531-7fd25bc2d48e+8:2359:x1874160192110336:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787338712.374198:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787338712.374223:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000099903cb8/0x83671231080c1b2b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab7d2 expref: 8 pid: 6691 timeout: 465 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338712.374247:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000099903cb8/0x83671231080c1b2b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab7d2 expref: 8 pid: 6691 timeout: 465 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338712.374273:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787338712.374516:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787338712.374526:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002f3186d5/0x83671231080c1b32 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab7d9 expref: 8 pid: 10743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338712.374536:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f3186d5/0x83671231080c1b32 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab7d9 expref: 8 pid: 10743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338712.374574:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000002f3186d5/0x83671231080c1b32 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab7d9 expref: 8 pid: 10743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338712.374589:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbff8ff480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5824:1874160212051200:192.168.201.53@tcp:105: 00000100:00100000:2.0:1787338712.374695:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbedd6b480 going to sleep for 11 seconds 00010000:00010000:3.0:1787338712.377558:0:10743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000099903cb8/0x83671231080c1b2b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab7d2 expref: 8 pid: 6691 timeout: 465 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338712.377587:0:10743:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc281180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10743:1874160212051072:192.168.201.53@tcp:104: 00010000:00010000:3.0:1787338712.377618:0:10743:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002f3186d5/0x83671231080c1b32 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab7d9 expref: 7 pid: 10743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.377633:0:10743:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf7ea5a00, rc 0) 00000100:00100000:3.0:1787338712.378113:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbff8ff480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5824:1874160212051200:192.168.201.53@tcp:105: 00010000:00010000:3.0:1787338712.378125:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787338712.378174:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbde53f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:83642291-0761-4205-9531-7fd25bc2d48e+7:2359:x1874160192110336:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 4004us (4626us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338712.378184:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 49 00000100:00100000:2.0:1787338712.379770:0:10743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc122d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:83642291-0761-4205-9531-7fd25bc2d48e+6:10500:x1874160192110208:12345-192.168.201.53@tcp:101:bash.0 Request processed in 11689us (12148us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338712.379781:0:10743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 35 00000100:00100000:0.0:1787338712.384663:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338712.384773:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192110592 00000100:00100000:2.0:1787338712.384783:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192110592 00000100:00100000:2.0:1787338712.385035:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 25 00000100:00100000:2.0:1787338712.385069:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc01ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:83642291-0761-4205-9531-7fd25bc2d48e+33:10500:x1874160192110592:12345-192.168.201.53@tcp:35:bash.0 00000100:00100000:2.0:1787338712.385583:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc01ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:83642291-0761-4205-9531-7fd25bc2d48e+34:10500:x1874160192110592:12345-192.168.201.53@tcp:35:bash.0 Request processed in 526us (927us total) trans 4294967377 rc 0/0 00000100:00100000:2.0:1787338712.385591:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 25 00000100:00100000:1.0:1787338712.590637:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338712.590785:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192110720 00000100:00100000:0.0:1787338712.590794:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192110720 00000100:00100000:0.0:1787338712.590918:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 97 00000100:00100000:0.0:1787338712.590930:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc120a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+34:10516:x1874160192110720:12345-192.168.201.53@tcp:101:lfs.0 00010000:00010000:0.0:1787338712.590954:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787338712.590974:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c1b39 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab7e0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338712.591048:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031400/0x83671231080c1b40 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338712.591076:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031400/0x83671231080c1b40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338712.591089:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031400/0x83671231080c1b40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787338712.591222:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:0.0:1787338712.591227:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787338712.591269:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031400/0x83671231080c1b40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338712.591294:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c1b39 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab7e0 expref: 36 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338712.591313:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031400/0x83671231080c1b40 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab7e0 expref: 35 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338712.591321:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff90bbdee56e00) 00010000:00010000:0.0:1787338712.591325:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787338712.591328:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbc0031400, rc 0) 00000100:00100000:0.0:1787338712.591397:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc120a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+35:10516:x1874160192110720:12345-192.168.201.53@tcp:101:lfs.0 Request processed in 470us (768us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338712.591406:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 97 00000100:00100000:1.0:1787338712.598575:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338712.598707:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192110976 00000100:00100000:0.0:1787338712.598718:0:7647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192110976 00000100:00100000:0.0:1787338712.598776:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 98 00000100:00100000:0.0:1787338712.598784:0:7647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc120380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+35:10516:x1874160192110976:12345-192.168.201.53@tcp:101:lfs.0 00010000:00010000:0.0:1787338712.598801:0:7647:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787338712.598818:0:7647:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c1b47 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab7e7 expref: -99 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338712.599083:0:7647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c1b4e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338712.599093:0:7647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c1b4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338712.599101:0:7647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c1b4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787338712.599192:0:7647:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1787338712.599415:0:7647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c1b47 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab7e7 expref: 38 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338712.599434:0:7647:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c1b4e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab7e7 expref: 37 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338712.599443:0:7647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90bbeb14d900) 00010000:00010000:0.0:1787338712.599445:0:7647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787338712.599449:0:7647:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbc0030400, rc 0) 00000100:00100000:0.0:1787338712.599511:0:7647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc120380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+37:10516:x1874160192110976:12345-192.168.201.53@tcp:101:lfs.0 Request processed in 722us (941us total) trans 4294967378 rc 0/0 00000100:00100000:0.0:1787338712.599519:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 98 00000100:00100000:1.0:1787338712.602036:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338712.602100:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192111232 00000100:00100000:3.0:1787338712.602108:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192111232 00000100:00100000:3.0:1787338712.603360:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 99 00000100:00100000:3.0:1787338712.603369:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc121180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+37:10516:x1874160192111232:12345-192.168.201.53@tcp:101:lfs.0 00010000:00010000:3.0:1787338712.603391:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787338712.603408:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c1b5c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab7ee expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.603493:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c1b63 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.603507:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c1b63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.603537:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c1b63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787338712.603551:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1787338712.603682:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c1b5c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab7ee expref: 40 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.603706:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c1b63 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab7ee expref: 39 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.603715:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90bbeb14d900) 00010000:00010000:3.0:1787338712.603718:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787338712.603721:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf7ea5800, rc 0) 00000100:00100000:3.0:1787338712.603786:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc121180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+39:10516:x1874160192111232:12345-192.168.201.53@tcp:101:lfs.0 Request processed in 417us (1800us total) trans 4294967379 rc 0/0 00000100:00100000:3.0:1787338712.603793:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 99 00000100:00100000:1.0:1787338712.606464:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338712.606565:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192111360 00000100:00100000:2.0:1787338712.606574:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192111360 00000100:00100000:2.0:1787338712.606673:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 6 00000100:00100000:2.0:1787338712.606684:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc123480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:83642291-0761-4205-9531-7fd25bc2d48e+39:2358:x1874160192111360:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787338712.606697:0:6704:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787338712.606721:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c1b4e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab7e7 expref: 39 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338712.606736:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90bbeb14d900) 00010000:00010000:2.0:1787338712.606740:0:6704:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787338712.606784:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc123480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:83642291-0761-4205-9531-7fd25bc2d48e+38:2358:x1874160192111360:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 104us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338712.606789:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 6 00000100:00100000:1.0:1787338712.612439:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338712.612541:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192111488 00000100:00100000:3.0:1787338712.612548:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192111488 00000100:00100000:3.0:1787338712.612613:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 36 00000100:00100000:3.0:1787338712.612621:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc121880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:83642291-0761-4205-9531-7fd25bc2d48e+6:2359:x1874160192111488:12345-192.168.201.53@tcp:1:lfs.0 00010000:00010000:3.0:1787338712.612671:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099903cb8/0x83671231080c1b71 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.612693:0:6691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002f3186d5/0x83671231080c1b32 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab7d9 expref: 6 pid: 10743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.612701:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787338712.612719:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787338712.612725:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000099903cb8/0x83671231080c1b71 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.612762:0:6691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002f3186d5/0x83671231080c1b32 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab7d9 expref: 6 pid: 10743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.612776:0:6691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002f3186d5/0x83671231080c1b32 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab7d9 expref: 6 pid: 10743 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338712.612788:0:6691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc282d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6691:1874160212051328:192.168.201.53@tcp:104: 00000100:00100000:3.0:1787338712.612894:0:6691:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbedc57f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787338712.622438:0:6691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc282d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6691:1874160212051328:192.168.201.53@tcp:104: 00010000:00010000:3.0:1787338712.622468:0:6691:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000099903cb8/0x83671231080c1b71 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338712.630141:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338712.630706:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192111616 00000100:00100000:3.0:1787338712.630715:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192111616 00002000:00100000:3.0:1787338712.630757:0:6696:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff90bbfc122680 x1874160192111616/t0(0) o4->83642291-0761-4205-9531-7fd25bc2d48e@192.168.201.53@tcp:43/0 lens 504/0 e 0 to 0 dl 1787338723 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787338712.630766:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90bbfc122680 with x1874160192111616 ext(0->8) 00010000:00010000:3.0:1787338712.630773:0:6696:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000002f3186d5/0x83671231080c1b32 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab7d9 expref: 7 pid: 10743 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.630785:0:6696:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000002f3186d5/0x83671231080c1b32 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab7d9 expref: 7 pid: 10743 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787338712.630808:0:6696:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90bbfc122680 00000100:00100000:3.0:1787338712.630916:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 1 00000100:00100000:3.0:1787338712.630927:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc122680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:83642291-0761-4205-9531-7fd25bc2d48e+7:2358:x1874160192111616:12345-192.168.201.53@tcp:4:lfs.0 00000100:00100000:3.0:1787338712.631620:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc122680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:83642291-0761-4205-9531-7fd25bc2d48e+9:2358:x1874160192111616:12345-192.168.201.53@tcp:4:lfs.0 Request processed in 691us (1485us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1787338712.631628:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 1 00002000:00100000:3.0:1787338712.631634:0:6696:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff90bbfc122680 x1874160192111616/t4294967302(0) o4->83642291-0761-4205-9531-7fd25bc2d48e@192.168.201.53@tcp:43/0 lens 504/448 e 0 to 0 dl 1787338723 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787338712.631640:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90bbfc122680 with x1874160192111616 ext(0->8) 00010000:00010000:3.0:1787338712.631645:0:6696:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000002f3186d5/0x83671231080c1b32 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab7d9 expref: 9 pid: 10743 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.631654:0:6696:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000002f3186d5/0x83671231080c1b32 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab7d9 expref: 9 pid: 10743 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787338712.631659:0:6696:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90bbfc122680 00000100:00100000:1.0:1787338712.638402:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338712.638581:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192111744 00000100:00100000:0.0:1787338712.638590:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192111744 00010000:00010000:0.0:1787338712.638623:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002f3186d5/0x83671231080c1b32 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab7d9 expref: 9 pid: 10743 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338712.638655:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 50 00000100:00100000:0.0:1787338712.638671:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc120700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:83642291-0761-4205-9531-7fd25bc2d48e+9:2356:x1874160192111744:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787338712.638686:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1787338712.638710:0:5823:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1787338712.638713:0:5823:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787338712 00002000:00010000:0.0:1787338712.638715:0:5823:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787338712 00002000:00010000:0.0:1787338712.638716:0:5823:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1787338712 00010000:00010000:0.0:1787338712.638720:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002f3186d5/0x83671231080c1b32 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab7d9 expref: 9 pid: 10743 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338712.638743:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002f3186d5/0x83671231080c1b32 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab7d9 expref: 9 pid: 10743 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338712.638762:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002f3186d5/0x83671231080c1b32 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab7d9 expref: 9 pid: 10743 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338712.638776:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787338712.638779:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787338712.638784:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000099903cb8/0x83671231080c1b71 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338712.638792:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000099903cb8/0x83671231080c1b71 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338712.638819:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787338712.638862:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc120700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:83642291-0761-4205-9531-7fd25bc2d48e+8:2356:x1874160192111744:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 201us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338712.638867:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 50 00010000:00010000:3.0:1787338712.639004:0:6691:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000099903cb8/0x83671231080c1b71 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.639017:0:6691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000099903cb8/0x83671231080c1b71 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.639042:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099903cb8/0x83671231080c1b71 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.639352:0:6691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000099903cb8/0x83671231080c1b71 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.639361:0:6691:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000099903cb8/0x83671231080c1b71 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.639369:0:6691:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea5400 already unused, calling callback (ffffffffc1546230) 00010000:00010000:3.0:1787338712.639374:0:6691:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000099903cb8/0x83671231080c1b71 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.639384:0:6691:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000099903cb8/0x83671231080c1b71 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.639394:0:6691:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000099903cb8/0x83671231080c1b71 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.639399:0:6691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000099903cb8/0x83671231080c1b71 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338712.639479:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc121880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:83642291-0761-4205-9531-7fd25bc2d48e+7:2359:x1874160192111488:12345-192.168.201.53@tcp:1:lfs.0 Request processed in 26858us (27049us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338712.639486:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 36 00000100:00100000:1.0:1787338712.650100:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338712.650246:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192112000 00000100:00100000:3.0:1787338712.650257:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192112000 00000100:00100000:3.0:1787338712.650316:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 26 00000100:00100000:3.0:1787338712.650340:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbd894c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:83642291-0761-4205-9531-7fd25bc2d48e+38:10516:x1874160192112000:12345-192.168.201.53@tcp:35:lfs.0 00000004:00010000:3.0:1787338712.650408:0:5842:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c1b63 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab7ee expref: 38 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787338712.650647:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:3.0:1787338712.650688:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:3.0:1787338712.651036:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:3.0:1787338712.651075:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c1b78 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.651086:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031800/0x83671231080c1b1d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab7cb expref: 42 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.651095:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c1b78 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.651400:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031800/0x83671231080c1b1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab7cb expref: 42 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.651415:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031800/0x83671231080c1b1d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab7cb expref: 42 pid: 7647 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338712.651429:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc282d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5842:1874160212051456:192.168.201.53@tcp:104: 00000100:00100000:3.0:1787338712.651506:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbedc57f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787338712.653387:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338712.653517:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192112128 00000100:00100000:1.0:1787338712.653524:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192112128 00010000:00010000:1.0:1787338712.653557:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031800/0x83671231080c1b1d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab7cb expref: 43 pid: 7647 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338712.653594:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 51 00000100:00100000:1.0:1787338712.653604:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbff8ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:83642291-0761-4205-9531-7fd25bc2d48e+43:2358:x1874160192112128:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787338712.653615:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787338712.653622:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031800/0x83671231080c1b1d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab7cb expref: 43 pid: 7647 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338712.653634:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031800/0x83671231080c1b1d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab7cb expref: 43 pid: 7647 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338712.653654:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90bbeb14d900) 00010000:00010000:1.0:1787338712.653660:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c1b78 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338712.653696:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c1b78 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338712.653703:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c1b78 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338712.653721:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787338712.653768:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbff8ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:83642291-0761-4205-9531-7fd25bc2d48e+43:2358:x1874160192112128:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 165us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338712.653776:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 51 00010000:00010000:3.0:1787338712.654048:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031800/0x83671231080c1b1d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab7cb expref: 42 pid: 7647 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338712.654064:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc282d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5842:1874160212051456:192.168.201.53@tcp:104: 00010000:00010000:3.0:1787338712.654091:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c1b78 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.654099:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c1b78 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.654215:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c1b78 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787338712.654319:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:3.0:1787338712.654501:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:3.0:1787338712.654601:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc282d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5842:1874160212051584:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787338712.654659:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338712.654702:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbedc57a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787338712.654724:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212051584 00000100:00100000:1.0:1787338712.654730:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212051584 00000100:00100000:1.0:1787338712.654786:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1787338712.654792:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787338712.654795:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc283480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5842:x1874160212051584:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787338712.654865:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc283480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5842:x1874160212051584:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 72us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338712.654903:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787338712.654995:0:5842:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:3.0:1787338712.655001:0:5842:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:3.0:1787338712.655018:0:5842:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90bbf7eae680, transno 4294967301 00000100:00100000:3.0:1787338712.655039:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc282d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5842:1874160212051584:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1787338712.655931:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:3.0:1787338712.655987:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc282d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5842:1874160212051712:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787338712.656027:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338712.656049:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbedc57f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787338712.656089:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212051712 00000100:00100000:2.0:1787338712.656095:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212051712 00000100:00100000:2.0:1787338712.656142:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787338712.656152:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc281180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5842:x1874160212051712:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787338712.656294:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc281180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5842:x1874160212051712:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 144us (266us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1787338712.656302:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787338712.656334:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc282d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5842:1874160212051712:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1787338712.656379:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:3.0:1787338712.656413:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c1b78 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.656423:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c1b78 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.656437:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c1b78 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.656443:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea5400 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:3.0:1787338712.656448:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c1b78 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.656456:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c1b78 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.656470:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90bbeb14d900) 00010000:00010000:3.0:1787338712.656473:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787338712.656478:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c1b78 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.656484:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c1b78 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787338712.656639:0:5842:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1787338712.656730:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:3.0:1787338712.656739:0:5842:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 365497864691ns, next at 366497862908ns, rc = 0 00000001:00080000:3.0:1787338712.656743:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:3.0:1787338712.656767:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90bbeb14d900) 00010000:00010000:3.0:1787338712.656770:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787338712.656776:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c1b63 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab7ee expref: 46 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338712.656946:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbd894c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:83642291-0761-4205-9531-7fd25bc2d48e+45:10516:x1874160192112000:12345-192.168.201.53@tcp:35:lfs.0 Request processed in 6608us (6852us total) trans 4294967388 rc 0/0 00000100:00100000:3.0:1787338712.656964:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 26 00000020:00080000:3.0:1787338712.656968:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1787338712.659860:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338712.659940:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192112256 00000100:00100000:3.0:1787338712.659949:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192112256 00000100:00100000:0.0:1787338712.660006:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 100 00000100:00100000:0.0:1787338712.660017:0:7647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbff8fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+45:10516:x1874160192112256:12345-192.168.201.53@tcp:101:lfs.0 00010000:00010000:0.0:1787338712.660036:0:7647:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787338712.660063:0:7647:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c1b7f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab7f5 expref: -99 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338712.660127:0:7647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c1b7f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab7f5 expref: 46 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338712.660136:0:7647:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c1b7f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab7f5 expref: 46 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338712.660149:0:7647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90bbeb14d700) 00010000:00010000:0.0:1787338712.660151:0:7647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787338712.660154:0:7647:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbc0030800, rc 0) 00000100:00100000:0.0:1787338712.660199:0:7647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbff8fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+46:10516:x1874160192112256:12345-192.168.201.53@tcp:101:lfs.0 Request processed in 186us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338712.660204:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 100 00000100:00100000:1.0:1787338712.665326:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338712.665390:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192112512 00000100:00100000:2.0:1787338712.665400:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192112512 00000100:00100000:2.0:1787338712.665493:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 27 00000100:00100000:2.0:1787338712.665502:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc123100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:83642291-0761-4205-9531-7fd25bc2d48e+46:10516:x1874160192112512:12345-192.168.201.53@tcp:35:lfs.0 00000100:00100000:2.0:1787338712.665794:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc123100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:83642291-0761-4205-9531-7fd25bc2d48e+47:10516:x1874160192112512:12345-192.168.201.53@tcp:35:lfs.0 Request processed in 284us (468us total) trans 4294967389 rc 0/0 00000100:00100000:2.0:1787338712.665800:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 27 00000100:00100000:1.0:1787338712.747049:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338712.747271:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192112640 00000100:00100000:3.0:1787338712.747282:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192112640 00000100:00100000:3.0:1787338712.747344:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 101 00000100:00100000:3.0:1787338712.747354:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc122300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+47:10526:x1874160192112640:12345-192.168.201.53@tcp:34:lfs.0 00010000:00010000:3.0:1787338712.747454:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c1b86 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.747473:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c1b86 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.747485:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c1b86 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.747500:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c1b8d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.747516:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c1b8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.747522:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c1b8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.747635:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5000/0x83671231080c1b94 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.747645:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5000/0x83671231080c1b94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.747684:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5000/0x83671231080c1b94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787338712.747729:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5000/0x83671231080c1b94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.748782:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c1b86 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.748789:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c1b86 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.748797:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c1b86 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.748802:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea5800 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:3.0:1787338712.748806:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c1b86 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.748812:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c1b86 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.748825:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff90bbdee56e00) 00010000:00010000:3.0:1787338712.748829:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787338712.748833:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c1b86 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.748839:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c1b86 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.748854:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c1b8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.748871:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c1b8d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.748901:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c1b8d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.748907:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea5400 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:3.0:1787338712.748919:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c1b8d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.748927:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c1b8d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.748936:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff90bbd38d6b00) 00010000:00010000:3.0:1787338712.748938:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787338712.748941:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c1b8d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.748947:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c1b8d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.748964:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5000/0x83671231080c1b94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.748970:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5000/0x83671231080c1b94 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.748976:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5000/0x83671231080c1b94 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.748981:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea5000 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:3.0:1787338712.748992:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5000/0x83671231080c1b94 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.748998:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5000/0x83671231080c1b94 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.749006:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90bbeb14d700) 00010000:00010000:3.0:1787338712.749008:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787338712.749011:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5000/0x83671231080c1b94 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.749016:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5000/0x83671231080c1b94 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338712.749417:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc122300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+47:10526:x1874160192112640:12345-192.168.201.53@tcp:34:lfs.0 Request processed in 2060us (2376us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338712.749440:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 101 00010000:00010000:3.0:1787338712.758063:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787338712.780061:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338712.780494:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192112896 00000100:00100000:3.0:1787338712.780506:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192112896 00000100:00100000:3.0:1787338712.780609:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 102 00000100:00100000:3.0:1787338712.780629:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc122a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+47:10529:x1874160192112896:12345-192.168.201.53@tcp:101:lfs.0 00010000:00010000:3.0:1787338712.780646:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787338712.780679:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5000/0x83671231080c1b9b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab7fc expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.780741:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c1ba2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.780754:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c1ba2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.780776:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c1ba2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.780789:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c1ba9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.780795:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c1ba9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.780800:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c1ba9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.780955:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5c00/0x83671231080c1bb0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.780964:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5c00/0x83671231080c1bb0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.780971:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5c00/0x83671231080c1bb0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787338712.780981:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1787338712.781091:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c1ba2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.781098:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c1ba2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.781111:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c1ba2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.781123:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea5400 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:3.0:1787338712.781133:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c1ba2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.781145:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c1ba2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.781158:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff90bbdee56e00) 00010000:00010000:3.0:1787338712.781161:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787338712.781166:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c1ba2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.781172:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c1ba2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.781186:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c1ba9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.781192:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c1ba9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.781198:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c1ba9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.781202:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea5800 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:3.0:1787338712.781205:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c1ba9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.781210:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c1ba9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.781216:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff90bbd38d6b00) 00010000:00010000:3.0:1787338712.781218:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787338712.781227:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c1ba9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.781232:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c1ba9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.781266:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5000/0x83671231080c1b9b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab7fc expref: 50 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.781278:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5c00/0x83671231080c1bb0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab7fc expref: 49 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.781284:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90bbeb14d700) 00010000:00010000:3.0:1787338712.781286:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787338712.781288:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf7ea5c00, rc 0) 00000100:00100000:3.0:1787338712.781334:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc122a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+49:10529:x1874160192112896:12345-192.168.201.53@tcp:101:lfs.0 Request processed in 718us (1292us total) trans 4294967390 rc 0/0 00000100:00100000:3.0:1787338712.781341:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 102 00000100:00100000:1.0:1787338712.785286:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338712.785558:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192113024 00000100:00100000:0.0:1787338712.785568:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192113024 00000100:00100000:0.0:1787338712.785641:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 103 00000100:00100000:0.0:1787338712.785652:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc121500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+49:10529:x1874160192113024:12345-192.168.201.53@tcp:54:lfs.0 00010000:00010000:0.0:1787338712.785735:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c1bbe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338712.785753:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c1bbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338712.785765:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c1bbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338712.785790:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c1bbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338712.785813:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c1bbe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338712.785819:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c1bbe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338712.785833:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbc0031000 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:0.0:1787338712.785838:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c1bbe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338712.785845:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c1bbe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338712.785858:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90bbeb14d700) 00010000:00010000:0.0:1787338712.785861:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787338712.785865:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c1bbe lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338712.785895:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c1bbe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338712.785972:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc121500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+49:10529:x1874160192113024:12345-192.168.201.53@tcp:54:lfs.0 Request processed in 320us (693us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338712.785987:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 103 00000100:00100000:1.0:1787338712.790274:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338712.790496:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192113280 00000100:00100000:3.0:1787338712.790519:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192113280 00000100:00100000:3.0:1787338712.790589:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 28 00000100:00100000:3.0:1787338712.790600:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc120e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:83642291-0761-4205-9531-7fd25bc2d48e+49:10529:x1874160192113280:12345-192.168.201.53@tcp:35:lfs.0 00000100:00100000:3.0:1787338712.791013:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc120e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:83642291-0761-4205-9531-7fd25bc2d48e+50:10529:x1874160192113280:12345-192.168.201.53@tcp:35:lfs.0 Request processed in 413us (754us total) trans 4294967391 rc 0/0 00000100:00100000:3.0:1787338712.791033:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 28 00000100:00100000:1.0:1787338712.884453:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338712.896768:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192113536 00000100:00100000:0.0:1787338712.896783:0:7647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192113536 00000100:00100000:0.0:1787338712.896936:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 104 00000100:00100000:0.0:1787338712.896948:0:7647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc120000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+50:10539:x1874160192113536:12345-192.168.201.53@tcp:101:bash.0 00010000:00010000:0.0:1787338712.896975:0:7647:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787338712.896990:0:7647:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787338712.897017:0:7647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031400/0x83671231080c1b40 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab7e0 expref: 50 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338712.897039:0:7647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff90bbdee56e00) 00010000:00010000:0.0:1787338712.897044:0:7647:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787338712.897063:0:7647:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c1bc5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab803 expref: -99 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338712.897180:0:7647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031a00/0x83671231080c1bcc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338712.897197:0:7647:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5c00/0x83671231080c1bb0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab7fc expref: 50 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338712.897208:0:7647:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031a00/0x83671231080c1bcc lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338712.897246:0:7647:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5c00/0x83671231080c1bb0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab7fc expref: 50 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338712.897261:0:7647:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5c00/0x83671231080c1bb0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab7fc expref: 50 pid: 5840 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338712.897273:0:7647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc01ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7647:1874160212051840:192.168.201.53@tcp:104: 00000100:00100000:0.0:1787338712.897357:0:7647:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbf43d8f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787338712.906383:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338712.906457:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192113664 00000100:00100000:3.0:1787338712.906465:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192113664 00010000:00010000:3.0:1787338712.906503:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5c00/0x83671231080c1bb0 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab7fc expref: 51 pid: 5840 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338712.907271:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 52 00000100:00100000:3.0:1787338712.907283:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc121c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:83642291-0761-4205-9531-7fd25bc2d48e+51:2359:x1874160192113664:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787338712.907299:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787338712.907307:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5c00/0x83671231080c1bb0 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab7fc expref: 51 pid: 5840 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.907342:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5c00/0x83671231080c1bb0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab7fc expref: 51 pid: 5840 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.907365:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90bbeb14d700) 00010000:00010000:3.0:1787338712.907371:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031a00/0x83671231080c1bcc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.907379:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031a00/0x83671231080c1bcc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.907385:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031a00/0x83671231080c1bcc lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.907401:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787338712.907461:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc121c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:83642291-0761-4205-9531-7fd25bc2d48e+51:2359:x1874160192113664:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 180us (1096us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338712.907469:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 52 00010000:00010000:0.0:1787338712.915088:0:7647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5c00/0x83671231080c1bb0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab7fc expref: 50 pid: 5840 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338712.915136:0:7647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc01ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7647:1874160212051840:192.168.201.53@tcp:104: 00010000:00010000:0.0:1787338712.915163:0:7647:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031a00/0x83671231080c1bcc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338712.915273:0:7647:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031a00/0x83671231080c1bcc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338712.915281:0:7647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031a00/0x83671231080c1bcc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787338712.915309:0:7647:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1787338712.915479:0:7647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c1bc5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab803 expref: 51 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338712.915497:0:7647:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031a00/0x83671231080c1bcc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab803 expref: 50 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338712.915506:0:7647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90bbeb14d700) 00010000:00010000:1.0:1787338712.915509:0:7647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787338712.915512:0:7647:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbc0031a00, rc 0) 00000100:00100000:1.0:1787338712.915595:0:7647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc120000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+50:10539:x1874160192113536:12345-192.168.201.53@tcp:101:bash.0 Request processed in 18648us (31160us total) trans 4294967392 rc 0/0 00000100:00100000:1.0:1787338712.915604:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 104 00000100:00100000:1.0:1787338712.922686:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338712.922764:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192113920 00000100:00100000:0.0:1787338712.922774:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192113920 00000100:00100000:0.0:1787338712.922833:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 105 00000100:00100000:0.0:1787338712.922845:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc121f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+50:10539:x1874160192113920:12345-192.168.201.53@tcp:36:bash.0 00010000:00010000:0.0:1787338712.923152:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031400/0x83671231080c1bda lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338712.923170:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031400/0x83671231080c1bda lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338712.923182:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031400/0x83671231080c1bda lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787338712.923232:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:0.0:1787338712.923256:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000852f6636 reply state 000000007365e76f transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031400/0x83671231080c1bda lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338712.923264:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787338712.923354:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc121f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+53:10539:x1874160192113920:12345-192.168.201.53@tcp:36:bash.0 Request processed in 511us (676us total) trans 4294967394 rc 0/0 00000100:00100000:0.0:1787338712.923361:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 105 00000020:00080000:0.0:1787338712.923366:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787338712.926109:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031400/0x83671231080c1bda lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338712.926144:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031400/0x83671231080c1bda lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338712.926151:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031400/0x83671231080c1bda lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338712.926158:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbc0031400 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:0.0:1787338712.926163:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031400/0x83671231080c1bda lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338712.926170:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031400/0x83671231080c1bda lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338712.926186:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90bbeb14d700) 00010000:00010000:0.0:1787338712.926189:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787338712.926194:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031400/0x83671231080c1bda lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338712.926200:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031400/0x83671231080c1bda lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338712.927651:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338712.927709:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192114048 00000100:00100000:3.0:1787338712.927718:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192114048 00000100:00100000:3.0:1787338712.927762:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 106 00000100:00100000:3.0:1787338712.927770:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc123b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+52:10539:x1874160192114048:12345-192.168.201.53@tcp:101:bash.0 00010000:00010000:3.0:1787338712.927798:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787338712.927812:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5000/0x83671231080c1be1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab80a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.927915:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c1be8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.927930:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031a00/0x83671231080c1bcc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab803 expref: 53 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.927939:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c1be8 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.927981:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031a00/0x83671231080c1bcc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab803 expref: 53 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.927995:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031a00/0x83671231080c1bcc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab803 expref: 53 pid: 7647 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338712.928007:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc280380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5840:1874160212051968:192.168.201.53@tcp:104: 00000100:00100000:3.0:1787338712.928134:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbedc57b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787338712.929827:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc280380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5840:1874160212051968:192.168.201.53@tcp:104: 00010000:00010000:1.0:1787338712.929852:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c1be8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338712.932605:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338712.932707:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192114176 00000100:00100000:3.0:1787338712.932716:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192114176 00010000:00010000:3.0:1787338712.932756:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031a00/0x83671231080c1bcc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab803 expref: 54 pid: 7647 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338712.932800:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 53 00000100:00100000:3.0:1787338712.932811:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc123800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:83642291-0761-4205-9531-7fd25bc2d48e+54:2358:x1874160192114176:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787338712.932840:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787338712.932848:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031a00/0x83671231080c1bcc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab803 expref: 54 pid: 7647 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.932862:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031a00/0x83671231080c1bcc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab803 expref: 54 pid: 7647 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.932919:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031a00/0x83671231080c1bcc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab803 expref: 54 pid: 7647 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.932936:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90bbeb14d700) 00010000:00010000:3.0:1787338712.932942:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c1be8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.932950:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c1be8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.932957:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c1be8 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338712.932977:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787338712.933029:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc123800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:83642291-0761-4205-9531-7fd25bc2d48e+53:2358:x1874160192114176:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 220us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338712.933037:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 53 00010000:00010000:1.0:1787338712.933694:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c1be8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338712.933705:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c1be8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787338712.933748:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1787338712.933760:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787338712.933782:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c1be8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338712.933813:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5000/0x83671231080c1be1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab80a expref: 53 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338712.933828:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c1be8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab80a expref: 52 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338712.933836:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90bbeb14d700) 00010000:00010000:1.0:1787338712.933839:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787338712.933842:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf7ea5800, rc 0) 00000100:00100000:1.0:1787338712.933914:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc123b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+52:10539:x1874160192114048:12345-192.168.201.53@tcp:101:bash.0 Request processed in 6143us (6269us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338712.933921:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 106 00000100:00100000:1.0:1787338712.940997:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338712.941385:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192114432 00000100:00100000:3.0:1787338712.941394:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192114432 00000100:00100000:3.0:1787338712.941456:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 29 00000100:00100000:3.0:1787338712.941467:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf4117480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:83642291-0761-4205-9531-7fd25bc2d48e+52:10539:x1874160192114432:12345-192.168.201.53@tcp:35:bash.0 00000100:00100000:3.0:1787338712.941716:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf4117480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:83642291-0761-4205-9531-7fd25bc2d48e+53:10539:x1874160192114432:12345-192.168.201.53@tcp:35:bash.0 Request processed in 250us (726us total) trans 4294967395 rc 0/0 00000100:00100000:3.0:1787338712.941724:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 29 00000100:00100000:3.0:1787338712.992364:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338712.993544:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192114560 00000100:00100000:2.0:1787338712.993556:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192114560 00000100:00100000:2.0:1787338712.993609:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 107 00000100:00100000:2.0:1787338712.993620:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc280380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+53:10545:x1874160192114560:12345-192.168.201.53@tcp:101:lfs.0 00010000:00010000:2.0:1787338712.993646:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787338712.993678:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c1bef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab811 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338712.993745:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c1bf6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338712.993759:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c1bf6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338712.993770:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c1bf6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787338712.993830:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:2.0:1787338712.993834:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787338712.993856:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c1bf6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338712.993910:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c1bef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab811 expref: 55 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338712.995127:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c1bf6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab811 expref: 54 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338712.995142:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff90bbdee56e00) 00010000:00010000:2.0:1787338712.995146:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787338712.995150:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf40e2600, rc 0) 00000100:00100000:2.0:1787338712.995239:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc280380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+54:10545:x1874160192114560:12345-192.168.201.53@tcp:101:lfs.0 Request processed in 1620us (2884us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338712.995247:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 107 00000100:00100000:0.0:1787338713.002650:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338713.002828:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192114688 00000100:00100000:1.0:1787338713.002839:0:7647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192114688 00000100:00100000:1.0:1787338713.002957:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 108 00000100:00100000:1.0:1787338713.002969:0:7647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc01ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+54:10545:x1874160192114688:12345-192.168.201.53@tcp:101:lfs.0 00010000:00010000:1.0:1787338713.002992:0:7647:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787338713.003016:0:7647:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d200/0x83671231080c1bfd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab818 expref: -99 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338713.003106:0:7647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c600/0x83671231080c1c04 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787338713.003319:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787338713.003652:0:7647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c600/0x83671231080c1c04 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338713.003689:0:7647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c600/0x83671231080c1c04 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338713.003708:0:7647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c200/0x83671231080c1c0b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338713.003716:0:7647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c200/0x83671231080c1c0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338713.003722:0:7647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c200/0x83671231080c1c0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338713.003829:0:7647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9da00/0x83671231080c1c12 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338713.003839:0:7647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9da00/0x83671231080c1c12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338713.003846:0:7647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9da00/0x83671231080c1c12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787338713.003970:0:7647:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1787338713.003975:0:7647:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787338713.003994:0:7647:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9da00/0x83671231080c1c12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338713.004007:0:7647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9da00/0x83671231080c1c12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338713.004015:0:7647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c600/0x83671231080c1c04 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338713.004032:0:7647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c600/0x83671231080c1c04 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338713.004039:0:7647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c600/0x83671231080c1c04 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338713.004046:0:7647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbfbe9c600 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:1.0:1787338713.005688:0:7647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c600/0x83671231080c1c04 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338713.005704:0:7647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c600/0x83671231080c1c04 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338713.005720:0:7647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff90bbdee56e00) 00010000:00010000:1.0:1787338713.005723:0:7647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787338713.005728:0:7647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c600/0x83671231080c1c04 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338713.005735:0:7647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c600/0x83671231080c1c04 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338713.005752:0:7647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c200/0x83671231080c1c0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338713.005759:0:7647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c200/0x83671231080c1c0b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338713.005766:0:7647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c200/0x83671231080c1c0b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338713.005771:0:7647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbfbe9c200 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:1.0:1787338713.005784:0:7647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c200/0x83671231080c1c0b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338713.005791:0:7647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c200/0x83671231080c1c0b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338713.005798:0:7647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff90bbc2a93800) 00010000:00010000:1.0:1787338713.005800:0:7647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787338713.005803:0:7647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c200/0x83671231080c1c0b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338713.005809:0:7647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c200/0x83671231080c1c0b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338713.005850:0:7647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d200/0x83671231080c1bfd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab818 expref: 56 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338713.005864:0:7647:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9da00/0x83671231080c1c12 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab818 expref: 55 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338713.005909:0:7647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90bbeb14d700) 00010000:00010000:1.0:1787338713.005912:0:7647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787338713.005915:0:7647:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbfbe9da00, rc 0) 00000100:00100000:1.0:1787338713.005987:0:7647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc01ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+55:10545:x1874160192114688:12345-192.168.201.53@tcp:101:lfs.0 Request processed in 3019us (3354us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338713.005996:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 108 00000100:00100000:1.0:1787338713.012093:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338713.012260:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338713.012393:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192114816 00000100:00100000:3.0:1787338713.012404:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192114816 00000100:00100000:3.0:1787338713.012469:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 7 00000100:00100000:3.0:1787338713.012480:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf4115880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:83642291-0761-4205-9531-7fd25bc2d48e+55:2358:x1874160192114816:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787338713.012494:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787338713.012519:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9da00/0x83671231080c1c12 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab818 expref: 55 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338713.012539:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90bbeb14d700) 00010000:00010000:3.0:1787338713.012544:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787338713.012692:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192115072 00000100:00100000:0.0:1787338713.012697:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192115072 00000100:00100000:0.0:1787338713.012731:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 109 00000100:00100000:0.0:1787338713.012738:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf4116680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+55:10545:x1874160192115072:12345-192.168.201.53@tcp:101:lfs.0 00010000:00010000:0.0:1787338713.012754:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787338713.012769:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031800/0x83671231080c1c19 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab81f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338713.012919:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c1c20 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338713.012933:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c1be8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab80a expref: 56 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338713.012941:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c1c20 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338713.012991:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c1be8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab80a expref: 56 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338713.013005:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c1be8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab80a expref: 56 pid: 5840 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338713.013019:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbd17ec000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5841:1874160212052096:192.168.201.53@tcp:104: 00000100:00100000:3.0:1787338713.014088:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf4115880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:83642291-0761-4205-9531-7fd25bc2d48e+56:2358:x1874160192114816:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 1604us (2001us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338713.014098:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 7 00000100:00100000:0.0:1787338713.018132:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbf43d8f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787338713.028185:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338713.028284:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbd17ec000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5841:1874160212052096:192.168.201.53@tcp:104: 00010000:00010000:0.0:1787338713.028311:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c1c20 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338713.028616:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192115200 00000100:00100000:3.0:1787338713.028623:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192115200 00010000:00010000:3.0:1787338713.028671:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c1be8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab80a expref: 56 pid: 5840 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338713.028927:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 54 00000100:00100000:3.0:1787338713.028938:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbde53f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:83642291-0761-4205-9531-7fd25bc2d48e+56:2359:x1874160192115200:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787338713.028952:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787338713.028959:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c1be8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab80a expref: 56 pid: 5840 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338713.028984:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c1be8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab80a expref: 56 pid: 5840 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338713.029006:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c1be8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab80a expref: 56 pid: 5840 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338713.029021:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90bbeb14d700) 00010000:00010000:3.0:1787338713.029027:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c1c20 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338713.029036:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c1c20 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338713.029044:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c1c20 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338713.029081:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787338713.029142:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbde53f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:83642291-0761-4205-9531-7fd25bc2d48e+55:2359:x1874160192115200:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 197us (958us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338713.029150:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 54 00010000:00010000:0.0:1787338713.029585:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c1c20 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338713.029593:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c1c20 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787338713.029621:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1787338713.029792:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031800/0x83671231080c1c19 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab81f expref: 56 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338713.029808:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c1c20 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab81f expref: 55 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338713.029816:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90bbeb14d700) 00010000:00010000:0.0:1787338713.029819:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787338713.029821:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbc0030a00, rc 0) 00000100:00100000:0.0:1787338713.029867:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf4116680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+55:10545:x1874160192115072:12345-192.168.201.53@tcp:101:lfs.0 Request processed in 17129us (17607us total) trans 4294967396 rc 0/0 00000100:00100000:0.0:1787338713.029901:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 109 00000100:00100000:1.0:1787338713.038648:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338713.038765:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192115456 00000100:00100000:0.0:1787338713.038776:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192115456 00000100:00100000:0.0:1787338713.038870:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 8 00000100:00100000:0.0:1787338713.038918:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf4114700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:83642291-0761-4205-9531-7fd25bc2d48e+55:10545:x1874160192115456:12345-192.168.201.53@tcp:103:lfs.0 00010000:00010000:0.0:1787338713.038934:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787338713.038959:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c1b7f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab7f5 expref: 55 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338713.038979:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90bbeb14d700) 00010000:00010000:0.0:1787338713.038985:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787338713.039036:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf4114700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:83642291-0761-4205-9531-7fd25bc2d48e+54:10545:x1874160192115456:12345-192.168.201.53@tcp:103:lfs.0 Request processed in 120us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338713.039045:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 8 00000100:00100000:1.0:1787338713.045686:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338713.045755:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192115584 00000100:00100000:3.0:1787338713.045767:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192115584 00000100:00100000:3.0:1787338713.045826:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 110 00000100:00100000:3.0:1787338713.045837:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf4117100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+54:10545:x1874160192115584:12345-192.168.201.53@tcp:58:lfs.0 00010000:00010000:3.0:1787338713.046094:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c1c2e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338713.046112:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c1c2e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338713.046149:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c1c2e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787338713.046375:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:3.0:1787338713.046464:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf4117100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+54:10545:x1874160192115584:12345-192.168.201.53@tcp:58:lfs.0 Request processed in 628us (787us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338713.046472:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 110 00000100:00100000:1.0:1787338713.050023:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338713.050108:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192115712 00000100:00100000:2.0:1787338713.050117:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192115712 00000100:00100000:2.0:1787338713.050211:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 111 00000100:00100000:2.0:1787338713.050222:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf4116300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+54:10545:x1874160192115712:12345-192.168.201.53@tcp:101:lfs.0 00010000:00010000:2.0:1787338713.050241:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787338713.050260:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c1c35 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab826 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338713.050319:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c1c2e lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338713.050330:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c1c35 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab826 expref: 55 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338713.050349:0:5839:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c1c2e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338713.050362:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c1c35 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab826 expref: 55 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338713.050391:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90bbeb14d700) 00010000:00010000:2.0:1787338713.050394:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787338713.050398:0:5839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c1c35 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab826 expref: 55 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338713.050405:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf40e2a00, rc 0) 00000100:00100000:2.0:1787338713.050461:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf4116300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+55:10545:x1874160192115712:12345-192.168.201.53@tcp:101:lfs.0 Request processed in 241us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338713.050468:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 111 00010000:00010000:2.0:1787338713.782372:0:11676:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787338713.846141:0:11692:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787338713.846151:0:11692:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787338713.846190:0:11692:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:2.0:1787338713.846196:0:11692:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787338713.846324:0:11692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbff8fd500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11692:1874160212052224:192.168.201.53@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787338713.847055:0:11692:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbedd6bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787338713.856519:0:11692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbff8fd500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11692:1874160212052224:192.168.201.53@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787338713.882053:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338713.882206:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192115840 00000100:00100000:2.0:1787338713.882217:0:7647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192115840 00000100:00100000:2.0:1787338713.882283:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 112 00000100:00100000:2.0:1787338713.882294:0:7647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf4116a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+55:10546:x1874160192115840:12345-192.168.201.53@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787338713.882323:0:7647:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787338713.882446:0:7647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf4116a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+55:10546:x1874160192115840:12345-192.168.201.53@tcp:53:lhsmtool_posix.0 Request processed in 154us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338713.882470:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 112 00000100:00100000:1.0:1787338713.887229:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338713.890612:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192115968 00000100:00100000:0.0:1787338713.890629:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192115968 00000100:00100000:0.0:1787338713.890747:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 113 00000100:00100000:0.0:1787338713.890758:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf4115500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+55:10546:x1874160192115968:12345-192.168.201.53@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787338713.890832:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031800/0x83671231080c1c3c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338713.890850:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031800/0x83671231080c1c3c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338713.890862:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031800/0x83671231080c1c3c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338713.890911:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c1c43 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338713.890920:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c1c43 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338713.890931:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c1c43 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338713.891029:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c1c4a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338713.891038:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c1c4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338713.891045:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c1c4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787338713.891085:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1787338713.891089:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787338713.891102:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c1c4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338713.891121:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031800/0x83671231080c1c3c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338713.891126:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031800/0x83671231080c1c3c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338713.891132:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031800/0x83671231080c1c3c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338713.891138:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbc0031800 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:0.0:1787338713.891141:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031800/0x83671231080c1c3c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338713.891149:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031800/0x83671231080c1c3c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338713.891160:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90bbdee56100) 00010000:00010000:0.0:1787338713.891162:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787338713.891166:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031800/0x83671231080c1c3c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338713.891171:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031800/0x83671231080c1c3c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338713.891185:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c1c43 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338713.891191:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c1c43 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338713.891197:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c1c43 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338713.891207:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbc0030400 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:0.0:1787338713.891210:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c1c43 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338713.891216:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c1c43 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338713.891224:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff90bbeb14db00) 00010000:00010000:0.0:1787338713.891227:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787338713.891229:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c1c43 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338713.891234:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c1c43 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338713.891250:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c1c4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338713.891256:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c1c4a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338713.891261:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c1c4a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338713.891266:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbc0030800 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:0.0:1787338713.891268:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c1c4a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338713.891274:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c1c4a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338713.891292:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90bbeb14d700) 00010000:00010000:0.0:1787338713.891294:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787338713.891297:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c1c4a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338713.891303:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c1c4a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338713.891392:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf4115500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+55:10546:x1874160192115968:12345-192.168.201.53@tcp:34:lhsmtool_posix.0 Request processed in 636us (4170us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338713.891400:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 113 00000100:00100000:0.0:1787338713.906304:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338713.909493:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192116224 00000100:00100000:2.0:1787338713.909511:0:7647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192116224 00000100:00100000:2.0:1787338713.909588:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 114 00000100:00100000:2.0:1787338713.909598:0:7647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbd17ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+55:10546:x1874160192116224:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787338713.909618:0:7647:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787338713.909651:0:7647:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c1c51 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab82d expref: -99 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338713.909751:0:7647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c1c58 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338713.909766:0:7647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c1c58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338713.909777:0:7647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c1c58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787338713.909787:0:7647:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1787338713.909957:0:7647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c1c58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338713.909965:0:7647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c1c58 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338713.909971:0:7647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c1c58 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338713.909977:0:7647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e2c00 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:2.0:1787338713.909981:0:7647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c1c58 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338713.910002:0:7647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c1c58 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338713.910015:0:7647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90bbeb14d700) 00010000:00010000:2.0:1787338713.910018:0:7647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787338713.910217:0:7647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c1c58 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338713.910224:0:7647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c1c58 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338713.910268:0:7647:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c1c51 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab82d expref: 57 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338713.910278:0:7647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90bbdee56100) 00010000:00010000:2.0:1787338713.910280:0:7647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787338713.910283:0:7647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c1c51 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab82d expref: 57 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338713.910293:0:7647:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf40e3200, rc 0) 00000100:00100000:2.0:1787338713.910359:0:7647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbd17ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+56:10546:x1874160192116224:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 Request processed in 762us (4065us total) trans 4294967397 rc 301/301 00000100:00100000:2.0:1787338713.910365:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 114 00000100:00100000:1.0:1787338713.921699:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338713.922684:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192116352 00000100:00100000:2.0:1787338713.922746:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192116352 00000100:00100000:2.0:1787338713.922844:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 115 00000100:00100000:2.0:1787338713.922856:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf4114e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+56:10546:x1874160192116352:12345-192.168.201.53@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787338713.922937:0:5839:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787338713.923093:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf4114e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+56:10546:x1874160192116352:12345-192.168.201.53@tcp:53:lhsmtool_posix.0 Request processed in 238us (1410us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338713.923100:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 115 00000100:00100000:1.0:1787338713.928450:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338713.930382:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192116608 00000100:00100000:0.0:1787338713.930395:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192116608 00000100:00100000:0.0:1787338713.930503:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 116 00000100:00100000:0.0:1787338713.930515:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf4114000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+56:10546:x1874160192116608:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787338713.930537:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787338713.930540:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787338713.930569:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c1bf6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab811 expref: 56 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338713.930592:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff90bbdee56e00) 00010000:00010000:0.0:1787338713.930669:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787338713.930686:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c1c66 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab834 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787338713.935849:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:0.0:1787338713.936194:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c1c6d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338713.936222:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c1c6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338713.936539:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c1c6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338713.936820:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c1c66 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab834 expref: 58 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338713.936843:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c1c6d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab834 expref: 57 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338713.936853:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff90bbeb14db00) 00010000:00010000:0.0:1787338713.936857:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787338713.936860:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbc0030400, rc 0) 00000100:00100000:0.0:1787338713.937389:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf4114000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+57:10546:x1874160192116608:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 Request processed in 6874us (8947us total) trans 4294967398 rc 0/0 00000100:00100000:0.0:1787338713.937397:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 116 00000100:00100000:3.0:1787338713.942797:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338713.943944:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192116864 00000100:00100000:2.0:1787338713.943963:0:7647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192116864 00000100:00100000:2.0:1787338713.944055:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 117 00000100:00100000:2.0:1787338713.944068:0:7647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc280e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+57:10546:x1874160192116864:12345-192.168.201.53@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787338713.944511:0:7647:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787338713.944542:0:7647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c1c6d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab834 expref: 57 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338713.944566:0:7647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff90bbeb14db00) 00010000:00010000:2.0:1787338713.944579:0:7647:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787338713.944738:0:7647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c1c7b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338713.944753:0:7647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c1c7b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338713.944762:0:7647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c1c7b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338713.944779:0:7647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c1c82 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x7c4a6181 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338713.944786:0:7647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c1c82 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x7c4a6181 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338713.944814:0:7647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c1c82 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x7c4a6181 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338713.945830:0:7647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c1c7b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338713.945843:0:7647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c1c7b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338713.945851:0:7647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c1c7b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338713.945856:0:7647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e3200 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:2.0:1787338713.945861:0:7647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c1c7b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338713.945868:0:7647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c1c7b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338713.945926:0:7647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff90bbdee56e00) 00010000:00010000:2.0:1787338713.945930:0:7647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787338713.945934:0:7647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c1c7b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338713.945941:0:7647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c1c7b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338713.945954:0:7647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c1c82 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x7c4a6181 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338713.945961:0:7647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c1c82 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x7c4a6181 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338713.946675:0:7647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c1c82 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x7c4a6181 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338713.946681:0:7647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e2c00 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:2.0:1787338713.946685:0:7647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c1c82 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x7c4a6181 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338713.946701:0:7647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c1c82 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x7c4a6181 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338713.946714:0:7647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x7c4a6181 (ffff90bbdee56f00) 00010000:00010000:2.0:1787338713.946716:0:7647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787338713.946719:0:7647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c1c82 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x7c4a6181 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338713.946725:0:7647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c1c82 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x7c4a6181 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338713.946847:0:7647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc280e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+56:10546:x1874160192116864:12345-192.168.201.53@tcp:36:lhsmtool_posix.0 Request processed in 2777us (4063us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787338713.946857:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 117 00000100:00100000:1.0:1787338713.952969:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338713.953248:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192116992 00000100:00100000:3.0:1787338713.953259:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192116992 00000100:00100000:3.0:1787338713.953306:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 118 00000100:00100000:3.0:1787338713.953315:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf4115c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+56:10546:x1874160192116992:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787338713.953335:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787338713.953361:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c1c89 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab83b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338713.953400:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4c00/0x83671231080c1c90 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338713.953414:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4c00/0x83671231080c1c90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338713.953425:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4c00/0x83671231080c1c90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338713.953549:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c1c89 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab83b expref: 58 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338713.953581:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4c00/0x83671231080c1c90 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab83b expref: 57 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338713.953589:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff90bbd38d6b00) 00010000:00010000:3.0:1787338713.953592:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787338713.953603:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf7ea4c00, rc 0) 00000100:00100000:3.0:1787338713.953702:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf4115c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+57:10546:x1874160192116992:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 Request processed in 388us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338713.953710:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 118 00000100:00100000:1.0:1787338713.988600:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338713.989589:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192117248 00000100:00100000:2.0:1787338713.989608:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192117248 00000100:00100000:2.0:1787338713.989687:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 119 00000100:00100000:2.0:1787338713.989698:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf4115f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+57:10546:x1874160192117248:12345-192.168.201.53@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787338713.989784:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c1c97 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338713.989801:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c1c97 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338713.989827:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c1c97 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787338713.990654:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:2.0:1787338713.990668:0:5839:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 366831793106ns, next at 367831789146ns, rc = 0 00000004:00010000:2.0:1787338713.990769:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000074581f0f reply state 000000007b936b30 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c1c97 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338713.990779:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787338713.991017:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf4115f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+59:10546:x1874160192117248:12345-192.168.201.53@tcp:36:lhsmtool_posix.0 Request processed in 1318us (2442us total) trans 4294967399 rc 0/0 00000100:00100000:2.0:1787338713.991025:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 119 00000100:00100000:1.0:1787338714.004279:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338714.004440:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192117376 00000100:00100000:0.0:1787338714.004451:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192117376 00000100:00100000:0.0:1787338714.004516:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 120 00000100:00100000:0.0:1787338714.004527:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf4117b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+59:10546:x1874160192117376:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787338714.004551:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787338714.004581:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c1c9e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab842 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338714.004679:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c1c9e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab842 expref: 60 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338714.004695:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c1c9e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab842 expref: 60 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338714.004716:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff90bbd38d6b00) 00010000:00010000:0.0:1787338714.004720:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787338714.004724:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbc0030800, rc 0) 00000100:00100000:0.0:1787338714.004785:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf4117b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+60:10546:x1874160192117376:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 Request processed in 260us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338714.004793:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 120 00010000:00010000:3.0:1787338714.007756:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c1c97 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338714.007773:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c1c97 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338714.007781:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c1c97 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338714.007787:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e2c00 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:3.0:1787338714.007792:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c1c97 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338714.007800:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c1c97 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338714.007818:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff90bbd38d6b00) 00010000:00010000:3.0:1787338714.007822:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787338714.007825:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c1c97 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338714.007849:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c1c97 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338714.009174:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338714.009346:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192117504 00000100:00100000:0.0:1787338714.009357:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192117504 00000100:00100000:0.0:1787338714.009444:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 37 00000100:00100000:0.0:1787338714.009455:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf4117800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:83642291-0761-4205-9531-7fd25bc2d48e+8:2358:x1874160192117504:12345-192.168.201.53@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1787338714.010028:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf4117800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:83642291-0761-4205-9531-7fd25bc2d48e+9:2358:x1874160192117504:12345-192.168.201.53@tcp:2:lhsmtool_posix.0 Request processed in 574us (859us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1787338714.010037:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 37 00000100:00080000:2.0:1787338714.010781:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787338714.015176:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338714.015327:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192117760 00000100:00100000:2.0:1787338714.015338:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192117760 00000100:00100000:2.0:1787338714.015401:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 30 00000100:00100000:2.0:1787338714.015411:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf4116d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:83642291-0761-4205-9531-7fd25bc2d48e+59:10546:x1874160192117760:12345-192.168.201.53@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787338714.015960:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf4116d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:83642291-0761-4205-9531-7fd25bc2d48e+60:10546:x1874160192117760:12345-192.168.201.53@tcp:35:lhsmtool_posix.0 Request processed in 548us (795us total) trans 4294967400 rc 0/0 00000100:00100000:2.0:1787338714.015969:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 30 00000100:00100000:3.0:1787338714.020998:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338714.021615:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192118016 00000100:00100000:2.0:1787338714.021628:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192118016 00000100:00100000:2.0:1787338714.021713:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 121 00000100:00100000:2.0:1787338714.021725:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc283100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+60:10546:x1874160192118016:12345-192.168.201.53@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787338714.021855:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc283100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+60:10546:x1874160192118016:12345-192.168.201.53@tcp:57:lhsmtool_posix.0 Request processed in 132us (865us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338714.021933:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 121 00000100:00100000:2.0:1787338714.025606:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338714.025763:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192118144 00000100:00100000:0.0:1787338714.025774:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192118144 00000100:00100000:0.0:1787338714.025831:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 122 00000100:00100000:0.0:1787338714.025843:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbff8fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+60:10546:x1874160192118144:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787338714.025862:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787338714.025950:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031800/0x83671231080c1ca5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab849 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338714.026021:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031400/0x83671231080c1cac lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338714.026034:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031400/0x83671231080c1cac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338714.026055:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031400/0x83671231080c1cac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787338714.026100:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787338714.026119:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031400/0x83671231080c1cac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338714.026145:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031800/0x83671231080c1ca5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab849 expref: 62 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338714.026163:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031400/0x83671231080c1cac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab849 expref: 61 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338714.026173:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff90bbd38d6b00) 00010000:00010000:0.0:1787338714.026176:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787338714.026180:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbc0031400, rc 0) 00000100:00100000:0.0:1787338714.026251:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbff8fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+61:10546:x1874160192118144:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 Request processed in 409us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338714.026258:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 122 00000100:00100000:2.0:1787338714.032764:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338714.032869:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192118272 00000100:00100000:1.0:1787338714.032896:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192118272 00000100:00100000:1.0:1787338714.033071:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 38 00000100:00100000:1.0:1787338714.033093:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbff8ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:83642291-0761-4205-9531-7fd25bc2d48e+9:2357:x1874160192118272:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787338714.033119:0:6689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787338714.033142:0:6689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009813027c/0x83671231080c1cb3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab850 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787338714.033173:0:6689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a889fd9, blocks: 0x1 00010000:00010000:1.0:1787338714.033197:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=366s v=(0 0) 00010000:00010000:1.0:1787338714.033202:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787338714.033219:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009813027c/0x83671231080c1cb3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab850 expref: 10 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338714.033555:0:6689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009813027c/0x83671231080c1cb3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab850 expref: 10 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338714.033604:0:6689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbfbe9c000, rc 0) 00000100:00100000:1.0:1787338714.033676:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbff8ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:83642291-0761-4205-9531-7fd25bc2d48e+10:2357:x1874160192118272:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 Request processed in 595us (924us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338714.033683:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 38 00000100:00100000:3.0:1787338714.037744:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338714.037928:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192118528 00000100:00100000:2.0:1787338714.037939:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192118528 00000100:00100000:2.0:1787338714.037988:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 123 00000100:00100000:2.0:1787338714.037998:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc123480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+61:10546:x1874160192118528:12345-192.168.201.53@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787338714.038136:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc123480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+61:10546:x1874160192118528:12345-192.168.201.53@tcp:57:lhsmtool_posix.0 Request processed in 139us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338714.038145:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 123 00000100:00100000:2.0:1787338714.042577:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338714.042728:0:10743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192118656 00000100:00100000:3.0:1787338714.042738:0:10743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192118656 00000100:00100000:3.0:1787338714.042799:0:10743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 39 00000100:00100000:3.0:1787338714.042811:0:10743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf7eae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:83642291-0761-4205-9531-7fd25bc2d48e+10:10546:x1874160192118656:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787338714.042829:0:10743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787338714.042848:0:10743:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088b888d5/0x83671231080c1cba lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab857 expref: -99 pid: 10743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338714.042909:0:10743:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009813027c/0x83671231080c1cb3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab850 expref: 11 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338714.042988:0:10743:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787338714.042995:0:10743:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787338714.043001:0:10743:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088b888d5/0x83671231080c1cba lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab857 expref: 11 pid: 10743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338714.043040:0:10743:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009813027c/0x83671231080c1cb3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab850 expref: 11 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338714.043054:0:10743:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009813027c/0x83671231080c1cb3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab850 expref: 11 pid: 6689 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338714.043161:0:10743:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc120700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10743:1874160212052352:192.168.201.53@tcp:104: 00000100:00100000:3.0:1787338714.043511:0:10743:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc67a6180 going to sleep for 11 seconds 00000100:00100000:3.0:1787338714.047821:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338714.047936:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192118784 00000100:00100000:0.0:1787338714.047946:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192118784 00010000:00010000:0.0:1787338714.047998:0:6704:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009813027c/0x83671231080c1cb3 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab850 expref: 12 pid: 6689 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338714.048041:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 55 00000100:00100000:0.0:1787338714.048052:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc121c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:83642291-0761-4205-9531-7fd25bc2d48e+12:2358:x1874160192118784:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787338714.048067:0:6704:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787338714.048098:0:6704:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009813027c/0x83671231080c1cb3 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab850 expref: 12 pid: 6689 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338714.048121:0:6704:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009813027c/0x83671231080c1cb3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab850 expref: 12 pid: 6689 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338714.048146:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787338714.048151:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787338714.048159:0:6704:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000088b888d5/0x83671231080c1cba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab857 expref: 12 pid: 10743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338714.048169:0:6704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088b888d5/0x83671231080c1cba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab857 expref: 12 pid: 10743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338714.048216:0:6704:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000088b888d5/0x83671231080c1cba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab857 expref: 12 pid: 10743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338714.048493:0:6704:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbd17edc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6704:1874160212052480:192.168.201.53@tcp:105: 00000100:00100000:0.0:1787338714.048590:0:6704:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbf43d86c0 going to sleep for 11 seconds 00010000:00010000:2.0:1787338714.050182:0:10743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009813027c/0x83671231080c1cb3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab850 expref: 12 pid: 6689 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338714.050323:0:10743:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc120700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10743:1874160212052352:192.168.201.53@tcp:104: 00010000:00010000:2.0:1787338714.050354:0:10743:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000088b888d5/0x83671231080c1cba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab857 expref: 11 pid: 10743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338714.050371:0:10743:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf7ea5800, rc 0) 00000100:00100000:2.0:1787338714.050505:0:10743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf7eae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:83642291-0761-4205-9531-7fd25bc2d48e+11:10546:x1874160192118656:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 Request processed in 7695us (7935us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338714.050513:0:10743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 39 00000100:00100000:3.0:1787338714.058012:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338714.058218:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192118912 00000100:00100000:2.0:1787338714.058235:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192118912 00002000:00100000:2.0:1787338714.058303:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff90bbfc123800 x1874160192118912/t0(0) o4->83642291-0761-4205-9531-7fd25bc2d48e@192.168.201.53@tcp:45/0 lens 504/0 e 0 to 0 dl 1787338725 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787338714.058314:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90bbfc123800 with x1874160192118912 ext(0->12) 00002000:00010000:2.0:1787338714.058319:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90bbfc123800 00000100:00100000:2.0:1787338714.058353:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 2 00000100:00100000:2.0:1787338714.058365:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc123800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:83642291-0761-4205-9531-7fd25bc2d48e+11:2359:x1874160192118912:12345-192.168.201.53@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787338714.059041:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc123800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:83642291-0761-4205-9531-7fd25bc2d48e+13:2359:x1874160192118912:12345-192.168.201.53@tcp:4:lhsmtool_posix.0 Request processed in 675us (1035us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1787338714.059050:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 2 00002000:00100000:2.0:1787338714.059057:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff90bbfc123800 x1874160192118912/t4294967308(0) o4->83642291-0761-4205-9531-7fd25bc2d48e@192.168.201.53@tcp:45/0 lens 504/448 e 0 to 0 dl 1787338725 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787338714.059066:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90bbfc123800 with x1874160192118912 ext(0->12) 00002000:00010000:2.0:1787338714.059071:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90bbfc123800 00000100:00100000:0.0:1787338714.059453:0:6704:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbd17edc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6704:1874160212052480:192.168.201.53@tcp:105: 00010000:00010000:0.0:1787338714.059489:0:6704:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787338714.059515:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc121c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:83642291-0761-4205-9531-7fd25bc2d48e+12:2358:x1874160192118784:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 11465us (11704us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338714.059523:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 55 00000100:00100000:1.0:1787338714.064539:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338714.064827:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192119040 00000100:00100000:0.0:1787338714.064837:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192119040 00000100:00100000:0.0:1787338714.065012:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 124 00000100:00100000:0.0:1787338714.065024:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf4114a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+61:10546:x1874160192119040:12345-192.168.201.53@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1787338714.135781:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967398 is committed 00000020:00080000:2.0:1787338714.135822:0:5861:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90bbf41c1f00 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:2.0:1787338714.135828:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90bbf4183e00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90bbf41c1b40 00000020:00080000:2.0:1787338714.135831:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90bbf4183f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90bbff900800 00000020:00080000:1.0:1787338714.136452:0:5872:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 2 committed batchid 0 00000020:00080000:2.0:1787338714.136752:0:5861:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000001:00080000:2.0:1787338714.136761:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:2.0:1787338714.136769:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000004:00080000:2.0:1787338714.136818:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:2.0:1787338714.136834:0:5861:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90bbedc57a80 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:2.0:1787338714.136839:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90bbffd56b00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90bbedc57840 00000020:00080000:2.0:1787338714.136842:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90bbffd56f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90bbedc45c00 00000004:00080000:2.0:1787338714.136897:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:1.0:1787338714.137333:0:5872:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:1.0:1787338714.137358:0:5872:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1787338714.137738:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbd17efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874160212052864:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787338714.137842:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338714.138208:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212052864 00000100:00100000:0.0:1787338714.138217:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212052864 00000100:00100000:0.0:1787338714.138352:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787338714.138363:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbd17ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3316:x1874160212052864:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787338714.138490:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbd17edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874160212052736:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1787338714.138533:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338714.138562:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787338714.138569:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbd17edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874160212052608:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787338714.138604:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338714.138631:0:10743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212052736 00000100:00100000:2.0:1787338714.138646:0:10743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212052736 00000100:00100000:2.0:1787338714.138669:0:10743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212052608 00000100:00100000:2.0:1787338714.138672:0:10743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212052608 00000100:00100000:2.0:1787338714.138684:0:10743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787338714.138691:0:10743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc95e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3315:x1874160212052736:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1787338714.138830:0:10743:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1787338714.138834:0:10743:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787338714 00002000:00010000:2.0:1787338714.138836:0:10743:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787338714.138838:0:10743:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1787338713 -> 1787338714 00002000:00010000:2.0:1787338714.138840:0:10743:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1787338714.138914:0:10743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc95e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3315:x1874160212052736:12345-0@lo:2:osp-syn-0-0.0 Request processed in 223us (380us total) trans 4294967309 rc 0/0 00002000:00080000:0.0:1787338714.139161:0:6691:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:0.0:1787338714.139188:0:6691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a889fd8, atime: 0x6a889fd8, ctime: 0x6a889fd8, blocks: 0x1 00010000:00010000:0.0:1787338714.139196:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049f56791/0x83671231080c1cc1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338714.139213:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=366s v=(0 0) 00010000:00010000:0.0:1787338714.139218:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00000100:00100000:2.0:1787338714.139305:0:10743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787338714.139325:0:10743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787338714.139332:0:10743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf7eafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3315:x1874160212052608:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1787338714.139345:0:10743:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:2.0:1787338714.139357:0:10743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006397681f/0x83671231080c1cc8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338714.139373:0:10743:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000884f449/0x83671231080c1a83 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab7b6 expref: 11 pid: 10743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338714.139454:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049f56791/0x83671231080c1cc1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338714.139475:0:6691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000049f56791/0x83671231080c1cc1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338714.139497:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049f56791/0x83671231080c1cc1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338714.139505:0:6691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000049f56791/0x83671231080c1cc1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338714.139521:0:6691:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787338714.139672:0:10743:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1787338714.139675:0:10743:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787338714.139679:0:10743:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006397681f/0x83671231080c1cc8 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338714.139712:0:10743:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000884f449/0x83671231080c1a83 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab7b6 expref: 11 pid: 10743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338714.139728:0:10743:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000884f449/0x83671231080c1a83 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab7b6 expref: 11 pid: 10743 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338714.139740:0:10743:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf7eaea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10743:1874160212052992:192.168.201.53@tcp:104: 00000100:00100000:2.0:1787338714.139812:0:10743:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbedd6b3c0 going to sleep for 11 seconds 00000004:00080000:2.0:1787338714.139854:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90bbd17edf80/2, rc 0, transno 4294967309 00000100:00100000:2.0:1787338714.139860:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbd17edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874160212052736:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1787338714.141054:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787338714.141065:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000049f56791/0x83671231080c1cc1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338714.141145:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbc0031800 already unused, calling callback (ffffffffc1546230) 00010000:00010000:1.0:1787338714.141151:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000049f56791/0x83671231080c1cc1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338714.141162:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000049f56791/0x83671231080c1cc1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338714.141180:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000049f56791/0x83671231080c1cc1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338714.141187:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049f56791/0x83671231080c1cc1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338714.141241:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338714.141243:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338714.141244:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787338714.142451:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787338714.142459:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787338714.142957:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbd17ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3316:x1874160212052864:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4591us (5110us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1787338714.142970:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787338714.143378:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf4114a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+15:10546:x1874160192119040:12345-192.168.201.53@tcp:44:lhsmtool_posix.0 Request processed in 78352us (78846us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338714.143399:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 124 00000100:00100000:3.0:1787338714.149406:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338714.149913:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192119168 00000100:00100000:2.0:1787338714.149934:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192119168 00000100:00100000:2.0:1787338714.149989:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 43 00000100:00100000:2.0:1787338714.149999:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc122d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:83642291-0761-4205-9531-7fd25bc2d48e+12:2358:x1874160192119168:12345-192.168.201.53@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1787338714.151034:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338714.151061:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192119296 00000100:00100000:2.0:1787338714.151066:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192119296 00010000:00010000:2.0:1787338714.151105:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000884f449/0x83671231080c1a83 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab7b6 expref: 13 pid: 10743 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338714.151611:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 56 00000100:00100000:2.0:1787338714.151622:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf7eae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:83642291-0761-4205-9531-7fd25bc2d48e+13:2358:x1874160192119296:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787338714.151646:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787338714.151654:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000884f449/0x83671231080c1a83 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab7b6 expref: 13 pid: 10743 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338714.151669:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000884f449/0x83671231080c1a83 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab7b6 expref: 13 pid: 10743 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338714.151696:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787338714.151700:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787338714.151706:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006397681f/0x83671231080c1cc8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 10743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338714.151716:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006397681f/0x83671231080c1cc8 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 10743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338714.151736:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787338714.151791:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf7eae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:83642291-0761-4205-9531-7fd25bc2d48e+13:2358:x1874160192119296:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 171us (761us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338714.151798:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 56 00010000:00010000:2.0:1787338714.151863:0:10743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000884f449/0x83671231080c1a83 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab7b6 expref: 12 pid: 10743 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338714.151931:0:10743:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf7eaea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10743:1874160212052992:192.168.201.53@tcp:104: 00010000:00010000:2.0:1787338714.151953:0:10743:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006397681f/0x83671231080c1cc8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338714.151964:0:10743:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006397681f/0x83671231080c1cc8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338714.151972:0:10743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006397681f/0x83671231080c1cc8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338714.151982:0:10743:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006397681f/0x83671231080c1cc8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338714.151990:0:10743:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006397681f/0x83671231080c1cc8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338714.152008:0:10743:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787338714.153979:0:10743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf7eafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3315:x1874160212052608:12345-0@lo:6:osp-syn-0-0.0 Request processed in 14641us (15368us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1787338714.153992:0:10743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00010000:2.0:1787338714.154025:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787338714.154033:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006397681f/0x83671231080c1cc8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338714.154058:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e2c00 already unused, calling callback (ffffffffc1546230) 00010000:00010000:2.0:1787338714.154063:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006397681f/0x83671231080c1cc8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338714.154072:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006397681f/0x83671231080c1cc8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338714.154101:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006397681f/0x83671231080c1cc8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338714.154108:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006397681f/0x83671231080c1cc8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338714.154131:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787338714.154133:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787338714.154135:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787338714.154174:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90bbd17edc00/2, rc 0, transno 4294967310 00000100:00100000:2.0:1787338714.154181:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbd17edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874160212052608:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1787338714.156808:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90bbd17efb80/2, rc 0, transno 4294967304 00000100:00100000:1.0:1787338714.156822:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbd17efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874160212052864:0@lo:6:osp-syn-1-0.0 00000001:00080000:1.0:1787338714.224182:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000001:00080000:1.0:1787338714.224515:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000100:00100000:2.0:1787338714.224788:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc122d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:83642291-0761-4205-9531-7fd25bc2d48e+8:2358:x1874160192119168:12345-192.168.201.53@tcp:16:lhsmtool_posix.0 Request processed in 74784us (75400us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338714.224800:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 43 00000100:00100000:2.0:1787338714.228327:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338714.228526:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192119552 00000100:00100000:3.0:1787338714.228537:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192119552 00000100:00100000:3.0:1787338714.228603:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 125 00000100:00100000:3.0:1787338714.228614:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf7eaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+15:10546:x1874160192119552:12345-192.168.201.53@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787338714.228679:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787338714.228709:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031400/0x83671231080c1cac lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab849 expref: 15 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338714.228730:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff90bbd38d6b00) 00010000:00010000:3.0:1787338714.228735:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787338714.228765:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4200/0x83671231080c1ccf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338714.228778:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4200/0x83671231080c1ccf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338714.228787:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4200/0x83671231080c1ccf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787338714.229370:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009d572387 reply state 00000000902bf503 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4200/0x83671231080c1ccf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338714.229382:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787338714.229536:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf7eaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+16:10546:x1874160192119552:12345-192.168.201.53@tcp:36:lhsmtool_posix.0 Request processed in 923us (1220us total) trans 4294967401 rc 0/0 00000100:00100000:3.0:1787338714.229545:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 125 00000100:00100000:2.0:1787338714.233130:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbed9caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874160212053120:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787338714.233206:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338714.233559:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212053120 00000100:00100000:2.0:1787338714.233567:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212053120 00000100:00100000:2.0:1787338714.233703:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787338714.233713:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbed9ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3317:x1874160212053120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787338714.233736:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787338714.233781:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbed9ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3317:x1874160212053120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338714.233789:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787338714.233838:0:3317:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:2.0:1787338714.233844:0:3317:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967305 00000100:00100000:2.0:1787338714.233871:0:3317:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff90bbd17edf80 x1874160212052736/t4294967309(4294967309) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1787338730 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787338714.233909:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbed9caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874160212053120:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787338714.235810:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00010000:00010000:0.0:1787338714.235904:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4200/0x83671231080c1ccf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338714.235927:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4200/0x83671231080c1ccf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338714.235936:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4200/0x83671231080c1ccf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338714.235943:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea4200 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:0.0:1787338714.235948:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4200/0x83671231080c1ccf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338714.235954:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4200/0x83671231080c1ccf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338714.235971:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff90bbd38d6b00) 00010000:00010000:0.0:1787338714.235974:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787338714.235989:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4200/0x83671231080c1ccf lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338714.235996:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4200/0x83671231080c1ccf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338714.236753:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192119680 00000100:00100000:3.0:1787338714.236764:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192119680 00000100:00100000:3.0:1787338714.236834:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 44 00000100:00100000:3.0:1787338714.236845:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbed9caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:83642291-0761-4205-9531-7fd25bc2d48e+8:2359:x1874160192119680:12345-192.168.201.53@tcp:2:lhsmtool_posix.0 00000001:00080000:1.0:1787338714.238481:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:1.0:1787338714.238498:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00002000:00010000:3.0:1787338714.238540:0:6691:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1787338714.238544:0:6691:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1787338714 -> 1787338712 00002000:00010000:3.0:1787338714.238547:0:6691:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787338712 00002000:00010000:3.0:1787338714.238549:0:6691:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1787338714 -> 1787338712 00002000:00010000:3.0:1787338714.238552:0:6691:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1787338714.238707:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbed9caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:83642291-0761-4205-9531-7fd25bc2d48e+7:2359:x1874160192119680:12345-192.168.201.53@tcp:2:lhsmtool_posix.0 Request processed in 1860us (2903us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1787338714.238716:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 44 00000100:00100000:3.0:1787338714.241838:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338714.242094:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192119936 00000100:00100000:2.0:1787338714.242104:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192119936 00000100:00100000:2.0:1787338714.242191:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 126 00000100:00100000:2.0:1787338714.242202:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc121880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+15:10546:x1874160192119936:12345-192.168.201.53@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1787338714.242286:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c1cd6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338714.242304:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4c00/0x83671231080c1c90 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab83b expref: 15 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338714.242313:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c1cd6 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338714.242352:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4c00/0x83671231080c1c90 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab83b expref: 15 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338714.242563:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4c00/0x83671231080c1c90 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab83b expref: 15 pid: 5840 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338714.242583:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf4101180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5841:1874160212053248:192.168.201.53@tcp:104: 00000100:00100000:2.0:1787338714.242696:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbedd6b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787338714.245834:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf4101180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5841:1874160212053248:192.168.201.53@tcp:104: 00010000:00010000:0.0:1787338714.245864:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c1cd6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338714.249046:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338714.249776:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192120064 00000100:00100000:1.0:1787338714.249789:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192120064 00010000:00010000:1.0:1787338714.249834:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4c00/0x83671231080c1c90 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab83b expref: 16 pid: 5840 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338714.249906:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 57 00000100:00100000:1.0:1787338714.249925:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc120700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:83642291-0761-4205-9531-7fd25bc2d48e+16:2359:x1874160192120064:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787338714.249940:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787338714.249948:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4c00/0x83671231080c1c90 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab83b expref: 16 pid: 5840 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338714.249963:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4c00/0x83671231080c1c90 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab83b expref: 16 pid: 5840 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338714.249985:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4c00/0x83671231080c1c90 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab83b expref: 16 pid: 5840 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338714.250018:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff90bbd38d6b00) 00010000:00010000:1.0:1787338714.250024:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c1cd6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338714.250043:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c1cd6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338714.250051:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c1cd6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338714.250341:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787338714.250473:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc120700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:83642291-0761-4205-9531-7fd25bc2d48e+15:2359:x1874160192120064:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 557us (1446us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338714.250482:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 57 00010000:00010000:2.0:1787338714.250828:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c1cd6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338714.250837:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c1cd6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338714.250864:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c1cd6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338714.250870:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c1cd6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338714.250924:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c1cd6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338714.250931:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e2600 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:2.0:1787338714.250936:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c1cd6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338714.250944:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c1cd6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338714.250958:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff90bbd38d6b00) 00010000:00010000:2.0:1787338714.250960:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1787338714.250973:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c1cd6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338714.250980:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c1cd6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338714.251044:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc121880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+14:10546:x1874160192119936:12345-192.168.201.53@tcp:55:lhsmtool_posix.0 Request processed in 8842us (9213us total) trans 0 rc -22/-22 00000100:00100000:2.0:1787338714.251052:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 126 00000100:00100000:3.0:1787338714.256302:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338714.256579:0:10743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192120192 00000100:00100000:2.0:1787338714.256591:0:10743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192120192 00000100:00100000:2.0:1787338714.256675:0:10743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 45 00000100:00100000:2.0:1787338714.256687:0:10743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:83642291-0761-4205-9531-7fd25bc2d48e+7:2358:x1874160192120192:12345-192.168.201.53@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787338714.256739:0:10743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006397681f/0x83671231080c1cdd lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338714.256761:0:10743:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000088b888d5/0x83671231080c1cba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab857 expref: 7 pid: 10743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338714.256770:0:10743:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1787338714.256775:0:10743:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787338714.256780:0:10743:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006397681f/0x83671231080c1cdd lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338714.256818:0:10743:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000088b888d5/0x83671231080c1cba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab857 expref: 7 pid: 10743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338714.256833:0:10743:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000088b888d5/0x83671231080c1cba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab857 expref: 7 pid: 10743 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338714.256865:0:10743:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf4103480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10743:1874160212053376:192.168.201.53@tcp:104: 00000100:00100000:2.0:1787338714.256988:0:10743:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbedd6bd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787338714.261745:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338714.261856:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192120320 00000100:00100000:0.0:1787338714.261867:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192120320 00010000:00010000:0.0:1787338714.261951:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000088b888d5/0x83671231080c1cba lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab857 expref: 8 pid: 10743 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338714.261986:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 58 00000100:00100000:0.0:1787338714.261996:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa49180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:83642291-0761-4205-9531-7fd25bc2d48e+8:2358:x1874160192120320:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787338714.262011:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787338714.262033:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000088b888d5/0x83671231080c1cba lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab857 expref: 8 pid: 10743 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338714.262047:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000088b888d5/0x83671231080c1cba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab857 expref: 8 pid: 10743 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338714.262086:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787338714.262091:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787338714.262097:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006397681f/0x83671231080c1cdd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 10743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338714.262126:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006397681f/0x83671231080c1cdd lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 10743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338714.262149:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787338714.262213:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa49180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:83642291-0761-4205-9531-7fd25bc2d48e+8:2358:x1874160192120320:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 218us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338714.262864:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 58 00010000:00010000:2.0:1787338714.263371:0:10743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088b888d5/0x83671231080c1cba lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab857 expref: 7 pid: 10743 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338714.263455:0:10743:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf4103480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10743:1874160212053376:192.168.201.53@tcp:104: 00010000:00010000:2.0:1787338714.263479:0:10743:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006397681f/0x83671231080c1cdd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338714.263489:0:10743:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006397681f/0x83671231080c1cdd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338714.263497:0:10743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006397681f/0x83671231080c1cdd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338714.263523:0:10743:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006397681f/0x83671231080c1cdd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338714.263531:0:10743:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006397681f/0x83671231080c1cdd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338714.263539:0:10743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006397681f/0x83671231080c1cdd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338714.263560:0:10743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e2c00 already unused, calling callback (ffffffffc1546230) 00010000:00010000:2.0:1787338714.263564:0:10743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006397681f/0x83671231080c1cdd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338714.263573:0:10743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006397681f/0x83671231080c1cdd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338714.263662:0:10743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006397681f/0x83671231080c1cdd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338714.263671:0:10743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006397681f/0x83671231080c1cdd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338714.263743:0:10743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:83642291-0761-4205-9531-7fd25bc2d48e+6:2358:x1874160192120192:12345-192.168.201.53@tcp:1:lhsmtool_posix.0 Request processed in 7058us (7456us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338714.263751:0:10743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 45 00000100:00100000:3.0:1787338714.271962:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338714.272420:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192120576 00000100:00100000:2.0:1787338714.272432:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192120576 00000100:00100000:2.0:1787338714.272495:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 127 00000100:00100000:2.0:1787338714.272507:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbef17b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+14:10546:x1874160192120576:12345-192.168.201.53@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787338714.272712:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c1ce4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338714.272732:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c1ce4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338714.272765:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c1ce4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338714.273015:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c1ceb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338714.273027:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c1c9e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab842 expref: 15 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338714.273046:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c1ceb lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338714.273091:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c1c9e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab842 expref: 15 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338714.273106:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c1c9e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab842 expref: 15 pid: 5840 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338714.273121:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf4103480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5839:1874160212053504:192.168.201.53@tcp:104: 00000100:00100000:2.0:1787338714.273521:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbedd6bd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787338714.277598:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338714.277855:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192120704 00000100:00100000:0.0:1787338714.277865:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192120704 00010000:00010000:0.0:1787338714.277955:0:6704:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c1c9e lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab842 expref: 16 pid: 5840 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338714.277988:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 59 00000100:00100000:0.0:1787338714.277998:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbef179880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:83642291-0761-4205-9531-7fd25bc2d48e+16:2359:x1874160192120704:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787338714.278012:0:6704:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787338714.278019:0:6704:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c1c9e lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab842 expref: 16 pid: 5840 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338714.278033:0:6704:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c1c9e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab842 expref: 16 pid: 5840 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338714.278055:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff90bbd38d6b00) 00010000:00010000:0.0:1787338714.278061:0:6704:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c1ceb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338714.278070:0:6704:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c1ceb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338714.278105:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c1ceb lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338714.278544:0:6704:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787338714.278747:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbef179880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:83642291-0761-4205-9531-7fd25bc2d48e+16:2359:x1874160192120704:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 749us (1157us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338714.278756:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 59 00010000:00010000:2.0:1787338714.278864:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c1c9e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab842 expref: 15 pid: 5840 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338714.278921:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf4103480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5839:1874160212053504:192.168.201.53@tcp:104: 00010000:00010000:2.0:1787338714.278945:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c1ceb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338714.280009:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c1ceb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338714.280044:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c1ceb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787338714.280824:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:2.0:1787338714.283816:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:2.0:1787338714.284585:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:2.0:1787338714.288834:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf4103480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5839:1874160212053632:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787338714.289565:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338714.289678:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbedd6ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1787338714.289809:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212053632 00000100:00100000:1.0:1787338714.289818:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212053632 00000100:00100000:1.0:1787338714.290070:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787338714.290093:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf4102d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5839:x1874160212053632:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787338714.290196:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf4102d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5839:x1874160212053632:12345-0@lo:1000:mdt00_000.0 Request processed in 105us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338714.290216:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787338714.290424:0:5839:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:2.0:1787338714.290430:0:5839:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90bbd17edf80, transno 4294967309 00000004:00080000:2.0:1787338714.290449:0:5839:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90bbd17edc00, transno 4294967310 00000100:00100000:2.0:1787338714.290458:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf4103480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5839:1874160212053632:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1787338714.291830:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:2.0:1787338714.293364:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf4103480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5839:1874160212053760:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787338714.293571:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338714.293732:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbedd6bd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787338714.293806:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212053760 00000100:00100000:3.0:1787338714.293822:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212053760 00000100:00100000:3.0:1787338714.293903:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787338714.293922:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf4103100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5839:x1874160212053760:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787338714.294677:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf4103100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5839:x1874160212053760:12345-0@lo:1000:mdt00_000.0 Request processed in 764us (1104us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1787338714.294687:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787338714.294950:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf4103480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5839:1874160212053760:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1787338714.295191:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c1ceb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338714.295367:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c1ceb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338714.295377:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c1ceb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338714.295488:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e2600 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:2.0:1787338714.295506:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c1ceb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338714.295515:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c1ceb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338714.295531:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff90bbd38d6b00) 00010000:00010000:2.0:1787338714.295535:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787338714.295539:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c1ceb lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338714.295546:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c1ceb lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338714.295580:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c1c2e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338714.295775:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c1c2e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338714.295784:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c1c2e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338714.295789:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea5400 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:2.0:1787338714.295792:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c1c2e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338714.295799:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c1c2e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338714.295809:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90bbeb14d700) 00010000:00010000:2.0:1787338714.295811:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787338714.295825:0:5839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c1c35 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab826 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338714.295837:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c1c35 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab826 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338714.295846:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c1c35 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab826 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338714.298666:0:5839:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c1c35 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab826 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338714.298694:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf4114380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5839:1874160212053888:192.168.201.53@tcp:105: 00000100:00100000:1.0:1787338714.298902:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc7c240c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787338714.313529:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338714.313760:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf4114380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5839:1874160212053888:192.168.201.53@tcp:105: 00010000:00010000:1.0:1787338714.313809:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c1c2e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338714.313819:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c1c2e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338714.313857:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d400/0x83671231080c1cf2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338714.313870:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d400/0x83671231080c1cf2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338714.313899:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d400/0x83671231080c1cf2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338714.313910:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d400/0x83671231080c1cf2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338714.313916:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d400/0x83671231080c1cf2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338714.313923:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d400/0x83671231080c1cf2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338714.313942:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbfbe9d400 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:1.0:1787338714.313946:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d400/0x83671231080c1cf2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338714.314144:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d400/0x83671231080c1cf2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338714.314157:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90bbeb14d700) 00010000:00010000:1.0:1787338714.314160:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787338714.314171:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d400/0x83671231080c1cf2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338714.314178:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d400/0x83671231080c1cf2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338714.314188:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c1ce4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338714.314194:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c1ce4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338714.314368:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c1ce4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338714.314377:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e2c00 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:1.0:1787338714.314380:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c1ce4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338714.314495:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c1ce4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338714.314505:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90bbeb14d700) 00010000:00010000:1.0:1787338714.314508:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787338714.314511:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c1ce4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338714.314517:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c1ce4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338714.315614:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbef17b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+18:10546:x1874160192120576:12345-192.168.201.53@tcp:57:lhsmtool_posix.0 Request processed in 43104us (43655us total) trans 4294967406 rc 0/0 00000100:00100000:1.0:1787338714.315627:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 127 00000020:00080000:1.0:1787338714.315654:0:5839:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1787338714.315754:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192120832 00000100:00100000:2.0:1787338714.315762:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192120832 00000100:00100000:2.0:1787338714.315807:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 31 00000100:00100000:2.0:1787338714.315816:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbef17b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:83642291-0761-4205-9531-7fd25bc2d48e+18:10545:x1874160192120832:12345-192.168.201.53@tcp:49:lfs.0 00000100:00100000:2.0:1787338714.315963:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbef17b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:83642291-0761-4205-9531-7fd25bc2d48e+18:10545:x1874160192120832:12345-192.168.201.53@tcp:49:lfs.0 Request processed in 148us (2444us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338714.315970:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 31 00000040:00080000:3.0:1787338714.316647:0:11692:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787338714.316652:0:11692:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787338714.317770:0:11692:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1787338714.317783:0:11692:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787338714.326471:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338714.326523:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338714.327938:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192121088 00000100:00100000:2.0:1787338714.327957:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192121088 00000100:00100000:2.0:1787338714.328020:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 32 00000100:00100000:2.0:1787338714.328043:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbd894c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:83642291-0761-4205-9531-7fd25bc2d48e+18:10546:x1874160192121088:12345-192.168.201.53@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787338714.330623:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192121344 00000100:00100000:3.0:1787338714.330645:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192121344 00000100:00100000:3.0:1787338714.330703:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 128 00000100:00100000:3.0:1787338714.330714:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbd17ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+20:10545:x1874160192121344:12345-192.168.201.53@tcp:58:lfs.0 00000040:00080000:3.0:1787338714.331145:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:3.0:1787338714.331252:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbd17ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+20:10545:x1874160192121344:12345-192.168.201.53@tcp:58:lfs.0 Request processed in 539us (4727us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338714.331260:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 128 00000004:00080000:2.0:1787338714.332996:0:5842:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787338714.333130:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:2.0:1787338714.333199:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c1cf9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338714.333218:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c1cf9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338714.333231:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c1cf9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338714.333249:0:5842:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c1cf9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338714.333256:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c1cf9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338714.333262:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c1cf9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338714.333289:0:5842:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787338714.333377:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbd894c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:83642291-0761-4205-9531-7fd25bc2d48e+20:10546:x1874160192121088:12345-192.168.201.53@tcp:35:lhsmtool_posix.0 Request processed in 5333us (6914us total) trans 4294967408 rc 0/0 00000100:00100000:2.0:1787338714.333387:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 32 00000020:00080000:2.0:1787338714.333391:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787338714.336736:0:11676:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787338714.336750:0:11676:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c1cf9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338714.336762:0:11676:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e2600 already unused, calling callback (ffffffffc1546230) 00010000:00010000:3.0:1787338714.336767:0:11676:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c1cf9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338714.336778:0:11676:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c1cf9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338714.336815:0:11676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff90bbdee56f00) 00010000:00010000:3.0:1787338714.336818:0:11676:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787338714.336822:0:11676:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c1cf9 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338714.336828:0:11676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c1cf9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338714.336851:0:11676:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338714.336853:0:11676:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338714.336854:0:11676:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787338714.434975:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338714.435194:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192121472 00000100:00100000:3.0:1787338714.435213:0:7647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192121472 00000100:00100000:3.0:1787338714.435265:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 129 00000100:00100000:3.0:1787338714.435276:0:7647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbd17eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+20:10548:x1874160192121472:12345-192.168.201.53@tcp:101:lfs.0 00010000:00010000:3.0:1787338714.435304:0:7647:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787338714.435325:0:7647:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5000/0x83671231080c1d00 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab85e expref: -99 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338714.435401:0:7647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5c00/0x83671231080c1d07 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338714.435416:0:7647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5c00/0x83671231080c1d07 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338714.435427:0:7647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5c00/0x83671231080c1d07 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338714.435444:0:7647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c1d0e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338714.435465:0:7647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c1d0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338714.435473:0:7647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c1d0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338714.435782:0:7647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4a00/0x83671231080c1d15 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338714.435795:0:7647:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c1c20 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab81f expref: 21 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338714.435804:0:7647:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4a00/0x83671231080c1d15 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338714.435836:0:7647:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c1c20 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab81f expref: 21 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338714.435851:0:7647:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c1c20 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab81f expref: 21 pid: 5841 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338714.435865:0:7647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbef17a300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7647:1874160212054016:192.168.201.53@tcp:104: 00000100:00100000:3.0:1787338714.436019:0:7647:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbedc57300 going to sleep for 11 seconds 00000100:00100000:0.0:1787338714.441617:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338714.441718:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192121728 00000100:00100000:1.0:1787338714.441729:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192121728 00000100:00100000:1.0:1787338714.441789:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 33 00000100:00100000:1.0:1787338714.441800:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbd17eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:83642291-0761-4205-9531-7fd25bc2d48e+22:5595:x1874160192121728:12345-192.168.201.53@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787338714.442103:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbd17eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:83642291-0761-4205-9531-7fd25bc2d48e+23:5595:x1874160192121728:12345-192.168.201.53@tcp:35:ldlm_bl.0 Request processed in 303us (495us total) trans 4294967409 rc 0/0 00000100:00100000:1.0:1787338714.442117:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 33 00000100:00100000:3.0:1787338714.443793:0:7647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbef17a300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7647:1874160212054016:192.168.201.53@tcp:104: 00010000:00010000:3.0:1787338714.443820:0:7647:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4a00/0x83671231080c1d15 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338714.445519:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338714.445655:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192121856 00000100:00100000:1.0:1787338714.445664:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192121856 00010000:00010000:1.0:1787338714.445707:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c1c20 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab81f expref: 23 pid: 5841 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338714.445799:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 60 00000100:00100000:1.0:1787338714.445810:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbde53e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:83642291-0761-4205-9531-7fd25bc2d48e+23:2359:x1874160192121856:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787338714.445824:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787338714.445831:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c1c20 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab81f expref: 23 pid: 5841 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338714.445845:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c1c20 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab81f expref: 23 pid: 5841 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338714.445868:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c1c20 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab81f expref: 23 pid: 5841 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338714.445933:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90bbeb14d700) 00010000:00010000:1.0:1787338714.445938:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4a00/0x83671231080c1d15 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338714.445972:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4a00/0x83671231080c1d15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338714.445979:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4a00/0x83671231080c1d15 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338714.446012:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787338714.446071:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbde53e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:83642291-0761-4205-9531-7fd25bc2d48e+22:2359:x1874160192121856:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 262us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338714.446092:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 60 00010000:00010000:3.0:1787338714.446181:0:7647:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4a00/0x83671231080c1d15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338714.446207:0:7647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4a00/0x83671231080c1d15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787338714.446251:0:7647:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1787338714.446256:0:7647:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787338714.446274:0:7647:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4a00/0x83671231080c1d15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338714.446287:0:7647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4a00/0x83671231080c1d15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338714.446297:0:7647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5c00/0x83671231080c1d07 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338714.446304:0:7647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5c00/0x83671231080c1d07 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338714.446312:0:7647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5c00/0x83671231080c1d07 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338714.446317:0:7647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea5c00 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:3.0:1787338714.446321:0:7647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5c00/0x83671231080c1d07 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338714.446329:0:7647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5c00/0x83671231080c1d07 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338714.446339:0:7647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff90bbdee56e00) 00010000:00010000:3.0:1787338714.446342:0:7647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787338714.446346:0:7647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5c00/0x83671231080c1d07 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338714.446363:0:7647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5c00/0x83671231080c1d07 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338714.446374:0:7647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c1d0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338714.446392:0:7647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c1d0e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338714.446398:0:7647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c1d0e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338714.446402:0:7647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea5a00 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:3.0:1787338714.446405:0:7647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c1d0e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338714.446412:0:7647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c1d0e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338714.446420:0:7647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff90bbd38d6800) 00010000:00010000:3.0:1787338714.446422:0:7647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787338714.446425:0:7647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c1d0e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338714.446431:0:7647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c1d0e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338714.446464:0:7647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5000/0x83671231080c1d00 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab85e expref: 22 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338714.446477:0:7647:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4a00/0x83671231080c1d15 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab85e expref: 21 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338714.446493:0:7647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90bbeb14d700) 00010000:00010000:3.0:1787338714.446495:0:7647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787338714.446498:0:7647:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf7ea4a00, rc 0) 00000100:00100000:3.0:1787338714.446524:0:7647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbd17eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+21:10548:x1874160192121472:12345-192.168.201.53@tcp:101:lfs.0 Request processed in 11250us (11559us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338714.446531:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 129 00000100:00100000:3.0:1787338714.744218:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787338714.745290:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf4114380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874160212054272:0@lo:400:kworker.0 00000100:00100000:2.0:1787338714.745364:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338714.745425:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf4114700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d79243c8-b367-45ff-8d76-fbaa4be8becb:3315:1874160212054144:0@lo:400:kworker.0 00000100:00100000:2.0:1787338714.745468:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338714.746125:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212054272 00000100:00100000:3.0:1787338714.746134:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212054272 00000100:00100000:3.0:1787338714.746187:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1787338714.746211:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf4101880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874160212054272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787338714.746280:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf4101880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874160212054272:12345-0@lo:400:kworker.0 Request processed in 84us (915us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338714.746288:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1787338714.746329:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf4114380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874160212054272:0@lo:400:kworker.0 00000100:00100000:2.0:1787338714.747644:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf4115180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874160212054400:0@lo:400:kworker.0 00000100:00100000:2.0:1787338714.747697:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338714.747765:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212054400 00000100:00100000:3.0:1787338714.747772:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212054400 00000100:00100000:3.0:1787338714.747824:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787338714.747834:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf4100a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874160212054400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787338714.748956:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212054144 00000100:00100000:0.0:1787338714.748966:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212054144 00000100:00100000:0.0:1787338714.749008:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1787338714.749018:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4089450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+19:3315:x1874160212054144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787338714.749081:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4089450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+19:3315:x1874160212054144:12345-0@lo:400:kworker.0 Request processed in 65us (3612us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338714.749089:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1787338714.749140:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf4114700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d79243c8-b367-45ff-8d76-fbaa4be8becb:3315:1874160212054144:0@lo:400:kworker.0 00000100:00100000:1.0:1787338714.749775:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbd17ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1874160212054528:0@lo:400:kworker.0 00000100:00100000:1.0:1787338714.749815:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338714.749852:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212054528 00000100:00100000:1.0:1787338714.749857:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212054528 00000100:00100000:1.0:1787338714.749922:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787338714.749930:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf4114700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1874160212054528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787338714.749978:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf4114700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1874160212054528:12345-0@lo:400:kworker.0 Request processed in 49us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338714.749985:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787338714.750014:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbd17ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1874160212054528:0@lo:400:kworker.0 00000100:00080000:1.0:1787338714.750048:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787338714.750346:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf4100a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874160212054400:12345-0@lo:400:kworker.0 Request processed in 2512us (2646us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338714.750354:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787338714.754112:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787338714.754134:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbd17ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874160212054656:0@lo:400:kworker.0 00000100:00100000:0.0:1787338714.754364:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338714.754465:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212054656 00000100:00100000:3.0:1787338714.754473:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212054656 00000100:00100000:3.0:1787338714.754532:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787338714.754550:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbd17ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3315:x1874160212054656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787338714.754609:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbd17ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3315:x1874160212054656:12345-0@lo:400:kworker.0 Request processed in 61us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338714.754616:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787338714.754673:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbd17ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874160212054656:0@lo:400:kworker.0 00000100:00100000:2.0:1787338714.756381:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf4115180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874160212054400:0@lo:400:kworker.0 00010000:00010000:2.0:1787338714.806189:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787338714.962361:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338714.962413:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338714.962439:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338714.962480:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338714.962511:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192122240 00000100:00100000:3.0:1787338714.962521:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192122240 00000100:00100000:3.0:1787338714.962576:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192122112 00000100:00100000:3.0:1787338714.962581:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192122112 00000100:00100000:3.0:1787338714.962605:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 64 00000100:00100000:3.0:1787338714.962615:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbef17a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:83642291-0761-4205-9531-7fd25bc2d48e+7:2357:x1874160192122240:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:3.0:1787338714.962832:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbef17a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:83642291-0761-4205-9531-7fd25bc2d48e+7:2357:x1874160192122240:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 177us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338714.962842:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 64 00000100:00100000:3.0:1787338714.962860:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 65 00000100:00100000:3.0:1787338714.962867:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbef179500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:83642291-0761-4205-9531-7fd25bc2d48e+6:2357:x1874160192122112:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:3.0:1787338714.962935:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbef179500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:83642291-0761-4205-9531-7fd25bc2d48e+6:2357:x1874160192122112:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 68us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338714.962953:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 65 00000100:00100000:3.0:1787338714.963093:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192122368 00000100:00100000:3.0:1787338714.963119:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192122368 00000100:00100000:3.0:1787338714.963202:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 143 00000100:00100000:3.0:1787338714.963264:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbef17bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e810cb1b-6993-4b6e-89c4-e8961cf35b35+5:2357:x1874160192122368:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:3.0:1787338714.963358:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbef17bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e810cb1b-6993-4b6e-89c4-e8961cf35b35+5:2357:x1874160192122368:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 113us (877us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338714.963403:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 143 00000100:00100000:2.0:1787338714.965550:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192121984 00000100:00100000:2.0:1787338714.965567:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192121984 00000100:00100000:2.0:1787338714.965645:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 291 00000100:00100000:2.0:1787338714.965656:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc408a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+13:2357:x1874160192121984:12345-192.168.201.53@tcp:400:kworker.0 00000100:00080000:1.0:1787338714.969690:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787338714.969700:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787338714.970318:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc408a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+13:2357:x1874160192121984:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 4653us (7957us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338714.970333:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 291 00000100:00100000:3.0:1787338715.254766:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787338715.254794:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbef178000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874160212054784:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787338715.254904:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338715.254978:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212054784 00000100:00100000:3.0:1787338715.254987:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212054784 00000100:00100000:3.0:1787338715.255174:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787338715.255266:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbef179880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1874160212054784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787338715.255308:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787338715.255361:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbef179880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1874160212054784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 176us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338715.255369:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787338715.255421:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbef178000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874160212054784:0@lo:13:osp-pre-1-0.0 00000040:00080000:1.0:1787338715.324384:0:11692:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787338715.324398:0:11692:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787338715.325751:0:11692:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1787338715.325763:0:11692:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787338715.325949:0:11692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf4114380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11692:1874160212054912:192.168.201.53@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787338715.327177:0:11692:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc7c24480 going to sleep for 11 seconds 00000100:00100000:0.0:1787338715.334732:0:11692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf4114380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11692:1874160212054912:192.168.201.53@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787338715.338781:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338715.340173:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192122496 00000100:00100000:1.0:1787338715.340186:0:7647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192122496 00000100:00100000:1.0:1787338715.340258:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 130 00000100:00100000:1.0:1787338715.340270:0:7647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbd17ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+21:10559:x1874160192122496:12345-192.168.201.53@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787338715.340306:0:7647:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787338715.340421:0:7647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbd17ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+21:10559:x1874160192122496:12345-192.168.201.53@tcp:53:lhsmtool_posix.0 Request processed in 152us (1648us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338715.340441:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 130 00000100:00080000:3.0:1787338715.340590:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787338715.345493:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338715.346362:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192122752 00000100:00100000:1.0:1787338715.346373:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192122752 00000100:00100000:0.0:1787338715.346533:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 131 00000100:00100000:0.0:1787338715.346546:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbef178000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+21:10559:x1874160192122752:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787338715.346565:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787338715.346585:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c1d1c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab865 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338715.346696:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031a00/0x83671231080c1d23 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338715.346712:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031a00/0x83671231080c1d23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338715.346725:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031a00/0x83671231080c1d23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787338715.346737:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1787338715.347218:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c1d1c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab865 expref: 24 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338715.347235:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031a00/0x83671231080c1d23 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab865 expref: 23 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338715.347243:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90bbeb14d700) 00010000:00010000:0.0:1787338715.347245:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787338715.347248:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbc0031a00, rc 0) 00000100:00100000:0.0:1787338715.347318:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbef178000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+23:10559:x1874160192122752:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 Request processed in 775us (1837us total) trans 4294967410 rc 0/0 00000100:00100000:0.0:1787338715.347325:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 131 00000100:00100000:2.0:1787338715.358175:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338715.358221:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338715.358259:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192123136 00000100:00100000:2.0:1787338715.358269:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192123136 00000100:00100000:2.0:1787338715.358342:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 9 00000100:00100000:2.0:1787338715.358354:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf4101180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:83642291-0761-4205-9531-7fd25bc2d48e+23:2358:x1874160192123136:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787338715.358373:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787338715.358405:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031a00/0x83671231080c1d23 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab865 expref: 23 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338715.358427:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90bbeb14d700) 00010000:00010000:2.0:1787338715.358433:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787338715.358491:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf4101180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:83642291-0761-4205-9531-7fd25bc2d48e+22:2358:x1874160192123136:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 139us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338715.358499:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 9 00000100:00100000:1.0:1787338715.359943:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192123008 00000100:00100000:1.0:1787338715.359955:0:7647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192123008 00000100:00100000:1.0:1787338715.360039:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 132 00000100:00100000:1.0:1787338715.360051:0:7647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf4100380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+22:10559:x1874160192123008:12345-192.168.201.53@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787338715.360154:0:7647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9cc00/0x83671231080c1d31 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338715.360173:0:7647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9cc00/0x83671231080c1d31 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338715.360186:0:7647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9cc00/0x83671231080c1d31 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338715.360423:0:7647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9cc00/0x83671231080c1d31 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338715.360431:0:7647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9cc00/0x83671231080c1d31 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338715.360447:0:7647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9cc00/0x83671231080c1d31 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338715.360453:0:7647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbfbe9cc00 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:1.0:1787338715.360457:0:7647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9cc00/0x83671231080c1d31 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338715.360466:0:7647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9cc00/0x83671231080c1d31 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338715.360478:0:7647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90bbeb14d700) 00010000:00010000:1.0:1787338715.360481:0:7647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787338715.360485:0:7647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9cc00/0x83671231080c1d31 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338715.360490:0:7647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9cc00/0x83671231080c1d31 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338715.362451:0:7647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf4100380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+23:10559:x1874160192123008:12345-192.168.201.53@tcp:57:lhsmtool_posix.0 Request processed in 2388us (4273us total) trans 4294967411 rc 0/0 00000100:00100000:1.0:1787338715.362466:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 132 00000040:00080000:0.0:1787338715.365297:0:11692:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787338715.365322:0:11692:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787338715.365966:0:11692:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1787338715.366780:0:11692:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787338715.381597:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338715.381690:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192123392 00000100:00100000:0.0:1787338715.381702:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192123392 00000100:00100000:0.0:1787338715.381766:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 34 00000100:00100000:0.0:1787338715.381779:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbef17b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:83642291-0761-4205-9531-7fd25bc2d48e+23:10559:x1874160192123392:12345-192.168.201.53@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787338715.382296:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbef17b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:83642291-0761-4205-9531-7fd25bc2d48e+24:10559:x1874160192123392:12345-192.168.201.53@tcp:35:lhsmtool_posix.0 Request processed in 517us (706us total) trans 4294967412 rc 0/0 00000100:00100000:0.0:1787338715.382306:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 34 00000040:00080000:1.0:1787338715.432162:0:12115:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787338715.432176:0:12115:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787338715.432228:0:12115:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1787338715.432233:0:12115:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787338715.682295:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338715.682460:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192123648 00000100:00100000:0.0:1787338715.682471:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192123648 00000100:00100000:0.0:1787338715.682533:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 133 00000100:00100000:0.0:1787338715.682543:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf4117480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+24:10572:x1874160192123648:12345-192.168.201.53@tcp:101:lfs.0 00010000:00010000:0.0:1787338715.682568:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787338715.682591:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c1d38 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab86c expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338715.682734:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031400/0x83671231080c1d3f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338715.682750:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031400/0x83671231080c1d3f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338715.682760:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031400/0x83671231080c1d3f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787338715.682770:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1787338715.682949:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c1d38 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab86c expref: 27 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338715.682983:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031400/0x83671231080c1d3f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab86c expref: 26 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338715.682992:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90bbeb14d700) 00010000:00010000:0.0:1787338715.682995:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787338715.682999:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbc0031400, rc 0) 00000100:00100000:0.0:1787338715.683067:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf4117480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+26:10572:x1874160192123648:12345-192.168.201.53@tcp:101:lfs.0 Request processed in 525us (783us total) trans 4294967413 rc 0/0 00000100:00100000:0.0:1787338715.683074:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 133 00000100:00100000:2.0:1787338715.688466:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338715.688564:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192123776 00000100:00100000:1.0:1787338715.688574:0:7647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192123776 00000100:00100000:1.0:1787338715.688641:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 134 00000100:00100000:1.0:1787338715.688666:0:7647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc121c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+26:10572:x1874160192123776:12345-192.168.201.53@tcp:54:lfs.0 00010000:00010000:1.0:1787338715.688731:0:7647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9cc00/0x83671231080c1d4d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338715.688750:0:7647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9cc00/0x83671231080c1d4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338715.688761:0:7647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9cc00/0x83671231080c1d4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338715.688787:0:7647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9cc00/0x83671231080c1d4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338715.688795:0:7647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9cc00/0x83671231080c1d4d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338715.688801:0:7647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9cc00/0x83671231080c1d4d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338715.688807:0:7647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbfbe9cc00 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:1.0:1787338715.688812:0:7647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9cc00/0x83671231080c1d4d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338715.688821:0:7647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9cc00/0x83671231080c1d4d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338715.688832:0:7647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90bbeb14d700) 00010000:00010000:1.0:1787338715.688835:0:7647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787338715.688840:0:7647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9cc00/0x83671231080c1d4d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338715.688846:0:7647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9cc00/0x83671231080c1d4d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338715.689137:0:7647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc121c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+26:10572:x1874160192123776:12345-192.168.201.53@tcp:54:lfs.0 Request processed in 471us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338715.689146:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 134 00010000:00010000:2.0:1787338715.830379:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787338715.883405:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338715.883688:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192123904 00000100:00100000:1.0:1787338715.883703:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192123904 00000100:00100000:1.0:1787338715.883770:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 46 00000100:00100000:1.0:1787338715.883783:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee083480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:83642291-0761-4205-9531-7fd25bc2d48e+6:2359:x1874160192123904:12345-192.168.201.53@tcp:101:cat.0 00010000:00010000:1.0:1787338715.883802:0:6689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787338715.883823:0:6689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000062c75baa/0x83671231080c1d54 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab873 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787338715.883852:0:6689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a889fd8, atime: 0x6a889fd8, ctime: 0x6a889fd8, blocks: 0xb 00010000:00010000:1.0:1787338715.883921:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=368s v=(0 0) 00010000:00010000:1.0:1787338715.883926:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787338715.883936:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000062c75baa/0x83671231080c1d54 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab873 expref: 7 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338715.883957:0:6689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000062c75baa/0x83671231080c1d54 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab873 expref: 7 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338715.883973:0:6689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbfbe9cc00, rc 0) 00000100:00100000:1.0:1787338715.884041:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee083480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:83642291-0761-4205-9531-7fd25bc2d48e+7:2359:x1874160192123904:12345-192.168.201.53@tcp:101:cat.0 Request processed in 261us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338715.884048:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 46 00000100:00100000:3.0:1787338715.887316:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338715.887470:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192124032 00000100:00100000:0.0:1787338715.887481:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192124032 00002000:00100000:0.0:1787338715.887535:0:6696:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff90bbee082680 x1874160192124032/t0(0) o3->83642291-0761-4205-9531-7fd25bc2d48e@192.168.201.53@tcp:46/0 lens 488/0 e 0 to 0 dl 1787338726 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787338715.887547:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90bbee082680 with x1874160192124032 ext(0->4095) 00002000:00010000:0.0:1787338715.887553:0:6696:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90bbee082680 00000100:00100000:0.0:1787338715.887590:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 3 00000100:00100000:0.0:1787338715.887600:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee082680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:83642291-0761-4205-9531-7fd25bc2d48e+7:2358:x1874160192124032:12345-192.168.201.53@tcp:3:cat.0 00000100:00100000:0.0:1787338715.890163:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee082680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:83642291-0761-4205-9531-7fd25bc2d48e+7:2358:x1874160192124032:12345-192.168.201.53@tcp:3:cat.0 Request processed in 2551us (2844us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787338715.890185:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 3 00002000:00100000:0.0:1787338715.890822:0:6696:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff90bbee082680 x1874160192124032/t0(0) o3->83642291-0761-4205-9531-7fd25bc2d48e@192.168.201.53@tcp:46/0 lens 488/4536 e 0 to 0 dl 1787338726 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787338715.890835:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90bbee082680 with x1874160192124032 ext(0->4095) 00002000:00010000:0.0:1787338715.890843:0:6696:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90bbee082680 00010000:00010000:0.0:1787338716.858988:0:11676:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787338716.911539:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:1.0:1787338716.911571:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00010000:00010000:2.0:1787338717.881835:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338718.903825:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787338719.353697:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc120700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874160212055040:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787338719.353762:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338719.355360:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212055040 00000100:00100000:2.0:1787338719.355372:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212055040 00000100:00100000:2.0:1787338719.355431:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787338719.355448:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc123100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3316:x1874160212055040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787338719.355484:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787338719.355564:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc123100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3316:x1874160212055040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (1801us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338719.355572:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:2.0:1787338719.355593:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787338719.355636:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc120700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874160212055040:0@lo:13:osp-pre-0-0.0 00000001:00080000:1.0:1787338719.435137:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:1.0:1787338719.435154:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000040:00080000:0.0:1787338719.483996:0:11692:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787338719.484009:0:11692:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787338719.484068:0:11692:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1787338719.484074:0:11692:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:2.0:1787338719.486949:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:2.0:1787338719.486981:0:5861:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:2.0:1787338719.486985:0:5861:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 2 batchid updated 00000020:00080000:2.0:1787338719.487013:0:5861:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90bbedd6ba80 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:2.0:1787338719.487019:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90bbc4cb3200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90bbedd6bcc0 00000020:00080000:2.0:1787338719.487023:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90bbc4cb3f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90bbee03fc00 00000020:00080000:2.0:1787338719.487058:0:5872:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:2.0:1787338719.487744:0:5872:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000100:00100000:0.0:1787338719.862819:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbd17ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1874160212055424:0@lo:400:kworker.0 00000100:00100000:1.0:1787338719.862898:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbd17ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874160212055296:0@lo:400:kworker.0 00000100:00100000:0.0:1787338719.862908:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338719.862968:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbd17ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1874160212055552:0@lo:400:kworker.0 00000100:00100000:2.0:1787338719.862968:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbd17ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d79243c8-b367-45ff-8d76-fbaa4be8becb:3317:1874160212055168:0@lo:400:kworker.0 00000100:00100000:1.0:1787338719.868642:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338719.868750:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212055424 00000100:00100000:1.0:1787338719.868762:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212055424 00000100:00100000:1.0:1787338719.868821:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212055296 00000100:00100000:1.0:1787338719.868824:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212055296 00000100:00100000:1.0:1787338719.868851:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787338719.868862:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbd17ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874160212055424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787338719.869250:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbd17ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874160212055424:12345-0@lo:400:kworker.0 Request processed in 388us (6340us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338719.869259:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787338719.869279:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787338719.869286:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf4116d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874160212055296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787338719.869323:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf4116d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874160212055296:12345-0@lo:400:kworker.0 Request processed in 38us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338719.869329:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787338719.869370:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbd17ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874160212055296:0@lo:400:kworker.0 00000100:00100000:0.0:1787338719.870588:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbd17ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1874160212055424:0@lo:400:kworker.0 00000100:00100000:2.0:1787338719.877418:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338719.877482:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbd17eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874160212055680:0@lo:400:kworker.0 00000100:00100000:2.0:1787338719.877529:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787338719.877600:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787338719.878178:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212055680 00000100:00100000:1.0:1787338719.878188:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212055680 00000100:00100000:1.0:1787338719.878269:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787338719.878282:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc120700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1874160212055680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787338719.878347:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338719.878355:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc120700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1874160212055680:12345-0@lo:400:kworker.0 Request processed in 77us (826us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338719.878363:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787338719.878381:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212055552 00000100:00100000:3.0:1787338719.878384:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212055552 00000100:00100000:3.0:1787338719.878414:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00080000:2.0:1787338719.878596:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787338719.878601:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787338719.878630:0:3317:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:2.0:1787338719.878637:0:3317:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:2.0:1787338719.878659:0:3317:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90bbd17efb80, transno 4294967304 00000100:00100000:3.0:1787338719.878695:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee081f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874160212055552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787338719.878738:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee081f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874160212055552:12345-0@lo:400:kworker.0 Request processed in 318us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338719.878745:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787338719.878758:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212055168 00000100:00100000:0.0:1787338719.878763:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212055168 00000100:00100000:3.0:1787338719.878775:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbd17ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1874160212055552:0@lo:400:kworker.0 00000100:00100000:0.0:1787338719.878800:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1787338719.878823:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbd17eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874160212055680:0@lo:400:kworker.0 00000100:00100000:0.0:1787338719.878899:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4089050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+19:3317:x1874160212055168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787338719.878954:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4089050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+19:3317:x1874160212055168:12345-0@lo:400:kworker.0 Request processed in 147us (1545us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338719.882834:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbd17ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d79243c8-b367-45ff-8d76-fbaa4be8becb:3317:1874160212055168:0@lo:400:kworker.0 00000100:00100000:0.0:1787338719.887348:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00010000:00010000:0.0:1787338719.926985:0:11676:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787338720.075861:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338720.075973:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338720.076024:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338720.076057:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338720.076085:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338720.076119:0:10743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192124544 00000100:00100000:2.0:1787338720.076133:0:10743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192124544 00000100:00100000:2.0:1787338720.076211:0:10743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192124416 00000100:00100000:2.0:1787338720.076215:0:10743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192124416 00000100:00100000:2.0:1787338720.076243:0:10743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 67 00000100:00100000:2.0:1787338720.076253:0:10743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc90c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:83642291-0761-4205-9531-7fd25bc2d48e+5:2358:x1874160192124544:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:2.0:1787338720.076324:0:10743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc90c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:83642291-0761-4205-9531-7fd25bc2d48e+5:2358:x1874160192124544:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 72us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338720.076332:0:10743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 67 00000100:00100000:2.0:1787338720.076349:0:10743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 68 00000100:00100000:2.0:1787338720.076355:0:10743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc90c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:83642291-0761-4205-9531-7fd25bc2d48e+6:2358:x1874160192124416:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:2.0:1787338720.076377:0:10743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc90c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:83642291-0761-4205-9531-7fd25bc2d48e+6:2358:x1874160192124416:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 23us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338720.076384:0:10743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 68 00000100:00100000:2.0:1787338720.076496:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192124288 00000100:00100000:2.0:1787338720.076500:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192124288 00000100:00100000:2.0:1787338720.076530:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192124672 00000100:00100000:2.0:1787338720.076545:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192124672 00000100:00100000:2.0:1787338720.076567:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 147 00000100:00100000:2.0:1787338720.076574:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc120e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+13:2358:x1874160192124288:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:2.0:1787338720.076616:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc120e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+13:2358:x1874160192124288:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 42us (768us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338720.076623:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 147 00000100:00100000:2.0:1787338720.076636:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 148 00000100:00100000:2.0:1787338720.076642:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc90c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e810cb1b-6993-4b6e-89c4-e8961cf35b35+5:2358:x1874160192124672:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:2.0:1787338720.076663:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc90c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e810cb1b-6993-4b6e-89c4-e8961cf35b35+5:2358:x1874160192124672:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 21us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338720.076669:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 148 00000100:00080000:2.0:1787338720.076708:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787338720.076713:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787338720.076715:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787338720.077053:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192124160 00000100:00100000:3.0:1787338720.077058:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192124160 00000100:00100000:3.0:1787338720.077127:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 293 00000100:00100000:3.0:1787338720.077136:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc408ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+13:2358:x1874160192124160:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:3.0:1787338720.077167:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc408ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+13:2358:x1874160192124160:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 33us (1143us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338720.077173:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 293 00000100:00100000:0.0:1787338720.374564:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee081180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874160212055808:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787338720.374642:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338720.375035:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212055808 00000100:00100000:3.0:1787338720.375044:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212055808 00000100:00100000:3.0:1787338720.375278:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787338720.375291:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbd17ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874160212055808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787338720.375326:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787338720.375389:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbd17ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874160212055808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (747us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338720.375396:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787338720.375697:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee081180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874160212055808:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787338720.954006:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787338721.425421:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338721.425461:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192124800 00000100:00100000:2.0:1787338721.425471:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192124800 00000100:00100000:2.0:1787338721.425532:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 135 00000100:00100000:2.0:1787338721.425544:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc90c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+13:10225:x1874160192124800:12345-192.168.201.53@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1787338721.425637:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc90c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+13:10225:x1874160192124800:12345-192.168.201.53@tcp:60:lhsmtool_posix.0 Request processed in 95us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338721.425645:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 135 00000100:00100000:0.0:1787338721.441427:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338721.441527:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192125056 00000100:00100000:3.0:1787338721.441536:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192125056 00000100:00100000:3.0:1787338721.441596:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 35 00000100:00100000:3.0:1787338721.441608:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbd17ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:83642291-0761-4205-9531-7fd25bc2d48e+13:10225:x1874160192125056:12345-192.168.201.53@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787338721.442128:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbd17ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:83642291-0761-4205-9531-7fd25bc2d48e+14:10225:x1874160192125056:12345-192.168.201.53@tcp:35:lhsmtool_posix.0 Request processed in 519us (708us total) trans 4294967414 rc 0/0 00000100:00100000:3.0:1787338721.442142:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 35 00000100:00100000:2.0:1787338721.698642:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338721.698867:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192125184 00000100:00100000:3.0:1787338721.699233:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192125184 00000100:00100000:3.0:1787338721.699300:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 136 00000100:00100000:3.0:1787338721.699311:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc90c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e810cb1b-6993-4b6e-89c4-e8961cf35b35+5:11025:x1874160192125184:12345-192.168.201.53@tcp:101:lsof.0 00010000:00010000:3.0:1787338721.699329:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787338721.699351:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c1d5b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab87a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338721.699416:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5000/0x83671231080c1d62 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338721.699431:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5000/0x83671231080c1d62 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338721.699444:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5000/0x83671231080c1d62 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787338721.699816:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787338721.699821:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1787338721.700007:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5000/0x83671231080c1d62 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338721.700034:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c1d5b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab87a expref: 7 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338721.700052:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5000/0x83671231080c1d62 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab87a expref: 6 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338721.700186:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90bbdee56300) 00010000:00010000:3.0:1787338721.700190:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787338721.700195:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf7ea5000, rc 0) 00000100:00100000:3.0:1787338721.700329:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc90c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e810cb1b-6993-4b6e-89c4-e8961cf35b35+6:11025:x1874160192125184:12345-192.168.201.53@tcp:101:lsof.0 Request processed in 1018us (1695us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338721.700336:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 136 00010000:00010000:3.0:1787338721.974405:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787338722.998678:0:11676:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787338724.022183:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787338724.471490:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787338724.471515:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee082d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874160212055936:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787338724.471593:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338724.471961:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212055936 00000100:00100000:0.0:1787338724.471970:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212055936 00000100:00100000:0.0:1787338724.472041:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787338724.472052:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee081180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874160212055936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787338724.472088:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787338724.472158:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee081180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874160212055936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338724.472166:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:0.0:1787338724.472188:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787338724.472593:0:3314:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:3.0:1787338724.472599:0:3314:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:3.0:1787338724.472628:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee082d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874160212055936:0@lo:13:osp-pre-0-0.0 00000020:00080000:2.0:1787338724.523682:0:5861:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000001:00080000:2.0:1787338724.523710:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:1.0:1787338724.523755:0:5872:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:1.0:1787338724.523768:0:5872:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1787338724.982894:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc90c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1874160212056320:0@lo:400:kworker.0 00000100:00100000:0.0:1787338724.983013:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc90c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d79243c8-b367-45ff-8d76-fbaa4be8becb:3316:1874160212056064:0@lo:400:kworker.0 00000100:00100000:0.0:1787338724.983076:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338724.983131:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc90c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874160212056576:0@lo:400:kworker.0 00000100:00100000:0.0:1787338724.983161:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338724.983187:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787338724.983192:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc90c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874160212056192:0@lo:400:kworker.0 00000100:00100000:0.0:1787338724.983215:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338724.983246:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212056064 00000100:00100000:0.0:1787338724.983253:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212056064 00000100:00100000:0.0:1787338724.983300:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1787338724.983310:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc408a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+19:3316:x1874160212056064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787338724.983503:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc408a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+19:3316:x1874160212056064:12345-0@lo:400:kworker.0 Request processed in 194us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338724.983511:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1787338724.983559:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc90c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d79243c8-b367-45ff-8d76-fbaa4be8becb:3316:1874160212056064:0@lo:400:kworker.0 00000100:00100000:0.0:1787338724.983600:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212056192 00000100:00100000:0.0:1787338724.983603:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212056192 00000100:00100000:0.0:1787338724.983631:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1787338724.983637:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbd17ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874160212056192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787338724.983672:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbd17ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874160212056192:12345-0@lo:400:kworker.0 Request processed in 35us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338724.983679:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1787338724.983711:0:10743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212056576 00000100:00100000:0.0:1787338724.983715:0:10743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212056576 00000100:00100000:0.0:1787338724.983747:0:10743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787338724.983754:0:10743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbd17efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1874160212056576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787338724.983785:0:10743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbd17efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1874160212056576:12345-0@lo:400:kworker.0 Request processed in 31us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338724.983791:0:10743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787338724.983809:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc90c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1874160212056448:0@lo:400:kworker.0 00000100:00100000:0.0:1787338724.983833:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338724.983870:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc90c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874160212056192:0@lo:400:kworker.0 00000100:00100000:0.0:1787338724.983905:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc90c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874160212056576:0@lo:400:kworker.0 00000100:00080000:0.0:1787338724.983923:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787338724.984153:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212056448 00000100:00100000:1.0:1787338724.984158:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212056448 00000100:00100000:1.0:1787338724.984189:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787338724.984196:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbd17eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874160212056448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787338724.984235:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbd17eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874160212056448:12345-0@lo:400:kworker.0 Request processed in 40us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338724.984241:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787338724.984270:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc90c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1874160212056448:0@lo:400:kworker.0 00000100:00080000:0.0:1787338724.985055:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787338724.985159:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338724.985290:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212056320 00000100:00100000:0.0:1787338724.985296:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212056320 00000100:00080000:1.0:1787338724.985419:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787338724.985529:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1787338724.985539:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc90c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874160212056320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787338724.985593:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc90c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874160212056320:12345-0@lo:400:kworker.0 Request processed in 57us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338724.985600:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1787338724.985667:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc90c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1874160212056320:0@lo:400:kworker.0 00010000:00010000:2.0:1787338725.046223:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787338725.201502:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338725.201541:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338725.201579:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338725.201601:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338725.201622:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338725.201647:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192125312 00000100:00100000:2.0:1787338725.201656:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192125312 00000100:00100000:2.0:1787338725.201717:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 295 00000100:00100000:2.0:1787338725.201728:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4088850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+13:2359:x1874160192125312:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:2.0:1787338725.201805:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4088850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+13:2359:x1874160192125312:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 78us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338725.201811:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 295 00000100:00100000:1.0:1787338725.202206:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192125440 00000100:00100000:1.0:1787338725.202210:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192125440 00000100:00100000:1.0:1787338725.202253:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192125824 00000100:00100000:1.0:1787338725.202256:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192125824 00000100:00100000:1.0:1787338725.202279:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 152 00000100:00100000:1.0:1787338725.202287:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc90c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+13:2359:x1874160192125440:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:1.0:1787338725.202326:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc90c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+13:2359:x1874160192125440:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 40us (835us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338725.202333:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 152 00000100:00100000:1.0:1787338725.202347:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 153 00000100:00100000:1.0:1787338725.202353:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc90c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e810cb1b-6993-4b6e-89c4-e8961cf35b35+6:2359:x1874160192125824:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:1.0:1787338725.202376:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc90c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e810cb1b-6993-4b6e-89c4-e8961cf35b35+6:2359:x1874160192125824:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 23us (753us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338725.202382:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 153 00000100:00100000:1.0:1787338725.202400:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192125696 00000100:00100000:1.0:1787338725.202413:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192125696 00000100:00100000:1.0:1787338725.202442:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192125568 00000100:00100000:1.0:1787338725.202456:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192125568 00000100:00100000:1.0:1787338725.202479:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 70 00000100:00100000:1.0:1787338725.202486:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc90c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:83642291-0761-4205-9531-7fd25bc2d48e+5:2359:x1874160192125696:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:1.0:1787338725.202513:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc90c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:83642291-0761-4205-9531-7fd25bc2d48e+5:2359:x1874160192125696:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 27us (971us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338725.202519:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 70 00000100:00100000:1.0:1787338725.202532:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 71 00000100:00100000:1.0:1787338725.202538:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc90c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:83642291-0761-4205-9531-7fd25bc2d48e+6:2359:x1874160192125568:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:1.0:1787338725.202563:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc90c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:83642291-0761-4205-9531-7fd25bc2d48e+6:2359:x1874160192125568:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 25us (961us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338725.202568:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 71 00000100:00080000:1.0:1787338725.202587:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787338725.202592:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787338725.202594:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787338725.495195:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787338725.495218:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee082d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874160212056704:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787338725.495283:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338725.495374:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212056704 00000100:00100000:2.0:1787338725.495385:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212056704 00000100:00100000:2.0:1787338725.495448:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787338725.495462:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf4103480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874160212056704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787338725.495497:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787338725.495553:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf4103480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874160212056704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338725.495560:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787338725.495677:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee082d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874160212056704:0@lo:13:osp-pre-1-0.0 00000001:02000400:1.0:1787338725.758496:0:12320:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 14:58:43 (1787338723) 00010000:00010000:0.0:1787338726.070286:0:11676:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787338727.094372:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787338727.179692:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338727.179916:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192126080 00000100:00100000:1.0:1787338727.179927:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192126080 00000100:00100000:1.0:1787338727.180017:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 137 00000100:00100000:1.0:1787338727.180029:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbd17ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+13:11290:x1874160192126080:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787338727.180052:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787338727.180074:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c1d69 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab881 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338727.180169:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c000/0x83671231080c1d70 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338727.180199:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c000/0x83671231080c1d70 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338727.180213:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c000/0x83671231080c1d70 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787338727.180489:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787338727.180746:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d400/0x83671231080c1d77 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338727.180757:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d400/0x83671231080c1d77 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338727.180766:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d400/0x83671231080c1d77 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338727.181571:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d000/0x83671231080c1d7e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338727.181585:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d000/0x83671231080c1d7e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338727.181593:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d000/0x83671231080c1d7e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787338727.181606:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1787338727.183535:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c000/0x83671231080c1d70 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338727.183562:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c000/0x83671231080c1d70 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338727.183570:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c000/0x83671231080c1d70 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338727.183589:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbfbe9c000 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:1.0:1787338727.183602:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c000/0x83671231080c1d70 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338727.183611:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c000/0x83671231080c1d70 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338727.183628:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff90bbd38d6200) 00010000:00010000:1.0:1787338727.183632:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787338727.183636:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c000/0x83671231080c1d70 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338727.183643:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c000/0x83671231080c1d70 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338727.183657:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d400/0x83671231080c1d77 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338727.185406:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d400/0x83671231080c1d77 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338727.185437:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d400/0x83671231080c1d77 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338727.185443:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbfbe9d400 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:1.0:1787338727.185447:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d400/0x83671231080c1d77 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338727.185455:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d400/0x83671231080c1d77 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338727.185490:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff90bbc2a93800) 00010000:00010000:1.0:1787338727.185493:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787338727.185498:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d400/0x83671231080c1d77 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338727.185504:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d400/0x83671231080c1d77 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338727.187576:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c1d69 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab881 expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338727.187603:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d000/0x83671231080c1d7e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab881 expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338727.187612:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90bbdee56100) 00010000:00010000:1.0:1787338727.187616:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787338727.187619:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbfbe9d000, rc 0) 00000100:00100000:1.0:1787338727.188465:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbd17ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+15:11290:x1874160192126080:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 Request processed in 8433us (8792us total) trans 4294967415 rc 0/0 00000100:00100000:1.0:1787338727.188476:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 137 00000100:00100000:2.0:1787338727.203353:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338727.203405:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338727.203557:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192126208 00000100:00100000:1.0:1787338727.203569:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192126208 00000100:00100000:1.0:1787338727.203640:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 138 00000100:00100000:1.0:1787338727.203651:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc90c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+15:11290:x1874160192126208:12345-192.168.201.53@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1787338727.203776:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc90c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+15:11290:x1874160192126208:12345-192.168.201.53@tcp:59:lhsmtool_posix.0 Request processed in 127us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338727.203784:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 138 00000100:00100000:3.0:1787338727.204020:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192126336 00000100:00100000:3.0:1787338727.204025:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192126336 00000100:00100000:3.0:1787338727.204069:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 10 00000100:00100000:3.0:1787338727.204084:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc90c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:83642291-0761-4205-9531-7fd25bc2d48e+15:2357:x1874160192126336:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787338727.204096:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787338727.204127:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d000/0x83671231080c1d7e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab881 expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338727.204160:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90bbdee56100) 00010000:00010000:3.0:1787338727.204165:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787338727.204186:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc90c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:83642291-0761-4205-9531-7fd25bc2d48e+14:2357:x1874160192126336:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 103us (781us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338727.204193:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 10 00000040:00080000:0.0:1787338727.670811:0:11692:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787338727.670821:0:11692:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787338727.671556:0:11692:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1787338727.671568:0:11692:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1787338728.119657:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787338729.142254:0:11676:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787338729.464073:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338729.464456:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192126464 00000100:00100000:1.0:1787338729.464467:0:7647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192126464 00000100:00080000:2.0:1787338729.464596:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787338729.464661:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 139 00000100:00100000:1.0:1787338729.464674:0:7647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc90c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+14:11332:x1874160192126464:12345-192.168.201.53@tcp:101:lfs.0 00010000:00010000:1.0:1787338729.464696:0:7647:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787338729.464717:0:7647:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9de00/0x83671231080c1d8c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab888 expref: -99 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338729.465127:0:7647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ca00/0x83671231080c1d93 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338729.465144:0:7647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ca00/0x83671231080c1d93 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338729.465159:0:7647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ca00/0x83671231080c1d93 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338729.465176:0:7647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c400/0x83671231080c1d9a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338729.465183:0:7647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c400/0x83671231080c1d9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338729.465190:0:7647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c400/0x83671231080c1d9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338729.465464:0:7647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ca00/0x83671231080c1d93 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338729.465473:0:7647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ca00/0x83671231080c1d93 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338729.465489:0:7647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ca00/0x83671231080c1d93 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338729.465496:0:7647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbfbe9ca00 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:1.0:1787338729.465500:0:7647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ca00/0x83671231080c1d93 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338729.465507:0:7647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ca00/0x83671231080c1d93 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338729.466686:0:7647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90bbdee56300) 00010000:00010000:1.0:1787338729.466693:0:7647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787338729.466699:0:7647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ca00/0x83671231080c1d93 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338729.466707:0:7647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ca00/0x83671231080c1d93 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338729.466723:0:7647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c400/0x83671231080c1d9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338729.467126:0:7647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c400/0x83671231080c1d9a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338729.467133:0:7647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c400/0x83671231080c1d9a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338729.467138:0:7647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbfbe9c400 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:1.0:1787338729.467142:0:7647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c400/0x83671231080c1d9a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338729.467161:0:7647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c400/0x83671231080c1d9a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338729.467173:0:7647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff90bbc2a93800) 00010000:00010000:1.0:1787338729.467176:0:7647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787338729.467179:0:7647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c400/0x83671231080c1d9a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338729.467185:0:7647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c400/0x83671231080c1d9a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338729.467228:0:7647:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9de00/0x83671231080c1d8c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab888 expref: 15 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338729.467239:0:7647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90bbdee56300) 00010000:00010000:1.0:1787338729.467242:0:7647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787338729.467245:0:7647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9de00/0x83671231080c1d8c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab888 expref: 15 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338729.467255:0:7647:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbfbe9de00, rc 0) 00000100:00100000:1.0:1787338729.467324:0:7647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc90c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+14:11332:x1874160192126464:12345-192.168.201.53@tcp:101:lfs.0 Request processed in 2653us (3260us total) trans 0 rc 301/301 00000100:00100000:1.0:1787338729.467333:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 139 00000100:00100000:2.0:1787338729.477331:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338729.477418:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192126720 00000100:00100000:0.0:1787338729.477428:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192126720 00000100:00100000:0.0:1787338729.477488:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 140 00000100:00100000:0.0:1787338729.477499:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc90c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+14:11332:x1874160192126720:12345-192.168.201.53@tcp:36:lfs.0 00010000:00010000:0.0:1787338729.477568:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787338729.477598:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3800/0x83671231080c170a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab6c1 expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338729.477620:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90bbdee56300) 00010000:00010000:0.0:1787338729.477626:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787338729.477952:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031800/0x83671231080c1da1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338729.477969:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5000/0x83671231080c1d62 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab87a expref: 5 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338729.478120:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031800/0x83671231080c1da1 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338729.478155:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5000/0x83671231080c1d62 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab87a expref: 5 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338729.478169:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5000/0x83671231080c1d62 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab87a expref: 5 pid: 5841 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338729.478183:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbd17ec700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5839:1874160212056832:192.168.201.53@tcp:104: 00000100:00100000:0.0:1787338729.478286:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc41123c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787338729.484164:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338729.484321:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbd17ec700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5839:1874160212056832:192.168.201.53@tcp:104: 00010000:00010000:0.0:1787338729.484359:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031800/0x83671231080c1da1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338729.484480:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192126848 00000100:00100000:3.0:1787338729.484488:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192126848 00010000:00010000:3.0:1787338729.484589:0:6704:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5000/0x83671231080c1d62 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab87a expref: 6 pid: 5841 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787338729.484823:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787338729.485408:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 61 00000100:00100000:3.0:1787338729.485422:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc90c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e810cb1b-6993-4b6e-89c4-e8961cf35b35+6:2358:x1874160192126848:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787338729.485438:0:6704:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787338729.485446:0:6704:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5000/0x83671231080c1d62 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab87a expref: 6 pid: 5841 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338729.485462:0:6704:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5000/0x83671231080c1d62 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab87a expref: 6 pid: 5841 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338729.485484:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5000/0x83671231080c1d62 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab87a expref: 6 pid: 5841 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338729.485499:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90bbdee56300) 00010000:00010000:3.0:1787338729.485505:0:6704:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031800/0x83671231080c1da1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338729.485525:0:6704:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031800/0x83671231080c1da1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338729.485532:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031800/0x83671231080c1da1 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338729.485569:0:6704:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787338729.485623:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc90c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e810cb1b-6993-4b6e-89c4-e8961cf35b35+5:2358:x1874160192126848:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 204us (1470us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338729.485631:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 61 00010000:00010000:1.0:1787338729.486138:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031800/0x83671231080c1da1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338729.486147:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031800/0x83671231080c1da1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338729.486178:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9de00/0x83671231080c1da8 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338729.486187:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9de00/0x83671231080c1da8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338729.486195:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9de00/0x83671231080c1da8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787338729.495824:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1787338729.495843:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031800/0x83671231080c1da1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338729.495853:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031800/0x83671231080c1da1 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338729.495861:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031800/0x83671231080c1da1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338729.495866:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbc0031800 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:1.0:1787338729.495871:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031800/0x83671231080c1da1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338729.495902:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031800/0x83671231080c1da1 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338729.495917:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90bbdee56300) 00010000:00010000:1.0:1787338729.495920:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787338729.495925:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031800/0x83671231080c1da1 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338729.495942:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031800/0x83671231080c1da1 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787338729.495965:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000456c18ab reply state 000000001707709b transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9de00/0x83671231080c1da8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338729.495974:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787338729.496074:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc90c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+15:11332:x1874160192126720:12345-192.168.201.53@tcp:36:lfs.0 Request processed in 18573us (18748us total) trans 4294967416 rc 0/0 00000100:00100000:1.0:1787338729.496083:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 140 00010000:00010000:3.0:1787338729.506664:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9de00/0x83671231080c1da8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338729.506685:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9de00/0x83671231080c1da8 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338729.506693:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9de00/0x83671231080c1da8 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338729.506700:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbfbe9de00 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:3.0:1787338729.506706:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9de00/0x83671231080c1da8 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338729.506714:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9de00/0x83671231080c1da8 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338729.506733:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff90bbc2a93800) 00010000:00010000:3.0:1787338729.506736:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787338729.506742:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9de00/0x83671231080c1da8 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338729.506767:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9de00/0x83671231080c1da8 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338729.605733:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbd17ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874160212056960:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787338729.605813:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338729.607032:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212056960 00000100:00100000:3.0:1787338729.607045:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212056960 00000100:00100000:3.0:1787338729.607136:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787338729.607147:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfbc98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874160212056960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787338729.607182:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787338729.607261:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfbc98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874160212056960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (1448us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338729.607269:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:3.0:1787338729.607480:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787338729.607524:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbd17ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874160212056960:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787338729.612990:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338729.613182:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192126976 00000100:00100000:0.0:1787338729.613193:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192126976 00000100:00100000:0.0:1787338729.613267:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 141 00000100:00100000:0.0:1787338729.613280:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf4101500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+14:11340:x1874160192126976:12345-192.168.201.53@tcp:101:lctl.0 00010000:00010000:0.0:1787338729.613311:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787338729.613337:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c1daf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab88f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338729.613421:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031800/0x83671231080c1db6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338729.613437:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031800/0x83671231080c1db6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338729.613450:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031800/0x83671231080c1db6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787338729.613670:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787338729.613674:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1787338729.613764:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031800/0x83671231080c1db6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338729.613791:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c1daf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab88f expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338729.613819:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031800/0x83671231080c1db6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab88f expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338729.613830:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90bbeb14d900) 00010000:00010000:0.0:1787338729.613833:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787338729.613836:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbc0031800, rc 0) 00000100:00100000:0.0:1787338729.613928:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf4101500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+15:11340:x1874160192126976:12345-192.168.201.53@tcp:101:lctl.0 Request processed in 650us (947us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338729.613936:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 141 00000001:00080000:0.0:1787338729.668715:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000100:00100000:2.0:1787338729.699238:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338729.699363:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192127104 00000100:00100000:0.0:1787338729.699385:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192127104 00000100:00100000:0.0:1787338729.699453:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 142 00000100:00100000:0.0:1787338729.699466:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc90c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+13:11345:x1874160192127104:12345-192.168.201.53@tcp:101:bash.0 00010000:00010000:0.0:1787338729.699490:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787338729.699514:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c1dbd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab896 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338729.699599:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c1dc4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338729.699617:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c1dc4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338729.699630:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c1dc4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338729.699666:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c1dcb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338729.699675:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c1dcb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338729.699682:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c1dcb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338729.700121:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031a00/0x83671231080c1dd2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338729.700131:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031a00/0x83671231080c1dd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338729.700139:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031a00/0x83671231080c1dd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787338729.700216:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:0.0:1787338729.700221:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787338729.700286:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031a00/0x83671231080c1dd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338729.700299:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c1dc4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338729.700306:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c1dc4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338729.700313:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c1dc4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338729.700327:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbc0030800 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:0.0:1787338729.700332:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c1dc4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338729.700340:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c1dc4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338729.700353:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90bbeb14d900) 00010000:00010000:0.0:1787338729.700356:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787338729.700360:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c1dc4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338729.700378:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c1dc4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338729.700391:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c1dcb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338729.700398:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c1dcb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338729.700404:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c1dcb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338729.700409:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbc0031000 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:0.0:1787338729.700411:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c1dcb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338729.700417:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c1dcb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338729.700433:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff90bbeb14d300) 00010000:00010000:0.0:1787338729.700436:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787338729.700438:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c1dcb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338729.700444:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c1dcb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338729.700477:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c1dbd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab896 expref: 15 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338729.700490:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031a00/0x83671231080c1dd2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab896 expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338729.700497:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff90bbeb14d600) 00010000:00010000:0.0:1787338729.700499:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787338729.700502:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbc0031a00, rc 0) 00000100:00100000:0.0:1787338729.700565:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc90c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+14:11345:x1874160192127104:12345-192.168.201.53@tcp:101:bash.0 Request processed in 1101us (1338us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338729.700572:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 142 00000100:00100000:0.0:1787338729.704488:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338729.707532:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192127360 00000100:00100000:2.0:1787338729.707547:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192127360 00000100:00100000:2.0:1787338729.707632:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 143 00000100:00100000:2.0:1787338729.707645:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbd17ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+14:11345:x1874160192127360:12345-192.168.201.53@tcp:101:bash.0 00010000:00010000:2.0:1787338729.707669:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787338729.707691:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c1dd9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab89d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338729.708164:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c1de0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338729.708184:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c1de0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338729.708198:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c1de0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338729.708255:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3800/0x83671231080c1de7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338729.708263:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3800/0x83671231080c1de7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338729.708269:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3800/0x83671231080c1de7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787338729.710673:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:2.0:1787338729.712153:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c1dee lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338729.712176:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c1dee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338729.712188:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c1dee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338729.712223:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c1de0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338729.712231:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c1de0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338729.712237:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c1de0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338729.712244:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e2600 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:2.0:1787338729.712248:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c1de0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338729.712255:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c1de0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338729.712268:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff90bbeb14d600) 00010000:00010000:2.0:1787338729.712271:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787338729.712276:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c1de0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338729.712297:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c1de0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787338729.712313:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000080c11d5a reply state 0000000070867b9d transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3800/0x83671231080c1de7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338729.712322:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787338729.712356:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c1dd9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab89d expref: 17 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338729.712382:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c1dee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab89d expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338729.712390:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90bbdee56d00) 00010000:00010000:2.0:1787338729.712392:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787338729.712394:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf40e2c00, rc 0) 00000100:00100000:2.0:1787338729.712481:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbd17ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+17:11345:x1874160192127360:12345-192.168.201.53@tcp:101:bash.0 Request processed in 4837us (8006us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1787338729.712490:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 143 00000040:00080000:1.0:1787338729.718092:0:11692:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787338729.718104:0:11692:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787338729.718336:0:11692:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:1.0:1787338729.718343:0:11692:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787338729.719630:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00010000:00010000:0.0:1787338729.721706:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3800/0x83671231080c1de7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338729.721724:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3800/0x83671231080c1de7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338729.721732:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3800/0x83671231080c1de7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338729.721757:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e3800 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:0.0:1787338729.721762:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3800/0x83671231080c1de7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338729.721770:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3800/0x83671231080c1de7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338729.721789:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff90bbdee56600) 00010000:00010000:0.0:1787338729.721793:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787338729.721798:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3800/0x83671231080c1de7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338729.721803:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3800/0x83671231080c1de7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338729.724450:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192127488 00000100:00100000:2.0:1787338729.724466:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192127488 00000100:00100000:2.0:1787338729.724563:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 47 00000100:00100000:2.0:1787338729.724577:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf4117800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:83642291-0761-4205-9531-7fd25bc2d48e+5:2358:x1874160192127488:12345-192.168.201.53@tcp:101:bash.0 00010000:00010000:2.0:1787338729.724596:0:6689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787338729.724643:0:6689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000980ef004/0x83671231080c1dfc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab8a4 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787338729.724685:0:6689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787338729.724707:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=382s v=(0 0) 00010000:00010000:2.0:1787338729.724711:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787338729.724721:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000980ef004/0x83671231080c1dfc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab8a4 expref: 6 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338729.724742:0:6689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000980ef004/0x83671231080c1dfc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab8a4 expref: 6 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338729.724756:0:6689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf3c53a00, rc 0) 00000100:00100000:2.0:1787338729.724828:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf4117800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:83642291-0761-4205-9531-7fd25bc2d48e+6:2358:x1874160192127488:12345-192.168.201.53@tcp:101:bash.0 Request processed in 254us (5205us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338729.724835:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 47 00000100:00080000:0.0:1787338729.725123:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787338729.727615:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338729.727720:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192127616 00000100:00100000:1.0:1787338729.727730:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192127616 00000100:00100000:1.0:1787338729.727791:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 48 00000100:00100000:1.0:1787338729.727802:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf4100700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:83642291-0761-4205-9531-7fd25bc2d48e+6:11345:x1874160192127616:12345-192.168.201.53@tcp:101:bash.0 00010000:00010000:1.0:1787338729.727819:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787338729.727839:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000062af652d/0x83671231080c1e03 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab8ab expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338729.727919:0:6691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000980ef004/0x83671231080c1dfc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab8a4 expref: 7 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338729.727930:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787338729.727951:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787338729.727958:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062af652d/0x83671231080c1e03 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab8ab expref: 7 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338729.727997:0:6691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000980ef004/0x83671231080c1dfc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab8a4 expref: 7 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338729.728012:0:6691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000980ef004/0x83671231080c1dfc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab8a4 expref: 7 pid: 6689 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338729.728028:0:6691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf4115880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6691:1874160212057088:192.168.201.53@tcp:104: 00000100:00100000:1.0:1787338729.728128:0:6691:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbeb056c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787338729.732099:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338729.732230:0:6691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf4115880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6691:1874160212057088:192.168.201.53@tcp:104: 00000100:00100000:3.0:1787338729.732261:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192127744 00000100:00100000:3.0:1787338729.732271:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192127744 00010000:00010000:1.0:1787338729.732274:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000062af652d/0x83671231080c1e03 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab8ab expref: 7 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338729.732297:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbfbe9ca00, rc 0) 00010000:00010000:3.0:1787338729.732312:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000980ef004/0x83671231080c1dfc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab8a4 expref: 8 pid: 6689 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338729.732361:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 62 00000100:00100000:1.0:1787338729.732377:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf4100700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:83642291-0761-4205-9531-7fd25bc2d48e+8:11345:x1874160192127616:12345-192.168.201.53@tcp:101:bash.0 Request processed in 4566us (4760us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338729.732386:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc90c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:83642291-0761-4205-9531-7fd25bc2d48e+8:2359:x1874160192127744:12345-192.168.201.53@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787338729.732389:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 48 00010000:00010000:3.0:1787338729.732404:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787338729.732430:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000980ef004/0x83671231080c1dfc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab8a4 expref: 7 pid: 6689 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338729.732465:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000980ef004/0x83671231080c1dfc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab8a4 expref: 7 pid: 6689 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338729.732489:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000980ef004/0x83671231080c1dfc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab8a4 expref: 7 pid: 6689 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338729.732504:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787338729.732509:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787338729.732531:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000062af652d/0x83671231080c1e03 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab8ab expref: 6 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338729.732543:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062af652d/0x83671231080c1e03 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab8ab expref: 6 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338729.732582:0:5823:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000062af652d/0x83671231080c1e03 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab8ab expref: 6 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338729.732598:0:5823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf4103480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5823:1874160212057216:192.168.201.53@tcp:105: 00000100:00100000:3.0:1787338729.732670:0:5823:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbf42dd9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787338729.735518:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338729.735549:0:5823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf4103480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5823:1874160212057216:192.168.201.53@tcp:105: 00010000:00010000:3.0:1787338729.735573:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787338729.735623:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192128000 00000100:00100000:0.0:1787338729.735630:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192128000 00000100:00100000:3.0:1787338729.735636:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc90c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:83642291-0761-4205-9531-7fd25bc2d48e+6:2359:x1874160192127744:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 3254us (3548us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338729.735646:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 62 00000100:00100000:0.0:1787338729.735693:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 36 00000100:00100000:0.0:1787338729.735704:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc90c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:83642291-0761-4205-9531-7fd25bc2d48e+16:11345:x1874160192128000:12345-192.168.201.53@tcp:35:bash.0 00000100:00100000:0.0:1787338729.736070:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc90c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:83642291-0761-4205-9531-7fd25bc2d48e+17:11345:x1874160192128000:12345-192.168.201.53@tcp:35:bash.0 Request processed in 367us (563us total) trans 4294967418 rc 0/0 00000100:00100000:0.0:1787338729.736078:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 36 00000100:00100000:0.0:1787338729.822686:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338729.822793:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192128256 00000100:00100000:2.0:1787338729.822804:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192128256 00000100:00100000:2.0:1787338729.822916:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 144 00000100:00100000:2.0:1787338729.822928:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbd17ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+17:11356:x1874160192128256:12345-192.168.201.53@tcp:101:lfs.0 00010000:00010000:2.0:1787338729.822961:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787338729.822982:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c53c00/0x83671231080c1e0a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab8b2 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787338729.823101:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:2.0:1787338729.823386:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c53c00/0x83671231080c1e0a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab8b2 expref: 19 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338729.823414:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90bbeb14d900) 00010000:00010000:2.0:1787338729.823417:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787338729.823423:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c53c00/0x83671231080c1e0a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab8b2 expref: 19 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338729.823437:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf3c53c00, rc 0) 00000100:00100000:2.0:1787338729.823508:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbd17ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+18:11356:x1874160192128256:12345-192.168.201.53@tcp:101:lfs.0 Request processed in 581us (833us total) trans 4294967419 rc 301/301 00000100:00100000:2.0:1787338729.823656:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 144 00000100:00100000:1.0:1787338729.828433:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338729.828694:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192128512 00000100:00100000:0.0:1787338729.828704:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192128512 00000100:00100000:0.0:1787338729.828774:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 37 00000100:00100000:0.0:1787338729.828785:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf4115880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:83642291-0761-4205-9531-7fd25bc2d48e+18:11356:x1874160192128512:12345-192.168.201.53@tcp:35:lfs.0 00000100:00100000:0.0:1787338729.829220:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf4115880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:83642291-0761-4205-9531-7fd25bc2d48e+19:11356:x1874160192128512:12345-192.168.201.53@tcp:35:lfs.0 Request processed in 434us (793us total) trans 4294967420 rc 0/0 00000100:00100000:0.0:1787338729.829228:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 37 00000100:00100000:3.0:1787338729.916131:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338729.916535:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192128640 00000100:00100000:1.0:1787338729.916549:0:7647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192128640 00000100:00100000:1.0:1787338729.916618:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 145 00000100:00100000:1.0:1787338729.916628:0:7647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf4103480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+19:11362:x1874160192128640:12345-192.168.201.53@tcp:101:lfs.0 00010000:00010000:1.0:1787338729.916656:0:7647:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787338729.916687:0:7647:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c800/0x83671231080c1e18 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab8b9 expref: -99 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338729.916763:0:7647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9da00/0x83671231080c1e1f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338729.916778:0:7647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9da00/0x83671231080c1e1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338729.916790:0:7647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9da00/0x83671231080c1e1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787338729.916853:0:7647:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:1.0:1787338729.916857:0:7647:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787338729.916918:0:7647:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9da00/0x83671231080c1e1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338729.916959:0:7647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c800/0x83671231080c1e18 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab8b9 expref: 21 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338729.916978:0:7647:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9da00/0x83671231080c1e1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab8b9 expref: 20 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338729.916988:0:7647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff90bbeb14d600) 00010000:00010000:1.0:1787338729.916990:0:7647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787338729.916994:0:7647:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbfbe9da00, rc 0) 00000100:00100000:1.0:1787338729.917062:0:7647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf4103480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+20:11362:x1874160192128640:12345-192.168.201.53@tcp:101:lfs.0 Request processed in 435us (953us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338729.917069:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 145 00000100:00100000:1.0:1787338729.923431:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338729.923560:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192128896 00000100:00100000:0.0:1787338729.923571:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192128896 00000100:00100000:0.0:1787338729.923647:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 146 00000100:00100000:0.0:1787338729.923658:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf4114380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+20:11362:x1874160192128896:12345-192.168.201.53@tcp:101:lfs.0 00010000:00010000:0.0:1787338729.923680:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787338729.923704:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c1e26 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab8c0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338729.923814:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c1e2d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338729.923829:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c1e2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338729.923840:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c1e2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787338729.923852:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787338729.924429:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c1e26 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab8c0 expref: 23 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338729.924452:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c1e2d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab8c0 expref: 22 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338729.924461:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90bbdee56d00) 00010000:00010000:0.0:1787338729.924472:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787338729.924476:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbc0030400, rc 0) 00000100:00100000:0.0:1787338729.924553:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf4114380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+22:11362:x1874160192128896:12345-192.168.201.53@tcp:101:lfs.0 Request processed in 895us (1131us total) trans 4294967421 rc 0/0 00000100:00100000:0.0:1787338729.924560:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 146 00000100:00100000:0.0:1787338729.930403:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338729.930502:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192129152 00000100:00100000:1.0:1787338729.930513:0:7647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192129152 00000100:00100000:1.0:1787338729.930587:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 147 00000100:00100000:1.0:1787338729.930599:0:7647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbd17edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+22:11362:x1874160192129152:12345-192.168.201.53@tcp:101:lfs.0 00010000:00010000:1.0:1787338729.930637:0:7647:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787338729.930662:0:7647:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c800/0x83671231080c1e3b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab8c7 expref: -99 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338729.930771:0:7647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d200/0x83671231080c1e42 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338729.930788:0:7647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d200/0x83671231080c1e42 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338729.930800:0:7647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d200/0x83671231080c1e42 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787338729.930815:0:7647:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1787338729.931458:0:7647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c800/0x83671231080c1e3b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab8c7 expref: 25 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338729.931481:0:7647:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d200/0x83671231080c1e42 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab8c7 expref: 24 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338729.931491:0:7647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90bbdee56d00) 00010000:00010000:1.0:1787338729.931494:0:7647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787338729.931497:0:7647:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbfbe9d200, rc 0) 00000100:00100000:1.0:1787338729.931568:0:7647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbd17edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+24:11362:x1874160192129152:12345-192.168.201.53@tcp:101:lfs.0 Request processed in 971us (1176us total) trans 4294967422 rc 0/0 00000100:00100000:1.0:1787338729.931591:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 147 00000100:00100000:3.0:1787338729.941372:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338729.941420:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338729.941561:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192129408 00000100:00100000:2.0:1787338729.941571:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192129408 00000100:00100000:2.0:1787338729.941640:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 49 00000100:00100000:2.0:1787338729.941651:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbd172f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:83642291-0761-4205-9531-7fd25bc2d48e+6:2358:x1874160192129408:12345-192.168.201.53@tcp:1:lfs.0 00010000:00010000:2.0:1787338729.941699:0:6689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000433f254a/0x83671231080c1e50 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338729.941720:0:6689:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000062af652d/0x83671231080c1e03 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab8ab expref: 6 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338729.941729:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787338729.941741:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787338729.941746:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000433f254a/0x83671231080c1e50 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338729.941809:0:6689:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000062af652d/0x83671231080c1e03 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab8ab expref: 6 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338729.941830:0:6689:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000062af652d/0x83671231080c1e03 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab8ab expref: 6 pid: 6691 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338729.941846:0:6689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf7ed6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6689:1874160212057344:192.168.201.53@tcp:104: 00000100:00100000:2.0:1787338729.942378:0:6689:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbf41c1e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787338729.942656:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192129280 00000100:00100000:0.0:1787338729.942664:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192129280 00000100:00100000:0.0:1787338729.942724:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 11 00000100:00100000:0.0:1787338729.942741:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbd172f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:83642291-0761-4205-9531-7fd25bc2d48e+24:2358:x1874160192129280:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787338729.942760:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787338729.942783:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c1e2d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab8c0 expref: 24 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338729.942802:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90bbdee56d00) 00010000:00010000:0.0:1787338729.942807:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787338729.942839:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbd172f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:83642291-0761-4205-9531-7fd25bc2d48e+23:2358:x1874160192129280:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 107us (1486us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338729.942847:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 11 00000100:00100000:0.0:1787338729.946475:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338729.946636:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192129536 00000100:00100000:3.0:1787338729.946646:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192129536 00002000:00100000:3.0:1787338729.946694:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff90bbd17edc00 x1874160192129536/t0(0) o4->83642291-0761-4205-9531-7fd25bc2d48e@192.168.201.53@tcp:60/0 lens 504/0 e 0 to 0 dl 1787338740 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787338729.946704:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90bbd17edc00 with x1874160192129536 ext(0->12) 00010000:00010000:3.0:1787338729.946713:0:6695:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000062af652d/0x83671231080c1e03 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab8ab expref: 7 pid: 6691 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338729.946729:0:6695:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000062af652d/0x83671231080c1e03 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab8ab expref: 7 pid: 6691 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787338729.946746:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90bbd17edc00 00000100:00100000:3.0:1787338729.946779:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 2 00000100:00100000:3.0:1787338729.946789:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbd17edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:83642291-0761-4205-9531-7fd25bc2d48e+7:2359:x1874160192129536:12345-192.168.201.53@tcp:4:lfs.0 00000100:00100000:2.0:1787338729.947137:0:6689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf7ed6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6689:1874160212057344:192.168.201.53@tcp:104: 00010000:00010000:2.0:1787338729.947162:0:6689:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000433f254a/0x83671231080c1e50 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338729.948343:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbd17edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:83642291-0761-4205-9531-7fd25bc2d48e+9:2359:x1874160192129536:12345-192.168.201.53@tcp:4:lfs.0 Request processed in 1549us (1872us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1787338729.948355:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 2 00002000:00100000:3.0:1787338729.948377:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff90bbd17edc00 x1874160192129536/t4294967305(0) o4->83642291-0761-4205-9531-7fd25bc2d48e@192.168.201.53@tcp:60/0 lens 504/448 e 0 to 0 dl 1787338740 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787338729.948386:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90bbd17edc00 with x1874160192129536 ext(0->12) 00010000:00010000:3.0:1787338729.948397:0:6695:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000062af652d/0x83671231080c1e03 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab8ab expref: 9 pid: 6691 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338729.948426:0:6695:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000062af652d/0x83671231080c1e03 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab8ab expref: 9 pid: 6691 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787338729.948433:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90bbd17edc00 00000100:00100000:0.0:1787338729.953250:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338729.953381:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192129664 00000100:00100000:2.0:1787338729.953394:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192129664 00010000:00010000:2.0:1787338729.953668:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000062af652d/0x83671231080c1e03 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab8ab expref: 9 pid: 6691 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338729.953751:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 63 00000100:00100000:2.0:1787338729.953774:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbd17ec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:83642291-0761-4205-9531-7fd25bc2d48e+9:2357:x1874160192129664:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787338729.953795:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1787338729.953821:0:5825:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1787338729.953824:0:5825:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787338729 00002000:00010000:2.0:1787338729.953826:0:5825:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787338729 00002000:00010000:2.0:1787338729.953828:0:5825:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1787338729 00010000:00010000:2.0:1787338729.953835:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000062af652d/0x83671231080c1e03 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab8ab expref: 9 pid: 6691 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338729.954129:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000062af652d/0x83671231080c1e03 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab8ab expref: 9 pid: 6691 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338729.954154:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000062af652d/0x83671231080c1e03 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab8ab expref: 9 pid: 6691 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338729.954171:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787338729.954175:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787338729.954181:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000433f254a/0x83671231080c1e50 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338729.954192:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000433f254a/0x83671231080c1e50 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338729.954274:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787338729.954336:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbd17ec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:83642291-0761-4205-9531-7fd25bc2d48e+8:2357:x1874160192129664:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 565us (1096us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338729.954344:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 63 00010000:00010000:1.0:1787338729.955888:0:6689:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000433f254a/0x83671231080c1e50 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338729.955907:0:6689:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000433f254a/0x83671231080c1e50 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338729.956051:0:6689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000433f254a/0x83671231080c1e50 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338729.956060:0:6689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000433f254a/0x83671231080c1e50 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338729.956068:0:6689:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000433f254a/0x83671231080c1e50 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338729.956074:0:6689:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf3c53c00 already unused, calling callback (ffffffffc1546230) 00010000:00010000:1.0:1787338729.956079:0:6689:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000433f254a/0x83671231080c1e50 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338729.956086:0:6689:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000433f254a/0x83671231080c1e50 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338729.956103:0:6689:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000433f254a/0x83671231080c1e50 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338729.956208:0:6689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000433f254a/0x83671231080c1e50 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338729.956314:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbd172f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:83642291-0761-4205-9531-7fd25bc2d48e+7:2358:x1874160192129408:12345-192.168.201.53@tcp:1:lfs.0 Request processed in 14661us (14889us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338729.956323:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 49 00000100:00100000:0.0:1787338729.958945:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338729.959413:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192129920 00000100:00100000:1.0:1787338729.959424:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192129920 00000100:00100000:1.0:1787338729.959494:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 38 00000100:00100000:1.0:1787338729.959505:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbd894c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:83642291-0761-4205-9531-7fd25bc2d48e+23:11362:x1874160192129920:12345-192.168.201.53@tcp:35:lfs.0 00000004:00010000:1.0:1787338729.959585:0:5843:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d200/0x83671231080c1e42 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab8c7 expref: 23 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787338729.959911:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:1.0:1787338729.959974:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:1.0:1787338729.960559:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:1.0:1787338729.960618:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c800/0x83671231080c1e57 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338729.960636:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c1dee lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab89d expref: 27 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338729.960644:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c800/0x83671231080c1e57 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338729.960682:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c1dee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab89d expref: 27 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338729.960709:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c1dee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab89d expref: 27 pid: 5841 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338729.960727:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf4115180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5843:1874160212057472:192.168.201.53@tcp:104: 00000100:00100000:1.0:1787338729.960819:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc818ca80 going to sleep for 11 seconds 00000100:00100000:1.0:1787338729.970059:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf4115180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5843:1874160212057472:192.168.201.53@tcp:104: 00010000:00010000:1.0:1787338729.970101:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c800/0x83671231080c1e57 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338729.970546:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338729.970683:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192130048 00000100:00100000:0.0:1787338729.970695:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192130048 00010000:00010000:0.0:1787338729.970758:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c1dee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab89d expref: 28 pid: 5841 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338729.970800:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 64 00000100:00100000:0.0:1787338729.970825:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbde53fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:83642291-0761-4205-9531-7fd25bc2d48e+28:2358:x1874160192130048:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787338729.970843:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787338729.970850:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c1dee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab89d expref: 28 pid: 5841 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338729.970862:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c1dee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab89d expref: 28 pid: 5841 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338729.970918:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c1dee lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab89d expref: 28 pid: 5841 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338729.970947:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90bbdee56d00) 00010000:00010000:0.0:1787338729.970952:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c800/0x83671231080c1e57 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338729.970963:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c800/0x83671231080c1e57 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338729.970970:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c800/0x83671231080c1e57 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338729.970990:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787338729.971045:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbde53fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:83642291-0761-4205-9531-7fd25bc2d48e+27:2358:x1874160192130048:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 221us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338729.971053:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 64 00010000:00010000:1.0:1787338729.971407:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c800/0x83671231080c1e57 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338729.971415:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c800/0x83671231080c1e57 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787338729.971557:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:1.0:1787338729.971787:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:1.0:1787338729.972215:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf4115180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5843:1874160212057600:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787338729.972272:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338729.972312:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc818c180 going to sleep for 11 seconds 00000100:00100000:2.0:1787338729.972396:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212057600 00000100:00100000:2.0:1787338729.972402:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212057600 00000100:00100000:2.0:1787338729.972459:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787338729.972468:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf7eae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5843:x1874160212057600:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787338729.972556:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf7eae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5843:x1874160212057600:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 89us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338729.972577:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:1.0:1787338729.972682:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787338729.972715:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf4115180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5843:1874160212057600:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1787338729.977868:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:1.0:1787338729.978153:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf4115180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5843:1874160212057728:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787338729.978225:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338729.978259:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc67a6180 going to sleep for 11 seconds 00000100:00100000:2.0:1787338729.978487:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212057728 00000100:00100000:2.0:1787338729.978494:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212057728 00000100:00100000:2.0:1787338729.978540:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787338729.978549:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5843:x1874160212057728:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787338729.978739:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5843:x1874160212057728:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 190us (512us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1787338729.978746:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787338729.978961:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf4115180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5843:1874160212057728:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1787338729.979013:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:0.0:1787338729.979048:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c800/0x83671231080c1e57 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338729.979063:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c800/0x83671231080c1e57 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338729.979071:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c800/0x83671231080c1e57 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338729.979078:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbfbe9c800 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:0.0:1787338729.979083:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c800/0x83671231080c1e57 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338729.979091:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c800/0x83671231080c1e57 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338729.979106:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90bbdee56d00) 00010000:00010000:0.0:1787338729.979109:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1787338729.979113:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c800/0x83671231080c1e57 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338729.979119:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c800/0x83671231080c1e57 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787338729.979274:0:5843:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1787338729.979414:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:0.0:1787338729.979425:0:5843:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 382820550570ns, next at 383820548098ns, rc = 0 00000001:00080000:0.0:1787338729.979431:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:0.0:1787338729.979457:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90bbdee56d00) 00010000:00010000:0.0:1787338729.979460:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787338729.979466:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d200/0x83671231080c1e42 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab8c7 expref: 31 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338729.979569:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbd894c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:83642291-0761-4205-9531-7fd25bc2d48e+30:11362:x1874160192129920:12345-192.168.201.53@tcp:35:lfs.0 Request processed in 20066us (20645us total) trans 4294967431 rc 0/0 00000100:00100000:0.0:1787338729.979577:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 38 00000020:00080000:0.0:1787338729.979581:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1787338729.982722:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338729.983139:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192130176 00000100:00100000:2.0:1787338729.983151:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192130176 00000100:00100000:2.0:1787338729.983214:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 148 00000100:00100000:2.0:1787338729.983225:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbd17eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+30:11362:x1874160192130176:12345-192.168.201.53@tcp:101:lfs.0 00010000:00010000:2.0:1787338729.983251:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787338729.983277:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c53800/0x83671231080c1e5e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab8ce expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338729.983339:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c53800/0x83671231080c1e5e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab8ce expref: 31 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338729.983354:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c53800/0x83671231080c1e5e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab8ce expref: 31 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338729.983387:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90bbdee56700) 00010000:00010000:2.0:1787338729.983391:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787338729.983395:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf3c53800, rc 0) 00000100:00100000:2.0:1787338729.983461:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbd17eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+31:11362:x1874160192130176:12345-192.168.201.53@tcp:101:lfs.0 Request processed in 237us (750us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338729.983483:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 148 00000100:00100000:3.0:1787338729.987038:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338729.987341:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192130432 00000100:00100000:0.0:1787338729.987350:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192130432 00000100:00100000:0.0:1787338729.987417:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 39 00000100:00100000:0.0:1787338729.987428:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbd172df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:83642291-0761-4205-9531-7fd25bc2d48e+31:11362:x1874160192130432:12345-192.168.201.53@tcp:35:lfs.0 00000100:00100000:0.0:1787338729.987652:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbd172df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:83642291-0761-4205-9531-7fd25bc2d48e+32:11362:x1874160192130432:12345-192.168.201.53@tcp:35:lfs.0 Request processed in 225us (622us total) trans 4294967432 rc 0/0 00000100:00100000:0.0:1787338729.987660:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 39 00000100:00100000:3.0:1787338730.096534:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338730.096646:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192130688 00000100:00100000:2.0:1787338730.096657:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192130688 00000100:00100000:2.0:1787338730.096719:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 149 00000100:00100000:2.0:1787338730.096730:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbd172dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+32:11372:x1874160192130688:12345-192.168.201.53@tcp:101:lfs.0 00010000:00010000:2.0:1787338730.096772:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787338730.096793:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52a00/0x83671231080c1e65 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab8d5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787338730.096948:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:2.0:1787338730.097066:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52a00/0x83671231080c1e65 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab8d5 expref: 34 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338730.097082:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90bbeb14d900) 00010000:00010000:2.0:1787338730.097086:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787338730.097091:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52a00/0x83671231080c1e65 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab8d5 expref: 34 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338730.097104:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf3c52a00, rc 0) 00000100:00100000:2.0:1787338730.097433:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbd172dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+33:11372:x1874160192130688:12345-192.168.201.53@tcp:101:lfs.0 Request processed in 703us (906us total) trans 4294967433 rc 301/301 00000100:00100000:2.0:1787338730.097441:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 149 00000100:00100000:2.0:1787338730.102135:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf7ed4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1874160212058112:0@lo:400:kworker.0 00000100:00100000:2.0:1787338730.102204:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338730.102267:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787338730.102274:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf7ed5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874160212057984:0@lo:400:kworker.0 00000100:00100000:2.0:1787338730.102314:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338730.102347:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212058112 00000100:00100000:2.0:1787338730.102355:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212058112 00000100:00100000:2.0:1787338730.102413:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212057984 00000100:00100000:2.0:1787338730.102417:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212057984 00000100:00100000:2.0:1787338730.102440:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1787338730.102449:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf7ed5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874160212058112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787338730.102500:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf7ed5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874160212058112:12345-0@lo:400:kworker.0 Request processed in 51us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338730.102507:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1787338730.102524:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787338730.102530:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf7ed5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874160212057984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787338730.102553:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf7ed5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874160212057984:12345-0@lo:400:kworker.0 Request processed in 24us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338730.102559:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787338730.102588:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf7ed5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874160212057984:0@lo:400:kworker.0 00000100:00100000:2.0:1787338730.102597:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf7ed4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1874160212058112:0@lo:400:kworker.0 00000100:00100000:1.0:1787338730.102767:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf7ed6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d79243c8-b367-45ff-8d76-fbaa4be8becb:3315:1874160212057856:0@lo:400:kworker.0 00000100:00100000:1.0:1787338730.102801:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338730.102826:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787338730.102832:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf7ed4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1874160212058240:0@lo:400:kworker.0 00000100:00100000:1.0:1787338730.102855:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338730.102905:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212057856 00000100:00100000:1.0:1787338730.102909:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212057856 00000100:00100000:1.0:1787338730.102938:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1787338730.102944:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4088050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+19:3315:x1874160212057856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787338730.102978:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4088050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+19:3315:x1874160212057856:12345-0@lo:400:kworker.0 Request processed in 34us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338730.102984:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00080000:1.0:1787338730.103010:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787338730.103026:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf7ed6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d79243c8-b367-45ff-8d76-fbaa4be8becb:3315:1874160212057856:0@lo:400:kworker.0 00000100:00100000:1.0:1787338730.103044:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212058240 00000100:00100000:1.0:1787338730.103047:0:7647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212058240 00000100:00100000:3.0:1787338730.105835:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338730.115586:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192130816 00000100:00100000:1.0:1787338730.115602:0:7647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192130816 00000100:00100000:1.0:1787338730.115683:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787338730.115694:0:7647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874160212058240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787338730.115817:0:7647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874160212058240:12345-0@lo:400:kworker.0 Request processed in 125us (12959us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338730.115824:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787338730.115844:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 150 00000100:00100000:1.0:1787338730.115852:0:7647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbd172d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+33:11372:x1874160192130816:12345-192.168.201.53@tcp:34:lfs.0 00000100:00100000:3.0:1787338730.115957:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf7ed4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1874160212058240:0@lo:400:kworker.0 00010000:00010000:1.0:1787338730.115968:0:7647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c600/0x83671231080c1e73 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338730.116000:0:7647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c600/0x83671231080c1e73 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338730.116013:0:7647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c600/0x83671231080c1e73 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338730.116030:0:7647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d200/0x83671231080c1e7a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338730.116038:0:7647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d200/0x83671231080c1e7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338730.116045:0:7647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d200/0x83671231080c1e7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787338730.116059:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787338730.116150:0:7647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c800/0x83671231080c1e81 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338730.116159:0:7647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c800/0x83671231080c1e81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338730.116165:0:7647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c800/0x83671231080c1e81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787338730.116204:0:7647:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c800/0x83671231080c1e81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338730.116216:0:7647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c600/0x83671231080c1e73 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338730.116223:0:7647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c600/0x83671231080c1e73 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338730.116240:0:7647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c600/0x83671231080c1e73 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338730.116561:0:7647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbfbe9c600 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:1.0:1787338730.116566:0:7647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c600/0x83671231080c1e73 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338730.116573:0:7647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c600/0x83671231080c1e73 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338730.116587:0:7647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff90bbeb14d600) 00010000:00010000:1.0:1787338730.116591:0:7647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787338730.116596:0:7647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c600/0x83671231080c1e73 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338730.116603:0:7647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c600/0x83671231080c1e73 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338730.116619:0:7647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d200/0x83671231080c1e7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338730.116625:0:7647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d200/0x83671231080c1e7a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338730.116630:0:7647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d200/0x83671231080c1e7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338730.116636:0:7647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbfbe9d200 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:1.0:1787338730.116639:0:7647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d200/0x83671231080c1e7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338730.116657:0:7647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d200/0x83671231080c1e7a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338730.116665:0:7647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff90bbc2a93a00) 00010000:00010000:1.0:1787338730.116668:0:7647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787338730.116671:0:7647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d200/0x83671231080c1e7a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338730.116677:0:7647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d200/0x83671231080c1e7a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338730.116692:0:7647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c800/0x83671231080c1e81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338730.116698:0:7647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c800/0x83671231080c1e81 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338730.116704:0:7647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c800/0x83671231080c1e81 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338730.116709:0:7647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbfbe9c800 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:1.0:1787338730.116711:0:7647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c800/0x83671231080c1e81 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338730.116718:0:7647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c800/0x83671231080c1e81 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338730.116724:0:7647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90bbdee56700) 00010000:00010000:1.0:1787338730.116726:0:7647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787338730.116729:0:7647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c800/0x83671231080c1e81 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338730.116744:0:7647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c800/0x83671231080c1e81 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338730.116817:0:7647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbd172d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+33:11372:x1874160192130816:12345-192.168.201.53@tcp:34:lfs.0 Request processed in 964us (10989us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338730.116824:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 150 00000100:00100000:3.0:1787338730.119287:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338730.119523:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192131072 00000100:00100000:0.0:1787338730.119532:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192131072 00000100:00100000:0.0:1787338730.119633:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 40 00000100:00100000:0.0:1787338730.119644:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbd172fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:83642291-0761-4205-9531-7fd25bc2d48e+33:11372:x1874160192131072:12345-192.168.201.53@tcp:35:lfs.0 00000100:00100000:0.0:1787338730.119958:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbd172fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:83642291-0761-4205-9531-7fd25bc2d48e+34:11372:x1874160192131072:12345-192.168.201.53@tcp:35:lfs.0 Request processed in 315us (678us total) trans 4294967434 rc 0/0 00000100:00100000:0.0:1787338730.119967:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 40 00010000:00010000:2.0:1787338730.166061:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787338730.166438:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338730.166540:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192131328 00000100:00100000:0.0:1787338730.166551:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192131328 00000100:00100000:0.0:1787338730.166655:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 151 00000100:00100000:0.0:1787338730.166667:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbd172d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+34:11375:x1874160192131328:12345-192.168.201.53@tcp:101:lfs.0 00010000:00010000:0.0:1787338730.166714:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787338730.166739:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c1e88 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab8dc expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338730.166835:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c1e8f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338730.166851:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c1e8f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338730.166861:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c1e8f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338730.166906:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c1e96 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338730.166914:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c1e96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338730.166920:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c1e96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338730.167049:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c1e9d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338730.167057:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c1e9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338730.167064:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c1e9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787338730.167073:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787338730.167175:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c1e8f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338730.167182:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c1e8f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338730.167189:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c1e8f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338730.167195:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbc0030400 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:0.0:1787338730.167200:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c1e8f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338730.167207:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c1e8f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338730.167220:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff90bbeb14d600) 00010000:00010000:0.0:1787338730.167223:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787338730.167228:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c1e8f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338730.167234:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c1e8f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338730.167247:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c1e96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338730.167253:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c1e96 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338730.167259:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c1e96 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338730.167274:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbc0031000 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:0.0:1787338730.167276:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c1e96 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338730.167280:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c1e96 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338730.167286:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff90bbeb14d300) 00010000:00010000:0.0:1787338730.167288:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787338730.167289:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c1e96 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338730.167293:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c1e96 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338730.167325:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c1e88 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab8dc expref: 37 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338730.167334:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c1e9d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab8dc expref: 36 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338730.167339:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90bbdee56700) 00010000:00010000:0.0:1787338730.167340:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787338730.167342:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbc0030800, rc 0) 00000100:00100000:0.0:1787338730.167521:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbd172d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+36:11375:x1874160192131328:12345-192.168.201.53@tcp:101:lfs.0 Request processed in 855us (1090us total) trans 4294967435 rc 0/0 00000100:00100000:0.0:1787338730.167528:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 151 00000100:00100000:3.0:1787338730.173296:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338730.175251:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192131456 00000100:00100000:1.0:1787338730.175266:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192131456 00000100:00100000:1.0:1787338730.175332:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 152 00000100:00100000:1.0:1787338730.175343:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbd172f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+36:11375:x1874160192131456:12345-192.168.201.53@tcp:54:lfs.0 00010000:00010000:1.0:1787338730.175444:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c800/0x83671231080c1eab lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338730.175462:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c800/0x83671231080c1eab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338730.175474:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c800/0x83671231080c1eab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338730.175506:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c800/0x83671231080c1eab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338730.175513:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c800/0x83671231080c1eab lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338730.175520:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c800/0x83671231080c1eab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338730.175526:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbfbe9c800 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:1.0:1787338730.175530:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c800/0x83671231080c1eab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338730.175554:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c800/0x83671231080c1eab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338730.175568:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90bbdee56700) 00010000:00010000:1.0:1787338730.175571:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787338730.175576:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c800/0x83671231080c1eab lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338730.175582:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c800/0x83671231080c1eab lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338730.175659:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbd172f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+36:11375:x1874160192131456:12345-192.168.201.53@tcp:54:lfs.0 Request processed in 318us (2373us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338730.175667:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 152 00000100:00100000:3.0:1787338730.178261:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338730.178443:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192131712 00000100:00100000:1.0:1787338730.178459:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192131712 00000100:00100000:1.0:1787338730.178540:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 41 00000100:00100000:1.0:1787338730.178551:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc91ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:83642291-0761-4205-9531-7fd25bc2d48e+36:11375:x1874160192131712:12345-192.168.201.53@tcp:35:lfs.0 00000100:00100000:1.0:1787338730.181827:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc91ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:83642291-0761-4205-9531-7fd25bc2d48e+37:11375:x1874160192131712:12345-192.168.201.53@tcp:35:lfs.0 Request processed in 3020us (3326us total) trans 4294967436 rc 0/0 00000100:00100000:1.0:1787338730.181843:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 41 00000100:00100000:3.0:1787338730.312656:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338730.312703:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338730.312740:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338730.312776:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338730.312798:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338730.312919:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192132096 00000100:00100000:1.0:1787338730.312932:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192132096 00000100:00100000:1.0:1787338730.312992:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192132224 00000100:00100000:1.0:1787338730.312995:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192132224 00000100:00100000:1.0:1787338730.313020:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 72 00000100:00100000:1.0:1787338730.313031:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc91dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:83642291-0761-4205-9531-7fd25bc2d48e+6:2357:x1874160192132096:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:1.0:1787338730.313118:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc91dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:83642291-0761-4205-9531-7fd25bc2d48e+6:2357:x1874160192132096:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 89us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338730.313127:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 72 00000100:00100000:1.0:1787338730.313144:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 73 00000100:00100000:1.0:1787338730.313151:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc91de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:83642291-0761-4205-9531-7fd25bc2d48e+7:2357:x1874160192132224:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:1.0:1787338730.313176:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc91de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:83642291-0761-4205-9531-7fd25bc2d48e+7:2357:x1874160192132224:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 25us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338730.313182:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 73 00000100:00100000:1.0:1787338730.313208:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192132352 00000100:00100000:1.0:1787338730.313211:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192132352 00000100:00100000:1.0:1787338730.313236:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192131968 00000100:00100000:1.0:1787338730.313239:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192131968 00000100:00100000:1.0:1787338730.313255:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 157 00000100:00100000:1.0:1787338730.313261:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc91ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e810cb1b-6993-4b6e-89c4-e8961cf35b35+5:2357:x1874160192132352:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:1.0:1787338730.313294:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc91ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e810cb1b-6993-4b6e-89c4-e8961cf35b35+5:2357:x1874160192132352:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 32us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338730.313300:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 157 00000100:00100000:1.0:1787338730.313311:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 158 00000100:00100000:1.0:1787338730.313318:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc91dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+37:2357:x1874160192131968:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:1.0:1787338730.313344:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc91dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+37:2357:x1874160192131968:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 27us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338730.313349:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 158 00000100:00100000:2.0:1787338730.313624:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192131840 00000100:00100000:2.0:1787338730.313629:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192131840 00000100:00100000:2.0:1787338730.313666:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 297 00000100:00100000:2.0:1787338730.313674:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4088450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+13:2357:x1874160192131840:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:2.0:1787338730.313702:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4088450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+13:2357:x1874160192131840:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 29us (1058us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338730.313708:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 297 00000100:00080000:3.0:1787338730.313910:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787338730.433908:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338730.434087:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192132608 00000100:00100000:1.0:1787338730.434096:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192132608 00000100:00100000:1.0:1787338730.434157:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 153 00000100:00100000:1.0:1787338730.434184:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc91de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+37:11406:x1874160192132608:12345-192.168.201.53@tcp:101:cat.0 00010000:00010000:1.0:1787338730.434206:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787338730.434228:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c800/0x83671231080c1eb2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab8e3 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338730.434335:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d200/0x83671231080c1eb9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338730.434348:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d200/0x83671231080c1eb9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338730.434391:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d200/0x83671231080c1eb9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787338730.434402:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1787338730.435098:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c800/0x83671231080c1eb2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab8e3 expref: 40 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338730.435118:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d200/0x83671231080c1eb9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab8e3 expref: 39 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338730.435127:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90bbdee56700) 00010000:00010000:1.0:1787338730.435130:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787338730.435133:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbfbe9d200, rc 0) 00000100:00100000:1.0:1787338730.435194:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc91de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+39:11406:x1874160192132608:12345-192.168.201.53@tcp:101:cat.0 Request processed in 1013us (1328us total) trans 4294967437 rc 0/0 00000100:00100000:1.0:1787338730.435202:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 153 00000100:00100000:3.0:1787338730.442497:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338730.442549:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338730.442623:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192132992 00000100:00100000:1.0:1787338730.442635:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192132992 00000100:00100000:1.0:1787338730.442712:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 12 00000100:00100000:1.0:1787338730.442721:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbed9c9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:83642291-0761-4205-9531-7fd25bc2d48e+39:2358:x1874160192132992:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787338730.442734:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787338730.442766:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d200/0x83671231080c1eb9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab8e3 expref: 39 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338730.442786:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90bbdee56700) 00010000:00010000:1.0:1787338730.442792:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787338730.442846:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbed9c9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:83642291-0761-4205-9531-7fd25bc2d48e+38:2358:x1874160192132992:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 125us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338730.442853:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 12 00000100:00100000:0.0:1787338730.443709:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192132864 00000100:00100000:0.0:1787338730.443726:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192132864 00000100:00100000:0.0:1787338730.443768:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 42 00000100:00100000:0.0:1787338730.443777:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbed9cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:83642291-0761-4205-9531-7fd25bc2d48e+38:11406:x1874160192132864:12345-192.168.201.53@tcp:35:cat.0 00000100:00100000:0.0:1787338730.444288:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbed9cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:83642291-0761-4205-9531-7fd25bc2d48e+39:11406:x1874160192132864:12345-192.168.201.53@tcp:35:cat.0 Request processed in 510us (1801us total) trans 4294967438 rc 0/0 00000100:00100000:0.0:1787338730.444296:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 42 00000100:00100000:3.0:1787338730.541805:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338730.541929:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192133248 00000100:00100000:0.0:1787338730.541941:0:7647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192133248 00000100:00100000:0.0:1787338730.542006:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 154 00000100:00100000:0.0:1787338730.542017:0:7647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbed9c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+39:11412:x1874160192133248:12345-192.168.201.53@tcp:101:dd.0 00010000:00010000:0.0:1787338730.542044:0:7647:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787338730.542047:0:7647:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787338730.542072:0:7647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9da00/0x83671231080c1e1f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab8b9 expref: 39 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338730.542090:0:7647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff90bbeb14d600) 00010000:00010000:0.0:1787338730.542094:0:7647:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787338730.542121:0:7647:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c1ec7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab8ea expref: -99 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338730.542217:0:7647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c1ece lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338730.542230:0:7647:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c1e9d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab8dc expref: 39 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338730.542238:0:7647:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c1ece lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338730.542287:0:7647:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c1e9d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab8dc expref: 39 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338730.542300:0:7647:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c1e9d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab8dc expref: 39 pid: 5840 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338730.542313:0:7647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbd17ece00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7647:1874160212058368:192.168.201.53@tcp:104: 00000100:00100000:0.0:1787338730.542422:0:7647:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc4112600 going to sleep for 11 seconds 00000100:00100000:3.0:1787338730.546138:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338730.546306:0:7647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbd17ece00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7647:1874160212058368:192.168.201.53@tcp:104: 00010000:00010000:0.0:1787338730.546363:0:7647:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c1ece lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338730.546436:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192133376 00000100:00100000:2.0:1787338730.546444:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192133376 00010000:00010000:2.0:1787338730.546484:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c1e9d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab8dc expref: 40 pid: 5840 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338730.546521:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 65 00000100:00100000:2.0:1787338730.546531:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbed9ca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:83642291-0761-4205-9531-7fd25bc2d48e+40:2358:x1874160192133376:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787338730.546546:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787338730.546554:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c1e9d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab8dc expref: 40 pid: 5840 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338730.546565:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c1e9d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab8dc expref: 40 pid: 5840 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338730.546588:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c1e9d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab8dc expref: 40 pid: 5840 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338730.546605:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90bbdee56700) 00010000:00010000:2.0:1787338730.546609:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c1ece lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338730.546619:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c1ece lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338730.546626:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c1ece lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338730.546654:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787338730.546714:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbed9ca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:83642291-0761-4205-9531-7fd25bc2d48e+39:2358:x1874160192133376:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 185us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338730.546736:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 65 00010000:00010000:0.0:1787338730.546846:0:7647:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c1ece lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338730.546854:0:7647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c1ece lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787338730.546911:0:7647:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787338730.547076:0:7647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c1ec7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab8ea expref: 40 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338730.547091:0:7647:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c1ece lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab8ea expref: 39 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338730.547099:0:7647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90bbdee56700) 00010000:00010000:0.0:1787338730.547101:0:7647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787338730.547111:0:7647:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbc0031000, rc 0) 00000100:00100000:0.0:1787338730.547151:0:7647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbed9c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+39:11412:x1874160192133248:12345-192.168.201.53@tcp:101:dd.0 Request processed in 5136us (5355us total) trans 4294967439 rc 0/0 00000100:00100000:0.0:1787338730.547159:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 154 00000100:00100000:3.0:1787338730.550262:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338730.550346:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192133632 00000100:00100000:2.0:1787338730.550365:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192133632 00000100:00100000:2.0:1787338730.550418:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 155 00000100:00100000:2.0:1787338730.550429:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbef17b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+39:11412:x1874160192133632:12345-192.168.201.53@tcp:36:dd.0 00010000:00010000:2.0:1787338730.550679:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52a00/0x83671231080c1edc lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338730.550696:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52a00/0x83671231080c1edc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338730.550706:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52a00/0x83671231080c1edc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787338730.550769:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:2.0:1787338730.550794:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000011de57e4 reply state 00000000716bb32e transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52a00/0x83671231080c1edc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338730.550803:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787338730.550941:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbef17b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+42:11412:x1874160192133632:12345-192.168.201.53@tcp:36:dd.0 Request processed in 512us (688us total) trans 4294967441 rc 0/0 00000100:00100000:2.0:1787338730.550948:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 155 00000020:00080000:2.0:1787338730.550953:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787338730.556333:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52a00/0x83671231080c1edc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338730.556373:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52a00/0x83671231080c1edc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338730.556381:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52a00/0x83671231080c1edc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338730.556388:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf3c52a00 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:3.0:1787338730.556393:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52a00/0x83671231080c1edc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338730.556400:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52a00/0x83671231080c1edc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338730.556416:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90bbdee56700) 00010000:00010000:3.0:1787338730.556419:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787338730.556423:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52a00/0x83671231080c1edc lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338730.556429:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52a00/0x83671231080c1edc lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338730.614173:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787338730.614193:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbef179880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874160212058496:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787338730.614259:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338730.614776:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212058496 00000100:00100000:2.0:1787338730.614785:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212058496 00000100:00100000:2.0:1787338730.614842:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787338730.614853:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbd17ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1874160212058496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787338730.614906:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787338730.614963:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbd17ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1874160212058496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (702us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338730.614983:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787338730.615243:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbef179880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874160212058496:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787338730.875159:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338730.875321:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192133760 00000100:00100000:2.0:1787338730.875343:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192133760 00000100:00100000:2.0:1787338730.875426:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 156 00000100:00100000:2.0:1787338730.875436:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbef179880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+41:11426:x1874160192133760:12345-192.168.201.53@tcp:101:stat.0 00010000:00010000:2.0:1787338730.875462:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787338730.875482:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c53400/0x83671231080c1ee3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab8f1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338730.875551:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c53000/0x83671231080c1eea lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338730.875564:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c53000/0x83671231080c1eea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338730.875575:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c53000/0x83671231080c1eea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338730.875589:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c53e00/0x83671231080c1ef1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338730.875596:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c53e00/0x83671231080c1ef1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338730.875612:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c53e00/0x83671231080c1ef1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338730.875712:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c53600/0x83671231080c1ef8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338730.875723:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c1ece lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab8ea expref: 42 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338730.875752:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c53600/0x83671231080c1ef8 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338730.875785:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c1ece lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab8ea expref: 42 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338730.875799:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c1ece lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab8ea expref: 42 pid: 7647 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338730.875813:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf7ed4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5840:1874160212058624:192.168.201.53@tcp:104: 00000100:00100000:2.0:1787338730.875947:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbf41c1240 going to sleep for 11 seconds 00000100:00100000:2.0:1787338730.882602:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf7ed4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5840:1874160212058624:192.168.201.53@tcp:104: 00010000:00010000:2.0:1787338730.882634:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c53600/0x83671231080c1ef8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338730.883040:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338730.886445:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192134016 00000100:00100000:1.0:1787338730.886462:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192134016 00000100:00100000:1.0:1787338730.886539:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 43 00000100:00100000:1.0:1787338730.886551:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc123100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:83642291-0761-4205-9531-7fd25bc2d48e+43:5595:x1874160192134016:12345-192.168.201.53@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787338730.886941:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc123100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:83642291-0761-4205-9531-7fd25bc2d48e+44:5595:x1874160192134016:12345-192.168.201.53@tcp:35:ldlm_bl.0 Request processed in 391us (3901us total) trans 4294967442 rc 0/0 00000100:00100000:1.0:1787338730.886950:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 43 00000100:00100000:1.0:1787338730.898434:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338730.898682:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192134144 00000100:00100000:2.0:1787338730.898693:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192134144 00010000:00010000:2.0:1787338730.898739:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c1ece lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab8ea expref: 44 pid: 7647 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338730.898792:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 66 00000100:00100000:2.0:1787338730.898804:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa4b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:83642291-0761-4205-9531-7fd25bc2d48e+44:2358:x1874160192134144:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787338730.898818:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787338730.898825:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c1ece lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab8ea expref: 44 pid: 7647 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338730.898857:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c1ece lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab8ea expref: 44 pid: 7647 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338730.898906:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c1ece lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab8ea expref: 44 pid: 7647 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338730.899045:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90bbdee56700) 00010000:00010000:2.0:1787338730.899050:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c53600/0x83671231080c1ef8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338730.899059:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c53600/0x83671231080c1ef8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338730.899072:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c53600/0x83671231080c1ef8 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338730.899148:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787338730.899205:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa4b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:83642291-0761-4205-9531-7fd25bc2d48e+43:2358:x1874160192134144:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 403us (781us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338730.899213:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 66 00010000:00010000:0.0:1787338730.906153:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c53600/0x83671231080c1ef8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338730.906171:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c53600/0x83671231080c1ef8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787338730.906272:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1787338730.906277:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787338730.906305:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c53600/0x83671231080c1ef8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338730.906323:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c53600/0x83671231080c1ef8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338730.906334:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c53000/0x83671231080c1eea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338730.906340:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c53000/0x83671231080c1eea lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338730.906358:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c53000/0x83671231080c1eea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338730.906384:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf3c53000 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:0.0:1787338730.906388:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c53000/0x83671231080c1eea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338730.906396:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c53000/0x83671231080c1eea lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338730.906412:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff90bbeb14d600) 00010000:00010000:0.0:1787338730.906415:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787338730.906420:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c53000/0x83671231080c1eea lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338730.906427:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c53000/0x83671231080c1eea lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338730.906445:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c53e00/0x83671231080c1ef1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338730.906450:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c53e00/0x83671231080c1ef1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338730.906455:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c53e00/0x83671231080c1ef1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338730.906460:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf3c53e00 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:0.0:1787338730.906463:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c53e00/0x83671231080c1ef1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338730.906468:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c53e00/0x83671231080c1ef1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338730.906485:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff90bbdee56d00) 00010000:00010000:0.0:1787338730.906488:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787338730.906491:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c53e00/0x83671231080c1ef1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338730.906497:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c53e00/0x83671231080c1ef1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338730.906545:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c53400/0x83671231080c1ee3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab8f1 expref: 43 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338730.906559:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c53600/0x83671231080c1ef8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab8f1 expref: 42 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338730.906566:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90bbdee56700) 00010000:00010000:0.0:1787338730.906569:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787338730.906571:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf3c53600, rc 0) 00000100:00100000:0.0:1787338730.906659:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbef179880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+42:11426:x1874160192133760:12345-192.168.201.53@tcp:101:stat.0 Request processed in 31222us (31506us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338730.906669:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 156 00000100:00100000:1.0:1787338731.011299:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338731.011526:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192134400 00000100:00100000:2.0:1787338731.011536:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192134400 00000100:00100000:2.0:1787338731.011645:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 157 00000100:00100000:2.0:1787338731.011656:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+42:11433:x1874160192134400:12345-192.168.201.53@tcp:36:truncate.0 00010000:00010000:2.0:1787338731.011719:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787338731.014440:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c53600/0x83671231080c1ef8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab8f1 expref: 42 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.014502:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90bbdee56700) 00010000:00010000:2.0:1787338731.014507:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787338731.014739:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52e00/0x83671231080c1eff lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.014755:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52e00/0x83671231080c1eff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.014765:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52e00/0x83671231080c1eff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787338731.014811:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:2.0:1787338731.014832:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000333e0293 reply state 000000004c6baa32 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52e00/0x83671231080c1eff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338731.014842:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787338731.014998:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+44:11433:x1874160192134400:12345-192.168.201.53@tcp:36:truncate.0 Request processed in 3343us (3704us total) trans 4294967444 rc 0/0 00000100:00100000:2.0:1787338731.015007:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 157 00000020:00080000:2.0:1787338731.015012:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00080000:3.0:1787338731.020904:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787338731.025971:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52e00/0x83671231080c1eff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338731.025996:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52e00/0x83671231080c1eff lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338731.026005:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52e00/0x83671231080c1eff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338731.026036:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf3c52e00 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:0.0:1787338731.026042:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52e00/0x83671231080c1eff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338731.026050:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52e00/0x83671231080c1eff lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338731.026070:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90bbdee56700) 00010000:00010000:0.0:1787338731.026074:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787338731.026079:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52e00/0x83671231080c1eff lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338731.026084:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52e00/0x83671231080c1eff lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.190566:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787338731.231365:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338731.231643:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192134528 00000100:00100000:0.0:1787338731.231667:0:7647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192134528 00000100:00100000:0.0:1787338731.231751:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 158 00000100:00100000:0.0:1787338731.231764:0:7647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+43:11447:x1874160192134528:12345-192.168.201.53@tcp:101:stat.0 00010000:00010000:0.0:1787338731.232066:0:7647:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787338731.232092:0:7647:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c1f06 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab8f8 expref: -99 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338731.232190:0:7647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c1f0d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338731.232204:0:7647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c1f0d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338731.232215:0:7647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c1f0d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338731.232246:0:7647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c1f14 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338731.232253:0:7647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c1f14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338731.232258:0:7647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c1f14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338731.232415:0:7647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c1f1b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338731.232425:0:7647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c1f1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338731.232433:0:7647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c1f1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787338731.232486:0:7647:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1787338731.232493:0:7647:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787338731.232517:0:7647:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c1f1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338731.232530:0:7647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c1f1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338731.232540:0:7647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c1f0d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338731.232547:0:7647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c1f0d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338731.232568:0:7647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c1f0d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338731.232576:0:7647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbc0030400 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:0.0:1787338731.232581:0:7647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c1f0d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338731.232589:0:7647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c1f0d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338731.232604:0:7647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff90bbeb14d600) 00010000:00010000:0.0:1787338731.232607:0:7647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787338731.232612:0:7647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c1f0d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338731.232617:0:7647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c1f0d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338731.232632:0:7647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c1f14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338731.232639:0:7647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c1f14 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338731.232645:0:7647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c1f14 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338731.232651:0:7647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbc0031000 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:0.0:1787338731.232667:0:7647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c1f14 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338731.232685:0:7647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c1f14 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338731.232693:0:7647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff90bbeb14d300) 00010000:00010000:0.0:1787338731.232695:0:7647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787338731.232699:0:7647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c1f14 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338731.232714:0:7647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c1f14 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338731.232760:0:7647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c1f06 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab8f8 expref: 45 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338731.232773:0:7647:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c1f1b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab8f8 expref: 44 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338731.233712:0:7647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90bbdee56700) 00010000:00010000:0.0:1787338731.233718:0:7647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787338731.233722:0:7647:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbc0030800, rc 0) 00000100:00100000:0.0:1787338731.233824:0:7647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+44:11447:x1874160192134528:12345-192.168.201.53@tcp:101:stat.0 Request processed in 2061us (2493us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338731.233834:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 158 00000100:00100000:1.0:1787338731.339771:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338731.339900:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192134784 00000100:00100000:2.0:1787338731.339919:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192134784 00000100:00100000:2.0:1787338731.339981:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 159 00000100:00100000:2.0:1787338731.339991:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+44:11457:x1874160192134784:12345-192.168.201.53@tcp:101:lfs.0 00010000:00010000:2.0:1787338731.340012:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787338731.340036:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52000/0x83671231080c1f22 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab8ff expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787338731.340168:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:2.0:1787338731.340442:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52000/0x83671231080c1f22 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab8ff expref: 46 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.340458:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90bbeb14d900) 00010000:00010000:2.0:1787338731.340461:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787338731.340467:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52000/0x83671231080c1f22 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab8ff expref: 46 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.340481:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf3c52000, rc 0) 00000100:00100000:2.0:1787338731.340605:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+45:11457:x1874160192134784:12345-192.168.201.53@tcp:101:lfs.0 Request processed in 614us (844us total) trans 4294967445 rc 301/301 00000100:00100000:2.0:1787338731.340612:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 159 00000100:00100000:1.0:1787338731.342771:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338731.342869:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192135040 00000100:00100000:0.0:1787338731.342922:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192135040 00000100:00100000:0.0:1787338731.342974:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 44 00000100:00100000:0.0:1787338731.342985:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbd894f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:83642291-0761-4205-9531-7fd25bc2d48e+45:11457:x1874160192135040:12345-192.168.201.53@tcp:35:lfs.0 00000100:00100000:0.0:1787338731.343255:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbd894f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:83642291-0761-4205-9531-7fd25bc2d48e+46:11457:x1874160192135040:12345-192.168.201.53@tcp:35:lfs.0 Request processed in 272us (493us total) trans 4294967446 rc 0/0 00000100:00100000:0.0:1787338731.343264:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 44 00000100:00100000:1.0:1787338731.459188:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338731.459350:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192135296 00000100:00100000:2.0:1787338731.459360:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192135296 00000100:00100000:2.0:1787338731.459428:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 160 00000100:00100000:2.0:1787338731.459439:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbed9cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+46:11463:x1874160192135296:12345-192.168.201.53@tcp:101:bash.0 00010000:00010000:2.0:1787338731.459464:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787338731.459495:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52000/0x83671231080c1f30 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab906 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.459589:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52800/0x83671231080c1f37 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.459604:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c1f1b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab8f8 expref: 47 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.459630:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52800/0x83671231080c1f37 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.459660:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c1f1b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab8f8 expref: 47 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.459674:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c1f1b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab8f8 expref: 47 pid: 7647 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338731.459686:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf7ed4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5840:1874160212058752:192.168.201.53@tcp:104: 00000100:00100000:2.0:1787338731.459781:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbf41c1240 going to sleep for 11 seconds 00000100:00100000:2.0:1787338731.462001:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf7ed4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5840:1874160212058752:192.168.201.53@tcp:104: 00010000:00010000:2.0:1787338731.462030:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52800/0x83671231080c1f37 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338731.462294:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338731.462568:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192135424 00000100:00100000:2.0:1787338731.462577:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192135424 00010000:00010000:2.0:1787338731.462614:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c1f1b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab8f8 expref: 48 pid: 7647 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338731.462688:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 67 00000100:00100000:2.0:1787338731.462700:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc90c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:83642291-0761-4205-9531-7fd25bc2d48e+48:2358:x1874160192135424:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787338731.462718:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787338731.462724:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c1f1b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab8f8 expref: 48 pid: 7647 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.462755:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c1f1b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab8f8 expref: 48 pid: 7647 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.462778:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c1f1b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab8f8 expref: 48 pid: 7647 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.462797:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90bbdee56700) 00010000:00010000:2.0:1787338731.462803:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52800/0x83671231080c1f37 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.462811:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52800/0x83671231080c1f37 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.462819:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52800/0x83671231080c1f37 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.462849:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787338731.462988:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52800/0x83671231080c1f37 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338731.462996:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52800/0x83671231080c1f37 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787338731.463014:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:0.0:1787338731.463177:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52000/0x83671231080c1f30 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab906 expref: 49 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338731.463191:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52800/0x83671231080c1f37 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab906 expref: 48 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338731.463198:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90bbdee56700) 00010000:00010000:0.0:1787338731.463201:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787338731.463203:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf3c52800, rc 0) 00000100:00100000:2.0:1787338731.463294:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc90c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:83642291-0761-4205-9531-7fd25bc2d48e+48:2358:x1874160192135424:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 596us (1001us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338731.463302:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 67 00000100:00100000:0.0:1787338731.467684:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbed9cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+47:11463:x1874160192135296:12345-192.168.201.53@tcp:101:bash.0 Request processed in 8231us (8490us total) trans 4294967447 rc 0/0 00000100:00100000:0.0:1787338731.467698:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 160 00000100:00100000:1.0:1787338731.477473:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338731.477598:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192135680 00000100:00100000:2.0:1787338731.477608:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192135680 00000100:00100000:2.0:1787338731.477669:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 161 00000100:00100000:2.0:1787338731.477681:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc90c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+47:11463:x1874160192135680:12345-192.168.201.53@tcp:36:bash.0 00010000:00010000:2.0:1787338731.478194:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52400/0x83671231080c1f45 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.478217:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52400/0x83671231080c1f45 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.478235:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52400/0x83671231080c1f45 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787338731.478293:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:2.0:1787338731.478317:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a251ab04 reply state 0000000064991804 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52400/0x83671231080c1f45 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338731.478327:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787338731.478543:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc90c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+50:11463:x1874160192135680:12345-192.168.201.53@tcp:36:bash.0 Request processed in 863us (1447us total) trans 4294967449 rc 0/0 00000100:00100000:2.0:1787338731.478551:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 161 00000020:00080000:2.0:1787338731.478557:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787338731.485062:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52400/0x83671231080c1f45 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338731.485078:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52400/0x83671231080c1f45 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338731.485086:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52400/0x83671231080c1f45 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338731.485120:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf3c52400 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:3.0:1787338731.485125:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52400/0x83671231080c1f45 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338731.485132:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52400/0x83671231080c1f45 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338731.485150:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90bbdee56700) 00010000:00010000:3.0:1787338731.485153:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787338731.485158:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52400/0x83671231080c1f45 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338731.485165:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52400/0x83671231080c1f45 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338731.491913:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338731.492292:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192135808 00000100:00100000:0.0:1787338731.492304:0:7647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192135808 00000100:00100000:0.0:1787338731.492376:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 162 00000100:00100000:0.0:1787338731.492387:0:7647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc90c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+49:11463:x1874160192135808:12345-192.168.201.53@tcp:101:bash.0 00010000:00010000:0.0:1787338731.492421:0:7647:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787338731.492453:0:7647:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c1f4c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab90d expref: -99 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338731.492549:0:7647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c1f53 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338731.492563:0:7647:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52800/0x83671231080c1f37 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab906 expref: 50 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338731.492571:0:7647:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c1f53 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338731.492604:0:7647:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52800/0x83671231080c1f37 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab906 expref: 50 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338731.492617:0:7647:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52800/0x83671231080c1f37 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab906 expref: 50 pid: 5840 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338731.492631:0:7647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbd17ec700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7647:1874160212058880:192.168.201.53@tcp:104: 00000100:00100000:0.0:1787338731.492721:0:7647:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc67a6780 going to sleep for 11 seconds 00000100:00100000:1.0:1787338731.506196:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338731.506283:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192135936 00000100:00100000:3.0:1787338731.506296:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192135936 00010000:00010000:3.0:1787338731.506348:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52800/0x83671231080c1f37 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab906 expref: 51 pid: 5840 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338731.506391:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 68 00000100:00100000:3.0:1787338731.506401:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc90c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:83642291-0761-4205-9531-7fd25bc2d48e+51:2358:x1874160192135936:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787338731.506416:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787338731.506423:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52800/0x83671231080c1f37 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab906 expref: 51 pid: 5840 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338731.506437:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52800/0x83671231080c1f37 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab906 expref: 51 pid: 5840 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338731.506476:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90bbdee56700) 00010000:00010000:3.0:1787338731.506493:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c1f53 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338731.506503:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c1f53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338731.506510:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c1f53 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338731.506531:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787338731.506584:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc90c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:83642291-0761-4205-9531-7fd25bc2d48e+51:2358:x1874160192135936:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 184us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338731.506598:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 68 00010000:00010000:0.0:1787338731.507518:0:7647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52800/0x83671231080c1f37 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab906 expref: 50 pid: 5840 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338731.507539:0:7647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbd17ec700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7647:1874160212058880:192.168.201.53@tcp:104: 00010000:00010000:0.0:1787338731.507575:0:7647:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c1f53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338731.507585:0:7647:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c1f53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338731.507605:0:7647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c1f53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787338731.507648:0:7647:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1787338731.507652:0:7647:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787338731.507671:0:7647:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c1f53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338731.507700:0:7647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c1f4c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab90d expref: 50 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338731.507717:0:7647:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c1f53 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab90d expref: 49 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338731.507725:0:7647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90bbdee56700) 00010000:00010000:0.0:1787338731.507728:0:7647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787338731.507731:0:7647:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbc0031000, rc 0) 00000100:00100000:0.0:1787338731.507779:0:7647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc90c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+49:11463:x1874160192135808:12345-192.168.201.53@tcp:101:bash.0 Request processed in 15395us (15912us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338731.507787:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 162 00000100:00100000:1.0:1787338731.518746:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338731.518850:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192136192 00000100:00100000:0.0:1787338731.518862:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192136192 00000100:00100000:0.0:1787338731.518972:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 45 00000100:00100000:0.0:1787338731.518983:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf4101180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:83642291-0761-4205-9531-7fd25bc2d48e+49:11463:x1874160192136192:12345-192.168.201.53@tcp:35:bash.0 00000100:00100000:0.0:1787338731.519204:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf4101180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:83642291-0761-4205-9531-7fd25bc2d48e+50:11463:x1874160192136192:12345-192.168.201.53@tcp:35:bash.0 Request processed in 223us (467us total) trans 4294967450 rc 0/0 00000100:00100000:0.0:1787338731.519209:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 45 00000100:00100000:1.0:1787338731.648432:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338731.648548:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192136448 00000100:00100000:2.0:1787338731.648563:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192136448 00000100:00100000:2.0:1787338731.648652:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 163 00000100:00100000:2.0:1787338731.648664:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf4115880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+50:11473:x1874160192136448:12345-192.168.201.53@tcp:101:lfs.0 00010000:00010000:2.0:1787338731.648690:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787338731.648709:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c53200/0x83671231080c1f5a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab914 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787338731.648824:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:2.0:1787338731.648974:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c53200/0x83671231080c1f5a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab914 expref: 52 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.648993:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90bbeb14d900) 00010000:00010000:2.0:1787338731.648997:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787338731.649002:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c53200/0x83671231080c1f5a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab914 expref: 52 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.649035:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf3c53200, rc 0) 00000100:00100000:2.0:1787338731.649113:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf4115880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+51:11473:x1874160192136448:12345-192.168.201.53@tcp:101:lfs.0 Request processed in 451us (696us total) trans 4294967451 rc 301/301 00000100:00100000:2.0:1787338731.649122:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 163 00000100:00100000:1.0:1787338731.653923:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338731.654010:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192136576 00000100:00100000:2.0:1787338731.654022:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192136576 00000100:00100000:2.0:1787338731.654085:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 164 00000100:00100000:2.0:1787338731.654096:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf3e9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+51:11473:x1874160192136576:12345-192.168.201.53@tcp:34:lfs.0 00010000:00010000:2.0:1787338731.654177:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52800/0x83671231080c1f68 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.654196:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52800/0x83671231080c1f68 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.654209:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52800/0x83671231080c1f68 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.654235:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52400/0x83671231080c1f6f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.654243:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52400/0x83671231080c1f6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.654248:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52400/0x83671231080c1f6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.654358:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52000/0x83671231080c1f76 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.654392:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52000/0x83671231080c1f76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.654400:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52000/0x83671231080c1f76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787338731.654445:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52000/0x83671231080c1f76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.654457:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52800/0x83671231080c1f68 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.654463:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52800/0x83671231080c1f68 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.654469:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52800/0x83671231080c1f68 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.654475:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf3c52800 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:2.0:1787338731.654479:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52800/0x83671231080c1f68 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.654487:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52800/0x83671231080c1f68 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.654500:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff90bbeb14d600) 00010000:00010000:2.0:1787338731.654503:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787338731.654507:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52800/0x83671231080c1f68 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.654513:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52800/0x83671231080c1f68 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.654535:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52400/0x83671231080c1f6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.654541:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52400/0x83671231080c1f6f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.654547:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52400/0x83671231080c1f6f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.654552:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf3c52400 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:2.0:1787338731.654555:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52400/0x83671231080c1f6f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.654560:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52400/0x83671231080c1f6f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.654568:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff90bbdee56a00) 00010000:00010000:2.0:1787338731.654570:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787338731.654573:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52400/0x83671231080c1f6f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.654577:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52400/0x83671231080c1f6f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.654591:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52000/0x83671231080c1f76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.654598:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52000/0x83671231080c1f76 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.654603:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52000/0x83671231080c1f76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.654613:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf3c52000 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:2.0:1787338731.654616:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52000/0x83671231080c1f76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.654621:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52000/0x83671231080c1f76 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.654639:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90bbdee56700) 00010000:00010000:2.0:1787338731.654641:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787338731.654644:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52000/0x83671231080c1f76 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.654649:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52000/0x83671231080c1f76 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338731.654780:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf3e9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+51:11473:x1874160192136576:12345-192.168.201.53@tcp:34:lfs.0 Request processed in 685us (905us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338731.654790:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 164 00000100:00100000:1.0:1787338731.662076:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338731.663462:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192136832 00000100:00100000:0.0:1787338731.663474:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192136832 00000100:00100000:0.0:1787338731.663644:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 46 00000100:00100000:0.0:1787338731.663655:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf3e9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:83642291-0761-4205-9531-7fd25bc2d48e+51:11473:x1874160192136832:12345-192.168.201.53@tcp:35:lfs.0 00000100:00100000:0.0:1787338731.664132:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf3e9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:83642291-0761-4205-9531-7fd25bc2d48e+52:11473:x1874160192136832:12345-192.168.201.53@tcp:35:lfs.0 Request processed in 478us (2260us total) trans 4294967452 rc 0/0 00000100:00100000:0.0:1787338731.664140:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 46 00000100:00100000:1.0:1787338731.698678:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338731.698792:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192137088 00000100:00100000:2.0:1787338731.698803:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192137088 00000100:00100000:2.0:1787338731.698869:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 165 00000100:00100000:2.0:1787338731.698919:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf3e9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+52:11476:x1874160192137088:12345-192.168.201.53@tcp:101:lfs.0 00010000:00010000:2.0:1787338731.698945:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787338731.698966:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52000/0x83671231080c1f7d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab91b expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.699068:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52400/0x83671231080c1f84 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.699094:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52400/0x83671231080c1f84 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.699107:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52400/0x83671231080c1f84 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.699123:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52800/0x83671231080c1f8b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.699131:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52800/0x83671231080c1f8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.699137:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52800/0x83671231080c1f8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.699275:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c53200/0x83671231080c1f92 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.699284:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c53200/0x83671231080c1f92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.699291:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c53200/0x83671231080c1f92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787338731.699300:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1787338731.699409:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52400/0x83671231080c1f84 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.699417:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52400/0x83671231080c1f84 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.699423:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52400/0x83671231080c1f84 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.699436:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf3c52400 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:2.0:1787338731.699440:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52400/0x83671231080c1f84 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.699448:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52400/0x83671231080c1f84 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.699460:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff90bbeb14d600) 00010000:00010000:2.0:1787338731.699463:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787338731.699468:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52400/0x83671231080c1f84 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.699475:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52400/0x83671231080c1f84 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.699488:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52800/0x83671231080c1f8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.699494:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52800/0x83671231080c1f8b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.699499:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52800/0x83671231080c1f8b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.699503:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf3c52800 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:2.0:1787338731.699506:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52800/0x83671231080c1f8b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.699512:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52800/0x83671231080c1f8b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.699530:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff90bbdee56a00) 00010000:00010000:2.0:1787338731.699533:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787338731.699536:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52800/0x83671231080c1f8b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.699542:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52800/0x83671231080c1f8b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.699584:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52000/0x83671231080c1f7d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab91b expref: 55 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.699597:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c53200/0x83671231080c1f92 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab91b expref: 54 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.699605:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90bbdee56700) 00010000:00010000:2.0:1787338731.699607:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787338731.699610:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf3c53200, rc 0) 00000100:00100000:2.0:1787338731.699773:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf3e9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+54:11476:x1874160192137088:12345-192.168.201.53@tcp:101:lfs.0 Request processed in 856us (1107us total) trans 4294967453 rc 0/0 00000100:00100000:2.0:1787338731.699782:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 165 00000100:00100000:1.0:1787338731.703154:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338731.703223:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192137216 00000100:00100000:2.0:1787338731.703234:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192137216 00000100:00100000:2.0:1787338731.703299:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 166 00000100:00100000:2.0:1787338731.703311:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf3e9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+54:11476:x1874160192137216:12345-192.168.201.53@tcp:54:lfs.0 00010000:00010000:2.0:1787338731.703394:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c53600/0x83671231080c1fa0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.703410:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c53600/0x83671231080c1fa0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.703441:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c53600/0x83671231080c1fa0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.703470:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c53600/0x83671231080c1fa0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.703478:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c53600/0x83671231080c1fa0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.703485:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c53600/0x83671231080c1fa0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.703491:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf3c53600 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:2.0:1787338731.703496:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c53600/0x83671231080c1fa0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.703503:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c53600/0x83671231080c1fa0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.703515:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90bbdee56700) 00010000:00010000:2.0:1787338731.703518:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787338731.703523:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c53600/0x83671231080c1fa0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.703529:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c53600/0x83671231080c1fa0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338731.703605:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf3e9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+54:11476:x1874160192137216:12345-192.168.201.53@tcp:54:lfs.0 Request processed in 295us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338731.703613:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 166 00000100:00100000:3.0:1787338731.705348:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338731.705529:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192137472 00000100:00100000:2.0:1787338731.705549:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192137472 00000100:00100000:2.0:1787338731.705604:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 47 00000100:00100000:2.0:1787338731.705615:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc123100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:83642291-0761-4205-9531-7fd25bc2d48e+54:11476:x1874160192137472:12345-192.168.201.53@tcp:35:lfs.0 00000100:00100000:2.0:1787338731.705845:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc123100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:83642291-0761-4205-9531-7fd25bc2d48e+55:11476:x1874160192137472:12345-192.168.201.53@tcp:35:lfs.0 Request processed in 230us (513us total) trans 4294967454 rc 0/0 00000100:00100000:2.0:1787338731.705853:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 47 00000100:00100000:3.0:1787338731.706388:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338731.706459:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192137600 00000100:00100000:0.0:1787338731.706465:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192137600 00000100:00100000:0.0:1787338731.706513:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 13 00000100:00100000:0.0:1787338731.706522:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee081180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:83642291-0761-4205-9531-7fd25bc2d48e+55:2358:x1874160192137600:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787338731.706534:0:6704:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787338731.706557:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c53200/0x83671231080c1f92 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab91b expref: 55 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338731.706575:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90bbdee56700) 00010000:00010000:0.0:1787338731.706581:0:6704:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787338731.706614:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee081180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:83642291-0761-4205-9531-7fd25bc2d48e+54:2358:x1874160192137600:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 93us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338731.706621:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 13 00000100:00100000:3.0:1787338731.870633:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338731.870783:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192137856 00000100:00100000:1.0:1787338731.870794:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192137856 00000100:00100000:1.0:1787338731.870964:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 167 00000100:00100000:1.0:1787338731.870976:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee082d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+54:11494:x1874160192137856:12345-192.168.201.53@tcp:101:cat.0 00010000:00010000:1.0:1787338731.871002:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787338731.871025:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c1fa7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab922 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338731.871213:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d400/0x83671231080c1fae lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338731.871229:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d400/0x83671231080c1fae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338731.871241:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d400/0x83671231080c1fae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787338731.871253:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1787338731.871426:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c1fa7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab922 expref: 57 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338731.871446:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d400/0x83671231080c1fae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab922 expref: 56 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338731.871580:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90bbdee56700) 00010000:00010000:1.0:1787338731.871583:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787338731.871587:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbfbe9d400, rc 0) 00000100:00100000:1.0:1787338731.871709:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee082d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+56:11494:x1874160192137856:12345-192.168.201.53@tcp:101:cat.0 Request processed in 734us (1094us total) trans 4294967455 rc 0/0 00000100:00100000:1.0:1787338731.871716:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 167 00000100:00100000:0.0:1787338731.913410:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338731.913626:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192137984 00000100:00100000:2.0:1787338731.913637:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192137984 00000100:00100000:2.0:1787338731.913704:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 168 00000100:00100000:2.0:1787338731.913716:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbd17ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+56:11495:x1874160192137984:12345-192.168.201.53@tcp:101:lfs.0 00010000:00010000:2.0:1787338731.913744:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787338731.913769:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c53600/0x83671231080c1fbc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab929 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.913853:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52000/0x83671231080c1fc3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.913869:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52000/0x83671231080c1fc3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.913916:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52000/0x83671231080c1fc3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787338731.913978:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:2.0:1787338731.913982:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787338731.914006:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52000/0x83671231080c1fc3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.914032:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c53600/0x83671231080c1fbc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab929 expref: 58 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.914070:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52000/0x83671231080c1fc3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab929 expref: 57 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.914081:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff90bbeb14d600) 00010000:00010000:2.0:1787338731.914269:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787338731.914274:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf3c52000, rc 0) 00000100:00100000:2.0:1787338731.914347:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbd17ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+57:11495:x1874160192137984:12345-192.168.201.53@tcp:101:lfs.0 Request processed in 633us (948us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338731.914354:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 168 00000100:00100000:3.0:1787338731.919654:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338731.920068:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192138368 00000100:00100000:2.0:1787338731.920081:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192138368 00000100:00100000:2.0:1787338731.920160:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 48 00000100:00100000:2.0:1787338731.920173:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf46fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:83642291-0761-4205-9531-7fd25bc2d48e+57:11495:x1874160192138368:12345-192.168.201.53@tcp:35:lfs.0 00000100:00100000:2.0:1787338731.920990:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf46fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:83642291-0761-4205-9531-7fd25bc2d48e+58:11495:x1874160192138368:12345-192.168.201.53@tcp:35:lfs.0 Request processed in 815us (1346us total) trans 4294967456 rc 0/0 00000100:00100000:2.0:1787338731.920999:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 48 00000100:00100000:3.0:1787338731.927466:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338731.927662:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192138496 00000100:00100000:2.0:1787338731.927675:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192138496 00000100:00100000:2.0:1787338731.927755:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 14 00000100:00100000:2.0:1787338731.927767:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbde53d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:83642291-0761-4205-9531-7fd25bc2d48e+58:11495:x1874160192138496:12345-192.168.201.53@tcp:103:lfs.0 00010000:00010000:2.0:1787338731.927782:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787338731.927807:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c1f53 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab90d expref: 58 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.927829:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d400/0x83671231080c1fae lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab922 expref: 57 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.927857:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c53800/0x83671231080c1e5e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab8ce expref: 56 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.927868:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90bbdee56700) 00010000:00010000:2.0:1787338731.927923:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787338731.927975:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbde53d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:83642291-0761-4205-9531-7fd25bc2d48e+55:11495:x1874160192138496:12345-192.168.201.53@tcp:103:lfs.0 Request processed in 210us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338731.927982:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 14 00000100:00100000:0.0:1787338731.931745:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338731.931910:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192138624 00000100:00100000:2.0:1787338731.931920:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192138624 00000100:00100000:2.0:1787338731.931975:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 169 00000100:00100000:2.0:1787338731.931988:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbd17ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+55:11495:x1874160192138624:12345-192.168.201.53@tcp:58:lfs.0 00010000:00010000:2.0:1787338731.932109:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c53600/0x83671231080c1fca lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.932127:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c53600/0x83671231080c1fca lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.932140:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c53600/0x83671231080c1fca lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787338731.932344:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:2.0:1787338731.932695:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbd17ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+55:11495:x1874160192138624:12345-192.168.201.53@tcp:58:lfs.0 Request processed in 699us (951us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338731.932705:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 169 00000100:00100000:0.0:1787338731.967808:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338731.967934:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192138752 00000100:00100000:2.0:1787338731.967944:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192138752 00000100:00100000:2.0:1787338731.968027:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 170 00000100:00100000:2.0:1787338731.968038:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbd172df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+55:11497:x1874160192138752:12345-192.168.201.53@tcp:101:lfs.0 00010000:00010000:2.0:1787338731.968058:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787338731.968078:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c53800/0x83671231080c1fd1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab930 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.968149:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52800/0x83671231080c1fd8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.968163:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52800/0x83671231080c1fd8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.968183:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52800/0x83671231080c1fd8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.968199:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52400/0x83671231080c1fdf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.968206:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52400/0x83671231080c1fdf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.968213:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52400/0x83671231080c1fdf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.968319:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52e00/0x83671231080c1fe6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.968339:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52e00/0x83671231080c1fe6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.968346:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52e00/0x83671231080c1fe6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787338731.968407:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1787338731.968412:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787338731.968432:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52e00/0x83671231080c1fe6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.968445:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52e00/0x83671231080c1fe6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.968464:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52800/0x83671231080c1fd8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.968471:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52800/0x83671231080c1fd8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.968478:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52800/0x83671231080c1fd8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.968484:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf3c52800 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:2.0:1787338731.968489:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52800/0x83671231080c1fd8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.968496:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52800/0x83671231080c1fd8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.968508:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff90bbeb14d600) 00010000:00010000:2.0:1787338731.968511:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787338731.968516:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52800/0x83671231080c1fd8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.968522:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52800/0x83671231080c1fd8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.968547:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52400/0x83671231080c1fdf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.968553:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52400/0x83671231080c1fdf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.968559:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52400/0x83671231080c1fdf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.968564:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf3c52400 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:2.0:1787338731.968567:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52400/0x83671231080c1fdf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.968573:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52400/0x83671231080c1fdf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.968580:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff90bbdee56700) 00010000:00010000:2.0:1787338731.968582:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787338731.968585:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52400/0x83671231080c1fdf lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.968590:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52400/0x83671231080c1fdf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.968623:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c53800/0x83671231080c1fd1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab930 expref: 57 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.968636:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52e00/0x83671231080c1fe6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab930 expref: 56 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338731.968655:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90bbdee56a00) 00010000:00010000:2.0:1787338731.968658:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787338731.968660:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf3c52e00, rc 0) 00000100:00100000:3.0:1787338731.969297:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbd172df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+56:11497:x1874160192138752:12345-192.168.201.53@tcp:101:lfs.0 Request processed in 1255us (1495us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338731.969307:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 170 00010000:00010000:0.0:1787338732.242490:0:11676:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787338732.245076:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000001:00080000:0.0:1787338732.245092:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000040:00080000:3.0:1787338732.759234:0:12471:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787338732.759245:0:12471:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787338732.759284:0:12471:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1787338732.759290:0:12471:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1787338732.791195:0:11692:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787338732.791203:0:11692:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787338732.791236:0:11692:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1787338732.791242:0:11692:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787338732.791378:0:11692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf3e9ea00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11692:1874160212059008:192.168.201.53@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787338732.791521:0:11692:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc818ca80 going to sleep for 11 seconds 00000100:00100000:3.0:1787338732.804307:0:11692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf3e9ea00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11692:1874160212059008:192.168.201.53@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787338732.804667:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338732.804840:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192138880 00000100:00100000:2.0:1787338732.804848:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192138880 00000100:00100000:2.0:1787338732.804930:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 171 00000100:00100000:2.0:1787338732.804941:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf46fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+56:11508:x1874160192138880:12345-192.168.201.53@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787338732.804971:0:5839:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787338732.805062:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf46fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+56:11508:x1874160192138880:12345-192.168.201.53@tcp:53:lhsmtool_posix.0 Request processed in 122us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338732.805069:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 171 00000100:00100000:3.0:1787338732.811793:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338732.812011:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192139008 00000100:00100000:1.0:1787338732.812022:0:7647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192139008 00000100:00100000:1.0:1787338732.812112:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 172 00000100:00100000:1.0:1787338732.812124:0:7647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf46f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+56:11508:x1874160192139008:12345-192.168.201.53@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787338732.812194:0:7647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9de00/0x83671231080c1fed lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338732.812211:0:7647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9de00/0x83671231080c1fed lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338732.812222:0:7647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9de00/0x83671231080c1fed lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338732.812275:0:7647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c1ff4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338732.812298:0:7647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c1ff4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338732.812306:0:7647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c1ff4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338732.812343:0:7647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9dc00/0x83671231080c1ffb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338732.812353:0:7647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9dc00/0x83671231080c1ffb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338732.812360:0:7647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9dc00/0x83671231080c1ffb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787338732.812396:0:7647:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1787338732.812400:0:7647:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787338732.812411:0:7647:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9dc00/0x83671231080c1ffb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338732.812422:0:7647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9de00/0x83671231080c1fed lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338732.812428:0:7647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9de00/0x83671231080c1fed lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338732.812434:0:7647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9de00/0x83671231080c1fed lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338732.812441:0:7647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbfbe9de00 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:1.0:1787338732.812444:0:7647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9de00/0x83671231080c1fed lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338732.812458:0:7647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9de00/0x83671231080c1fed lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338732.812469:0:7647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90bbdee56100) 00010000:00010000:1.0:1787338732.812472:0:7647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787338732.812477:0:7647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9de00/0x83671231080c1fed lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338732.812483:0:7647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9de00/0x83671231080c1fed lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338732.812494:0:7647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c1ff4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338732.812499:0:7647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c1ff4 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338732.812504:0:7647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c1ff4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338732.812508:0:7647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbfbe9d600 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:1.0:1787338732.812510:0:7647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c1ff4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338732.812516:0:7647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c1ff4 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338732.812522:0:7647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff90bbc2a93c00) 00010000:00010000:1.0:1787338732.812525:0:7647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787338732.812527:0:7647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c1ff4 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338732.812541:0:7647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c1ff4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338732.812554:0:7647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9dc00/0x83671231080c1ffb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338732.812559:0:7647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9dc00/0x83671231080c1ffb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338732.812564:0:7647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9dc00/0x83671231080c1ffb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338732.812568:0:7647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbfbe9dc00 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:1.0:1787338732.812570:0:7647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9dc00/0x83671231080c1ffb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338732.812576:0:7647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9dc00/0x83671231080c1ffb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338732.812582:0:7647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90bbdee56a00) 00010000:00010000:1.0:1787338732.812584:0:7647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787338732.812586:0:7647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9dc00/0x83671231080c1ffb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338732.812591:0:7647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9dc00/0x83671231080c1ffb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338732.812666:0:7647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf46f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+56:11508:x1874160192139008:12345-192.168.201.53@tcp:34:lhsmtool_posix.0 Request processed in 545us (881us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338732.812673:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 172 00000100:00100000:3.0:1787338732.828607:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338732.828645:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192139264 00000100:00100000:3.0:1787338732.828654:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192139264 00000100:00100000:3.0:1787338732.828697:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 173 00000100:00100000:3.0:1787338732.828707:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf46f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+56:11508:x1874160192139264:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787338732.828727:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787338732.828744:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5c00/0x83671231080c2002 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab937 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338732.828831:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5000/0x83671231080c2009 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338732.828846:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5000/0x83671231080c2009 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338732.828857:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5000/0x83671231080c2009 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787338732.828867:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1787338732.828968:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5000/0x83671231080c2009 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338732.828976:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5000/0x83671231080c2009 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338732.828984:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5000/0x83671231080c2009 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338732.828990:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea5000 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:3.0:1787338732.829002:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5000/0x83671231080c2009 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338732.829010:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5000/0x83671231080c2009 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338732.829022:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90bbdee56a00) 00010000:00010000:3.0:1787338732.829025:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787338732.829029:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5000/0x83671231080c2009 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338732.829036:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5000/0x83671231080c2009 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338732.829072:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5c00/0x83671231080c2002 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab937 expref: 58 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338732.829082:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90bbdee56100) 00010000:00010000:3.0:1787338732.829084:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787338732.829088:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5c00/0x83671231080c2002 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab937 expref: 58 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338732.829097:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf7ea5c00, rc 0) 00000100:00100000:3.0:1787338732.829151:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf46f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+57:11508:x1874160192139264:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 Request processed in 445us (554us total) trans 4294967457 rc 301/301 00000100:00100000:3.0:1787338732.829158:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 173 00000100:00100000:3.0:1787338732.836240:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338732.836322:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192139392 00000100:00100000:0.0:1787338732.836338:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192139392 00000100:00100000:0.0:1787338732.836399:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 174 00000100:00100000:0.0:1787338732.836410:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf46f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+57:11508:x1874160192139392:12345-192.168.201.53@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787338732.836446:0:5840:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787338732.836555:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf46f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+57:11508:x1874160192139392:12345-192.168.201.53@tcp:53:lhsmtool_posix.0 Request processed in 146us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338732.836562:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 174 00000100:00100000:3.0:1787338732.840831:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338732.840947:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192139648 00000100:00100000:0.0:1787338732.840956:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192139648 00000100:00100000:0.0:1787338732.841015:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 175 00000100:00100000:0.0:1787338732.841027:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf46f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+57:11508:x1874160192139648:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787338732.841046:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787338732.841049:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787338732.841077:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52000/0x83671231080c1fc3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab929 expref: 57 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338732.841093:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff90bbeb14d600) 00010000:00010000:0.0:1787338732.841098:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787338732.841122:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c2017 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab93e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787338732.841539:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:0.0:1787338732.841744:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c201e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338732.841758:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c201e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338732.841784:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c201e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338732.841840:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c2017 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab93e expref: 59 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338732.841856:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c201e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab93e expref: 58 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338732.841863:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff90bbeb14d300) 00010000:00010000:0.0:1787338732.841866:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787338732.841868:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbc0030a00, rc 0) 00000100:00100000:0.0:1787338732.842066:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf46f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+58:11508:x1874160192139648:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 Request processed in 1040us (1242us total) trans 4294967458 rc 0/0 00000100:00100000:0.0:1787338732.842074:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 175 00000100:00100000:1.0:1787338732.852456:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338732.852542:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192139904 00000100:00100000:3.0:1787338732.852554:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192139904 00000100:00100000:3.0:1787338732.852626:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 176 00000100:00100000:3.0:1787338732.852637:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf3e9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+58:11508:x1874160192139904:12345-192.168.201.53@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787338732.852700:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787338732.852841:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c201e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab93e expref: 58 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338732.852862:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff90bbeb14d300) 00010000:00010000:3.0:1787338732.852950:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787338732.852976:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c202c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338732.852990:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c202c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338732.853001:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c202c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338732.853017:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5c00/0x83671231080c2033 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x5ebd5093 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338732.853025:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5c00/0x83671231080c2033 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x5ebd5093 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338732.853032:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5c00/0x83671231080c2033 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x5ebd5093 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338732.853108:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c202c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338732.853116:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c202c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338732.853134:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c202c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338732.853141:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea5a00 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:3.0:1787338732.853145:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c202c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338732.853153:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c202c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338732.853162:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff90bbeb14d600) 00010000:00010000:3.0:1787338732.853165:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787338732.853169:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c202c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338732.853176:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c202c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338732.853186:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5c00/0x83671231080c2033 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x5ebd5093 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338732.853193:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5c00/0x83671231080c2033 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x5ebd5093 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338732.853199:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5c00/0x83671231080c2033 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x5ebd5093 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338732.853204:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea5c00 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:3.0:1787338732.853206:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5c00/0x83671231080c2033 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x5ebd5093 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338732.853221:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5c00/0x83671231080c2033 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x5ebd5093 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338732.853230:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x5ebd5093 (ffff90bbd38d6100) 00010000:00010000:3.0:1787338732.853232:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787338732.853235:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5c00/0x83671231080c2033 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x5ebd5093 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338732.853242:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5c00/0x83671231080c2033 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x5ebd5093 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338732.853387:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf3e9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+57:11508:x1874160192139904:12345-192.168.201.53@tcp:36:lhsmtool_posix.0 Request processed in 750us (942us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787338732.853396:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 176 00000100:00100000:3.0:1787338732.858439:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338732.858508:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192140032 00000100:00100000:0.0:1787338732.858520:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192140032 00000100:00100000:0.0:1787338732.858579:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 177 00000100:00100000:0.0:1787338732.858589:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbedcb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+57:11508:x1874160192140032:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787338732.858609:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787338732.858632:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c203a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab945 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338732.858667:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c2041 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338732.858679:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c2041 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338732.858699:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c2041 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338732.858800:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c203a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab945 expref: 59 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338732.858818:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c2041 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab945 expref: 58 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338732.858826:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff90bbeb14da00) 00010000:00010000:0.0:1787338732.858829:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787338732.858833:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbc0030400, rc 0) 00000100:00100000:0.0:1787338732.859014:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbedcb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+58:11508:x1874160192140032:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 Request processed in 424us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338732.859021:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 177 00000100:00100000:1.0:1787338732.861225:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338732.861337:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192140288 00000100:00100000:0.0:1787338732.861347:0:7647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192140288 00000100:00100000:0.0:1787338732.861392:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 178 00000100:00100000:0.0:1787338732.861402:0:7647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf3e9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+58:11508:x1874160192140288:12345-192.168.201.53@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787338732.861479:0:7647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c2048 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338732.861494:0:7647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c2048 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338732.861505:0:7647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c2048 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787338732.861785:0:7647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:0.0:1787338732.861795:0:7647:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 385702920596ns, next at 386702918568ns, rc = 0 00000004:00010000:0.0:1787338732.862099:0:7647:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003c34ea54 reply state 00000000bcc58da4 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c2048 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338732.862110:0:7647:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787338732.862213:0:7647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf3e9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+60:11508:x1874160192140288:12345-192.168.201.53@tcp:36:lhsmtool_posix.0 Request processed in 811us (994us total) trans 4294967459 rc 0/0 00000100:00100000:0.0:1787338732.862221:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 178 00010000:00010000:0.0:1787338732.863738:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c2048 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338732.863753:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c2048 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338732.863760:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c2048 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338732.863767:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbc0030800 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:0.0:1787338732.863771:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c2048 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338732.863780:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c2048 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338732.863797:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff90bbeb14da00) 00010000:00010000:0.0:1787338732.863801:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787338732.863805:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c2048 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338732.863828:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c2048 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338732.866105:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338732.866185:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192140416 00000100:00100000:0.0:1787338732.866194:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192140416 00000100:00100000:0.0:1787338732.866257:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 179 00000100:00100000:0.0:1787338732.866268:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4097100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+59:11508:x1874160192140416:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787338732.866293:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787338732.866321:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c204f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab94c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338732.866379:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c204f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab94c expref: 60 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338732.866394:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c204f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab94c expref: 60 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338732.866414:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff90bbeb14da00) 00010000:00010000:0.0:1787338732.866417:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787338732.866420:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbc0030a00, rc 0) 00000100:00100000:0.0:1787338732.866475:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4097100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+60:11508:x1874160192140416:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 Request processed in 208us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338732.866481:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 179 00000100:00100000:0.0:1787338732.873815:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338732.874069:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192140544 00000100:00100000:3.0:1787338732.874079:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192140544 00000100:00100000:3.0:1787338732.874140:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 50 00000100:00100000:3.0:1787338732.874150:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbd172fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:83642291-0761-4205-9531-7fd25bc2d48e+6:2358:x1874160192140544:12345-192.168.201.53@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1787338732.874494:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbd172fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:83642291-0761-4205-9531-7fd25bc2d48e+7:2358:x1874160192140544:12345-192.168.201.53@tcp:2:lhsmtool_posix.0 Request processed in 345us (688us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1787338732.874502:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 50 00000100:00080000:2.0:1787338732.874555:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787338732.880095:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338732.880798:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192140800 00000100:00100000:2.0:1787338732.880810:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192140800 00000100:00100000:2.0:1787338732.880909:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 49 00000100:00100000:2.0:1787338732.880920:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4096a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:83642291-0761-4205-9531-7fd25bc2d48e+60:11508:x1874160192140800:12345-192.168.201.53@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787338732.881160:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4096a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:83642291-0761-4205-9531-7fd25bc2d48e+61:11508:x1874160192140800:12345-192.168.201.53@tcp:35:lhsmtool_posix.0 Request processed in 241us (1075us total) trans 4294967460 rc 0/0 00000100:00100000:2.0:1787338732.881169:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 49 00000100:00100000:1.0:1787338732.893349:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338732.893428:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192141056 00000100:00100000:3.0:1787338732.893439:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192141056 00000100:00100000:3.0:1787338732.893503:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 180 00000100:00100000:3.0:1787338732.893514:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4097800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+61:11508:x1874160192141056:12345-192.168.201.53@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787338732.893645:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4097800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+61:11508:x1874160192141056:12345-192.168.201.53@tcp:57:lhsmtool_posix.0 Request processed in 132us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338732.893662:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 180 00000100:00100000:2.0:1787338732.897419:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338732.897489:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192141184 00000100:00100000:0.0:1787338732.897498:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192141184 00000100:00100000:0.0:1787338732.897559:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 181 00000100:00100000:0.0:1787338732.897580:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf7ed4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+61:11508:x1874160192141184:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787338732.897602:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787338732.897625:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5e00/0x83671231080c2056 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab953 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338732.897715:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5600/0x83671231080c205d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338732.897731:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5600/0x83671231080c205d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338732.897743:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5600/0x83671231080c205d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787338732.897783:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787338732.897801:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5600/0x83671231080c205d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338732.897828:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5e00/0x83671231080c2056 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab953 expref: 63 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338732.897845:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5600/0x83671231080c205d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab953 expref: 62 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338732.897854:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff90bbeb14da00) 00010000:00010000:0.0:1787338732.897858:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787338732.897906:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbffef5600, rc 0) 00000100:00100000:0.0:1787338732.897965:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf7ed4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+62:11508:x1874160192141184:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 Request processed in 387us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338732.897981:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 181 00000100:00100000:2.0:1787338732.908137:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338732.908224:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192141312 00000100:00100000:3.0:1787338732.908236:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192141312 00000100:00100000:3.0:1787338732.908300:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 51 00000100:00100000:3.0:1787338732.908329:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf7ed5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:83642291-0761-4205-9531-7fd25bc2d48e+7:2359:x1874160192141312:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787338732.908351:0:6689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787338732.908373:0:6689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007edf8508/0x83671231080c2064 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab95a expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787338732.908403:0:6689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a889fec, blocks: 0x1 00010000:00010000:3.0:1787338732.908422:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=385s v=(0 0) 00010000:00010000:3.0:1787338732.908428:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787338732.908438:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007edf8508/0x83671231080c2064 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab95a expref: 8 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338732.908455:0:6689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007edf8508/0x83671231080c2064 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab95a expref: 8 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338732.908469:0:6689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf7ea5000, rc 0) 00000100:00100000:3.0:1787338732.908523:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf7ed5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:83642291-0761-4205-9531-7fd25bc2d48e+8:2359:x1874160192141312:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 Request processed in 214us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338732.908530:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 51 00000100:00100000:3.0:1787338732.915277:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338732.915325:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192141568 00000100:00100000:3.0:1787338732.915337:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192141568 00000100:00100000:3.0:1787338732.915406:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 182 00000100:00100000:3.0:1787338732.915416:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbedcb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+62:11508:x1874160192141568:12345-192.168.201.53@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787338732.915522:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbedcb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+62:11508:x1874160192141568:12345-192.168.201.53@tcp:57:lhsmtool_posix.0 Request processed in 108us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338732.915530:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 182 00000100:00100000:3.0:1787338732.929776:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338732.929811:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192141696 00000100:00100000:3.0:1787338732.929821:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192141696 00000100:00100000:3.0:1787338732.930007:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 52 00000100:00100000:3.0:1787338732.930020:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbedcb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:83642291-0761-4205-9531-7fd25bc2d48e+8:11508:x1874160192141696:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787338732.930040:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787338732.930059:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000003ae84a4/0x83671231080c206b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab961 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338732.930091:0:6691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007edf8508/0x83671231080c2064 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab95a expref: 9 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338732.930101:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787338732.930105:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787338732.930110:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003ae84a4/0x83671231080c206b lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab961 expref: 9 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338732.930145:0:6691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007edf8508/0x83671231080c2064 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab95a expref: 9 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338732.930160:0:6691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007edf8508/0x83671231080c2064 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab95a expref: 9 pid: 6689 timeout: 485 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338732.930185:0:6691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbedcb7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6691:1874160212059136:192.168.201.53@tcp:104: 00000100:00100000:3.0:1787338732.930274:0:6691:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbedc573c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787338732.946130:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338732.946401:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192141824 00000100:00100000:0.0:1787338732.946412:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192141824 00010000:00010000:0.0:1787338732.946453:0:6704:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007edf8508/0x83671231080c2064 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab95a expref: 10 pid: 6689 timeout: 485 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338732.946502:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 69 00000100:00100000:0.0:1787338732.946513:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf7ed7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:83642291-0761-4205-9531-7fd25bc2d48e+10:2359:x1874160192141824:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787338732.946529:0:6704:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787338732.946553:0:6704:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007edf8508/0x83671231080c2064 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab95a expref: 10 pid: 6689 timeout: 485 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338732.946568:0:6704:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007edf8508/0x83671231080c2064 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab95a expref: 10 pid: 6689 timeout: 485 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338732.946593:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787338732.946598:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787338732.946607:0:6704:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000003ae84a4/0x83671231080c206b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab961 expref: 10 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338732.946618:0:6704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003ae84a4/0x83671231080c206b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab961 expref: 10 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338732.946658:0:6704:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000003ae84a4/0x83671231080c206b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab961 expref: 10 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338732.946688:0:6704:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc91ddf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6704:1874160212059264:192.168.201.53@tcp:105: 00000100:00100000:0.0:1787338732.946786:0:6704:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbf41c16c0 going to sleep for 11 seconds 00010000:00010000:3.0:1787338732.948143:0:6691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007edf8508/0x83671231080c2064 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab95a expref: 10 pid: 6689 timeout: 485 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338732.948161:0:6691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbedcb7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6691:1874160212059136:192.168.201.53@tcp:104: 00010000:00010000:3.0:1787338732.948188:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000003ae84a4/0x83671231080c206b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab961 expref: 9 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338732.948202:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf7ea5c00, rc 0) 00000100:00100000:3.0:1787338732.948296:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbedcb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:83642291-0761-4205-9531-7fd25bc2d48e+9:11508:x1874160192141696:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 Request processed in 18278us (18530us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338732.948305:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 52 00000100:00100000:0.0:1787338732.949781:0:6704:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc91ddf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6704:1874160212059264:192.168.201.53@tcp:105: 00010000:00010000:0.0:1787338732.949806:0:6704:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787338732.951047:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf7ed7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:83642291-0761-4205-9531-7fd25bc2d48e+8:2359:x1874160192141824:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 4362us (4753us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338732.951061:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 69 00000100:00100000:1.0:1787338732.951578:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338732.952140:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192141952 00000100:00100000:3.0:1787338732.952151:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192141952 00002000:00100000:3.0:1787338732.952196:0:6694:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff90bbc4096d80 x1874160192141952/t0(0) o4->83642291-0761-4205-9531-7fd25bc2d48e@192.168.201.53@tcp:63/0 lens 504/0 e 0 to 0 dl 1787338743 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787338732.952207:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90bbc4096d80 with x1874160192141952 ext(0->8) 00002000:00010000:3.0:1787338732.952213:0:6694:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90bbc4096d80 00000100:00100000:3.0:1787338732.952249:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 4 00000100:00100000:3.0:1787338732.952259:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4096d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:83642291-0761-4205-9531-7fd25bc2d48e+8:2358:x1874160192141952:12345-192.168.201.53@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1787338732.952683:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4096d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:83642291-0761-4205-9531-7fd25bc2d48e+10:2358:x1874160192141952:12345-192.168.201.53@tcp:4:lhsmtool_posix.0 Request processed in 425us (1106us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1787338732.952696:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 4 00002000:00100000:3.0:1787338732.952714:0:6694:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff90bbc4096d80 x1874160192141952/t4294967314(0) o4->83642291-0761-4205-9531-7fd25bc2d48e@192.168.201.53@tcp:63/0 lens 504/448 e 0 to 0 dl 1787338743 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787338732.952724:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90bbc4096d80 with x1874160192141952 ext(0->8) 00002000:00010000:3.0:1787338732.952727:0:6694:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90bbc4096d80 00000100:00100000:0.0:1787338732.961258:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338732.961408:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192142080 00000100:00100000:3.0:1787338732.961419:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192142080 00000100:00100000:3.0:1787338732.961477:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 183 00000100:00100000:3.0:1787338732.961488:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc91ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+62:11508:x1874160192142080:12345-192.168.201.53@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1787338733.025789:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967459 is committed 00000004:00080000:2.0:1787338733.025804:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000004:00080000:2.0:1787338733.025840:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:2.0:1787338733.025916:0:5861:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90bbc818c240 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:2.0:1787338733.025922:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90bbfffc5e00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90bbeb056c00 00000020:00080000:2.0:1787338733.025925:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90bbfffc5900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90bbf4118800 00000001:00080000:2.0:1787338733.025951:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000100:00100000:0.0:1787338733.026215:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787338733.026234:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee44c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874160212059392:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1787338733.026301:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338733.026527:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc91ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+18:11508:x1874160192142080:12345-192.168.201.53@tcp:44:lhsmtool_posix.0 Request processed in 65038us (65277us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338733.026538:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 183 00000020:00080000:1.0:1787338733.026629:0:5872:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:1.0:1787338733.026807:0:5872:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:1.0:1787338733.026823:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbffa2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874160212059520:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787338733.026853:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338733.027246:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212059392 00000100:00100000:1.0:1787338733.027254:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212059392 00000100:00100000:1.0:1787338733.027299:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212059520 00000100:00100000:1.0:1787338733.027303:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212059520 00000100:00100000:1.0:1787338733.027337:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787338733.027345:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee44fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1874160212059392:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1787338733.027485:0:6690:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1787338733.027489:0:6690:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787338732 00002000:00010000:1.0:1787338733.027491:0:6690:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787338733.027493:0:6690:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1787338732 -> 1787338732 00002000:00010000:1.0:1787338733.027495:0:6690:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787338733.027535:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee44fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3317:x1874160212059392:12345-0@lo:2:osp-syn-0-0.0 Request processed in 191us (1233us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1787338733.027542:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787338733.027567:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787338733.027574:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1874160212059520:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1787338733.027592:0:6690:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:1.0:1787338733.027616:0:6690:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a889fe9, atime: 0x6a889fe9, ctime: 0x6a889fe9, blocks: 0xb 00010000:00010000:1.0:1787338733.027624:0:6690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7914893/0x83671231080c2072 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338733.027640:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=385s v=(0 0) 00010000:00010000:1.0:1787338733.027644:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787338733.027650:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b7914893/0x83671231080c2072 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338733.027665:0:6690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b7914893/0x83671231080c2072 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338733.027674:0:6690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7914893/0x83671231080c2072 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338733.027681:0:6690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b7914893/0x83671231080c2072 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338733.027697:0:6690:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:0.0:1787338733.028018:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787338733.028023:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787338733.028606:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3317:x1874160212059520:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1029us (1749us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1787338733.028614:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00010000:1.0:1787338733.028636:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787338733.028644:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b7914893/0x83671231080c2072 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338733.028660:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbfbe9c800 already unused, calling callback (ffffffffc1546230) 00010000:00010000:1.0:1787338733.028665:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7914893/0x83671231080c2072 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338733.028675:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7914893/0x83671231080c2072 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338733.028693:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b7914893/0x83671231080c2072 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338733.028701:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b7914893/0x83671231080c2072 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338733.028721:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338733.028723:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338733.028725:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787338733.028754:0:3317:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:1.0:1787338733.028760:0:3317:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:1.0:1787338733.028783:0:3317:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff90bbffa2ea00 x1874160212059520/t4294967307(4294967307) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787338749 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1787338733.028795:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90bbffa2ea00/2, rc 0, transno 4294967307 00000100:00100000:1.0:1787338733.028801:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbffa2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874160212059520:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1787338733.028814:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90bbee44c380/2, rc 0, transno 4294967315 00000100:00100000:1.0:1787338733.028819:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee44c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874160212059392:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1787338733.029847:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338733.030374:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192142208 00000100:00100000:0.0:1787338733.030383:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192142208 00000100:00100000:0.0:1787338733.030485:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 55 00000100:00100000:0.0:1787338733.030496:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf7ed7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:83642291-0761-4205-9531-7fd25bc2d48e+10:2356:x1874160192142208:12345-192.168.201.53@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1787338733.070440:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000001:00080000:1.0:1787338733.070470:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000100:00100000:0.0:1787338733.070849:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf7ed7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:83642291-0761-4205-9531-7fd25bc2d48e+7:2356:x1874160192142208:12345-192.168.201.53@tcp:16:lhsmtool_posix.0 Request processed in 40349us (41001us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338733.070862:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 55 00000100:00100000:0.0:1787338733.072699:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338733.072777:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192142464 00000100:00100000:3.0:1787338733.072787:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192142464 00000100:00100000:3.0:1787338733.072859:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 184 00000100:00080000:0.0:1787338733.072927:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787338733.073421:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee44f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+18:11508:x1874160192142464:12345-192.168.201.53@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787338733.073468:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787338733.073491:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5600/0x83671231080c205d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab953 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338733.073507:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff90bbeb14da00) 00010000:00010000:3.0:1787338733.073510:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787338733.073534:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5000/0x83671231080c2079 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338733.073545:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5000/0x83671231080c2079 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338733.073550:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5000/0x83671231080c2079 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787338733.073767:0:5840:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a74aede1 reply state 00000000b11fee63 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5000/0x83671231080c2079 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338733.073774:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787338733.073978:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee44f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+19:11508:x1874160192142464:12345-192.168.201.53@tcp:36:lhsmtool_posix.0 Request processed in 1109us (1288us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1787338733.073984:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 184 00000100:00100000:3.0:1787338733.075586:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338733.075648:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192142592 00000100:00100000:0.0:1787338733.075656:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192142592 00000100:00100000:0.0:1787338733.075703:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 56 00000100:00100000:0.0:1787338733.075713:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbedcb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:83642291-0761-4205-9531-7fd25bc2d48e+7:2358:x1874160192142592:12345-192.168.201.53@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787338733.075951:0:6689:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1787338733.075954:0:6689:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1787338732 -> 1787338731 00002000:00010000:0.0:1787338733.075956:0:6689:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787338729 00002000:00010000:0.0:1787338733.075958:0:6689:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1787338732 -> 1787338731 00002000:00010000:0.0:1787338733.075959:0:6689:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1787338733.076005:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbedcb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:83642291-0761-4205-9531-7fd25bc2d48e+8:2358:x1874160192142592:12345-192.168.201.53@tcp:2:lhsmtool_posix.0 Request processed in 294us (423us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1787338733.076010:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 56 00010000:00010000:2.0:1787338733.076653:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5000/0x83671231080c2079 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338733.076665:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5000/0x83671231080c2079 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338733.076673:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5000/0x83671231080c2079 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338733.076679:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea5000 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:2.0:1787338733.076683:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5000/0x83671231080c2079 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338733.076690:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5000/0x83671231080c2079 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338733.076707:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff90bbeb14da00) 00010000:00010000:2.0:1787338733.076710:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787338733.076714:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5000/0x83671231080c2079 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338733.076719:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5000/0x83671231080c2079 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338733.078062:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338733.078102:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192142848 00000100:00100000:1.0:1787338733.078111:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192142848 00000100:00100000:1.0:1787338733.078157:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 185 00000100:00100000:1.0:1787338733.078168:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf7ed6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+18:11508:x1874160192142848:12345-192.168.201.53@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1787338733.078233:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c800/0x83671231080c2080 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338733.078245:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c2041 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab945 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338733.078251:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c800/0x83671231080c2080 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338733.078275:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c2041 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab945 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338733.078285:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c2041 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab945 expref: 18 pid: 5839 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338733.078295:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbffa2c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5841:1874160212059648:192.168.201.53@tcp:104: 00000100:00100000:1.0:1787338733.078395:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbeb056c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787338733.081786:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbffa2c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5841:1874160212059648:192.168.201.53@tcp:104: 00000100:00100000:2.0:1787338733.081809:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00010000:00010000:1.0:1787338733.081816:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c800/0x83671231080c2080 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338733.082192:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192142976 00000100:00100000:1.0:1787338733.082199:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192142976 00010000:00010000:1.0:1787338733.082240:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c2041 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab945 expref: 19 pid: 5839 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338733.082300:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 70 00000100:00100000:1.0:1787338733.082318:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf7ed4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:83642291-0761-4205-9531-7fd25bc2d48e+19:2359:x1874160192142976:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787338733.082338:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787338733.082345:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c2041 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab945 expref: 19 pid: 5839 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338733.082358:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c2041 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab945 expref: 19 pid: 5839 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338733.082381:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c2041 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab945 expref: 19 pid: 5839 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338733.082393:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff90bbeb14da00) 00010000:00010000:1.0:1787338733.082397:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c800/0x83671231080c2080 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338733.082403:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c800/0x83671231080c2080 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338733.082408:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c800/0x83671231080c2080 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338733.084058:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c800/0x83671231080c2080 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338733.084074:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c800/0x83671231080c2080 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338733.084097:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787338733.084105:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c800/0x83671231080c2080 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338733.084121:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c800/0x83671231080c2080 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338733.084127:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c800/0x83671231080c2080 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338733.084133:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbfbe9c800 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:3.0:1787338733.084137:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c800/0x83671231080c2080 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338733.084144:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c800/0x83671231080c2080 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338733.084174:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff90bbeb14da00) 00010000:00010000:3.0:1787338733.084177:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1787338733.084181:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c800/0x83671231080c2080 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338733.084188:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c800/0x83671231080c2080 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338733.084220:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf7ed4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:83642291-0761-4205-9531-7fd25bc2d48e+18:2359:x1874160192142976:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 1907us (2406us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338733.084229:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 70 00000100:00100000:3.0:1787338733.084241:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf7ed6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+18:11508:x1874160192142848:12345-192.168.201.53@tcp:55:lhsmtool_posix.0 Request processed in 6076us (6187us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787338733.084248:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 185 00000100:00100000:3.0:1787338733.087399:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338733.087538:0:10743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192143104 00000100:00100000:0.0:1787338733.087546:0:10743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192143104 00000100:00100000:0.0:1787338733.087611:0:10743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 57 00000100:00100000:0.0:1787338733.087619:0:10743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbedcb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:83642291-0761-4205-9531-7fd25bc2d48e+8:2359:x1874160192143104:12345-192.168.201.53@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787338733.087661:0:10743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006f9d2ca8/0x83671231080c2087 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338733.087678:0:10743:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000003ae84a4/0x83671231080c206b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab961 expref: 8 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338733.087684:0:10743:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787338733.087687:0:10743:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787338733.087691:0:10743:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006f9d2ca8/0x83671231080c2087 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338733.087732:0:10743:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000003ae84a4/0x83671231080c206b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab961 expref: 8 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338733.087764:0:10743:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000003ae84a4/0x83671231080c206b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab961 expref: 8 pid: 6691 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338733.087779:0:10743:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee44df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10743:1874160212059776:192.168.201.53@tcp:104: 00000100:00100000:0.0:1787338733.087864:0:10743:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbf41c1480 going to sleep for 11 seconds 00000100:00100000:3.0:1787338733.091322:0:10743:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee44df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10743:1874160212059776:192.168.201.53@tcp:104: 00010000:00010000:3.0:1787338733.091374:0:10743:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006f9d2ca8/0x83671231080c2087 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338733.091686:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338733.091761:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192143232 00000100:00100000:2.0:1787338733.091768:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192143232 00010000:00010000:2.0:1787338733.091803:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000003ae84a4/0x83671231080c206b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab961 expref: 9 pid: 6691 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338733.091841:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 71 00000100:00100000:2.0:1787338733.091851:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc2d31c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:83642291-0761-4205-9531-7fd25bc2d48e+9:2358:x1874160192143232:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787338733.091866:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787338733.091914:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000003ae84a4/0x83671231080c206b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab961 expref: 9 pid: 6691 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338733.091938:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000003ae84a4/0x83671231080c206b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab961 expref: 9 pid: 6691 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338733.091962:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000003ae84a4/0x83671231080c206b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab961 expref: 9 pid: 6691 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338733.091977:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787338733.091981:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787338733.091987:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006f9d2ca8/0x83671231080c2087 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338733.091997:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006f9d2ca8/0x83671231080c2087 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338733.092028:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787338733.092085:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc2d31c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:83642291-0761-4205-9531-7fd25bc2d48e+8:2358:x1874160192143232:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 235us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338733.092106:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 71 00010000:00010000:3.0:1787338733.092214:0:10743:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006f9d2ca8/0x83671231080c2087 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338733.092224:0:10743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006f9d2ca8/0x83671231080c2087 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338733.092252:0:10743:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006f9d2ca8/0x83671231080c2087 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338733.092272:0:10743:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006f9d2ca8/0x83671231080c2087 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338733.092280:0:10743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006f9d2ca8/0x83671231080c2087 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338733.092288:0:10743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbffef4400 already unused, calling callback (ffffffffc1546230) 00010000:00010000:3.0:1787338733.092292:0:10743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006f9d2ca8/0x83671231080c2087 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338733.092301:0:10743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006f9d2ca8/0x83671231080c2087 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338733.092323:0:10743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006f9d2ca8/0x83671231080c2087 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338733.092330:0:10743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006f9d2ca8/0x83671231080c2087 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338733.092382:0:10743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbedcb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:83642291-0761-4205-9531-7fd25bc2d48e+7:2359:x1874160192143104:12345-192.168.201.53@tcp:1:lhsmtool_posix.0 Request processed in 4759us (4988us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338733.092394:0:10743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 57 00000100:00100000:0.0:1787338733.094793:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338733.095119:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192143488 00000100:00100000:1.0:1787338733.095128:0:7647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192143488 00000100:00100000:1.0:1787338733.095187:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 186 00000100:00100000:1.0:1787338733.095198:0:7647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee44c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+17:11508:x1874160192143488:12345-192.168.201.53@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787338733.095272:0:7647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9da00/0x83671231080c208e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338733.095289:0:7647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9da00/0x83671231080c208e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338733.095300:0:7647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9da00/0x83671231080c208e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338733.095512:0:7647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d200/0x83671231080c2095 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338733.095524:0:7647:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c204f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab94c expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338733.095532:0:7647:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d200/0x83671231080c2095 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338733.095561:0:7647:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c204f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab94c expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338733.095573:0:7647:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c204f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab94c expref: 18 pid: 5839 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338733.095588:0:7647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbffa2c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7647:1874160212059904:192.168.201.53@tcp:104: 00000100:00100000:1.0:1787338733.095664:0:7647:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbedd6b600 going to sleep for 11 seconds 00000100:00100000:3.0:1787338733.101945:0:7647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbffa2c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7647:1874160212059904:192.168.201.53@tcp:104: 00010000:00010000:3.0:1787338733.101976:0:7647:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d200/0x83671231080c2095 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338733.103973:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338733.104138:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192143616 00000100:00100000:3.0:1787338733.104147:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192143616 00010000:00010000:3.0:1787338733.104184:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c204f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab94c expref: 19 pid: 5839 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338733.104225:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 72 00000100:00100000:3.0:1787338733.104235:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee44ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:83642291-0761-4205-9531-7fd25bc2d48e+19:2358:x1874160192143616:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787338733.104249:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787338733.104256:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c204f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab94c expref: 19 pid: 5839 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338733.104269:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c204f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab94c expref: 19 pid: 5839 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338733.104289:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c204f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab94c expref: 19 pid: 5839 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338733.104303:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff90bbeb14da00) 00010000:00010000:3.0:1787338733.104320:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d200/0x83671231080c2095 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338733.104329:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d200/0x83671231080c2095 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338733.104335:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d200/0x83671231080c2095 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338733.104368:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787338733.104437:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee44ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:83642291-0761-4205-9531-7fd25bc2d48e+18:2358:x1874160192143616:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 203us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338733.104445:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 72 00010000:00010000:0.0:1787338733.104822:0:7647:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d200/0x83671231080c2095 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338733.104832:0:7647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d200/0x83671231080c2095 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787338733.105133:0:7647:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:0.0:1787338733.105259:0:7647:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:0.0:1787338733.105293:0:7647:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:0.0:1787338733.105373:0:7647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee44dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7647:1874160212060032:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787338733.105419:0:7647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338733.105721:0:7647:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbf41c19c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787338733.106282:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212060032 00000100:00100000:2.0:1787338733.106290:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212060032 00000100:00100000:2.0:1787338733.106595:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787338733.106604:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee44d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7647:x1874160212060032:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787338733.106730:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee44d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7647:x1874160212060032:12345-0@lo:1000:mdt00_003.0 Request processed in 121us (1303us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338733.106737:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787338733.107555:0:7647:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:0.0:1787338733.107562:0:7647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90bbee44c380, transno 4294967315 00000100:00100000:0.0:1787338733.107575:0:7647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee44dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7647:1874160212060032:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1787338733.108593:0:7647:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:0.0:1787338733.108661:0:7647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee44dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7647:1874160212060160:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787338733.108824:0:7647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338733.109050:0:7647:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbde5f80c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787338733.109231:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212060160 00000100:00100000:2.0:1787338733.109237:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212060160 00000100:00100000:2.0:1787338733.109271:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787338733.109280:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee44c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7647:x1874160212060160:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787338733.109487:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee44c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7647:x1874160212060160:12345-0@lo:1000:mdt00_003.0 Request processed in 208us (662us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1787338733.109494:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787338733.109560:0:7647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee44dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7647:1874160212060160:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1787338733.109597:0:7647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d200/0x83671231080c2095 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338733.109606:0:7647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d200/0x83671231080c2095 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338733.109613:0:7647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d200/0x83671231080c2095 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338733.109618:0:7647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbfbe9d200 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:0.0:1787338733.109623:0:7647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d200/0x83671231080c2095 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338733.109630:0:7647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d200/0x83671231080c2095 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338733.109646:0:7647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff90bbeb14da00) 00010000:00010000:0.0:1787338733.109649:0:7647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787338733.109654:0:7647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d200/0x83671231080c2095 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338733.109659:0:7647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d200/0x83671231080c2095 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338733.109690:0:7647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c53600/0x83671231080c1fca lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338733.109696:0:7647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c53600/0x83671231080c1fca lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338733.109713:0:7647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c53600/0x83671231080c1fca lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338733.109723:0:7647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf3c53600 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:0.0:1787338733.109792:0:7647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c53600/0x83671231080c1fca lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338733.109798:0:7647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c53600/0x83671231080c1fca lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338733.109806:0:7647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90bbdee56a00) 00010000:00010000:0.0:1787338733.109809:0:7647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787338733.109812:0:7647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c53600/0x83671231080c1fca lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338733.109817:0:7647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c53600/0x83671231080c1fca lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338733.109837:0:7647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5a00/0x83671231080c209c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338733.109849:0:7647:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52e00/0x83671231080c1fe6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab930 expref: 21 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338733.109857:0:7647:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5a00/0x83671231080c209c lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338733.109924:0:7647:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52e00/0x83671231080c1fe6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab930 expref: 21 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338733.110075:0:7647:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52e00/0x83671231080c1fe6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab930 expref: 21 pid: 5840 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338733.110099:0:7647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee44df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7647:1874160212060288:192.168.201.53@tcp:104: 00000100:00100000:0.0:1787338733.110233:0:7647:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbf41c16c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787338733.114433:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338733.114640:0:7647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee44df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7647:1874160212060288:192.168.201.53@tcp:104: 00010000:00010000:3.0:1787338733.114683:0:7647:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5a00/0x83671231080c209c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338733.115417:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192143744 00000100:00100000:2.0:1787338733.115426:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192143744 00010000:00010000:2.0:1787338733.115465:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52e00/0x83671231080c1fe6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab930 expref: 22 pid: 5840 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338733.115539:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 73 00000100:00100000:2.0:1787338733.115550:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf3e93480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:83642291-0761-4205-9531-7fd25bc2d48e+22:2358:x1874160192143744:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787338733.115565:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787338733.115572:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52e00/0x83671231080c1fe6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab930 expref: 22 pid: 5840 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338733.115605:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52e00/0x83671231080c1fe6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab930 expref: 22 pid: 5840 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338733.115626:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52e00/0x83671231080c1fe6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab930 expref: 22 pid: 5840 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338733.115640:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90bbdee56a00) 00010000:00010000:2.0:1787338733.115644:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5a00/0x83671231080c209c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338733.115652:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5a00/0x83671231080c209c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338733.115659:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5a00/0x83671231080c209c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338733.115690:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787338733.115816:0:7647:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5a00/0x83671231080c209c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338733.115824:0:7647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5a00/0x83671231080c209c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338733.115837:0:7647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5a00/0x83671231080c209c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338733.115843:0:7647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5a00/0x83671231080c209c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338733.115849:0:7647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5a00/0x83671231080c209c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338733.115855:0:7647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbffef5a00 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:3.0:1787338733.115860:0:7647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5a00/0x83671231080c209c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338733.115868:0:7647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5a00/0x83671231080c209c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338733.115904:0:7647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90bbdee56a00) 00010000:00010000:3.0:1787338733.115907:0:7647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787338733.115917:0:7647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5a00/0x83671231080c209c lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338733.115923:0:7647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5a00/0x83671231080c209c lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338733.115944:0:7647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9da00/0x83671231080c208e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338733.115949:0:7647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9da00/0x83671231080c208e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338733.115955:0:7647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9da00/0x83671231080c208e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338733.115960:0:7647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbfbe9da00 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:3.0:1787338733.115963:0:7647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9da00/0x83671231080c208e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338733.115968:0:7647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9da00/0x83671231080c208e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338733.115976:0:7647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90bbdee56a00) 00010000:00010000:3.0:1787338733.115978:0:7647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787338733.115980:0:7647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9da00/0x83671231080c208e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338733.115985:0:7647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9da00/0x83671231080c208e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338733.116467:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf3e93480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:83642291-0761-4205-9531-7fd25bc2d48e+21:2358:x1874160192143744:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 915us (2042us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338733.116476:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 73 00000040:00080000:1.0:1787338733.116652:0:11692:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787338733.116657:0:11692:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787338733.117210:0:11692:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:1.0:1787338733.117222:0:11692:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787338733.117617:0:7647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee44c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+20:11508:x1874160192143488:12345-192.168.201.53@tcp:57:lhsmtool_posix.0 Request processed in 22417us (22828us total) trans 4294967466 rc 0/0 00000100:00100000:3.0:1787338733.117628:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 186 00000020:00080000:3.0:1787338733.117647:0:7647:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1787338733.120689:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338733.120810:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192144000 00000100:00100000:0.0:1787338733.120820:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192144000 00000100:00100000:0.0:1787338733.120918:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 50 00000100:00100000:0.0:1787338733.121043:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbd894f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:83642291-0761-4205-9531-7fd25bc2d48e+20:11508:x1874160192144000:12345-192.168.201.53@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1787338733.122476:0:5843:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1787338733.122603:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:1.0:1787338733.122661:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c600/0x83671231080c20a3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338733.122678:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c600/0x83671231080c20a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338733.122690:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c600/0x83671231080c20a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338733.122699:0:5843:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c600/0x83671231080c20a3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338733.122719:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c600/0x83671231080c20a3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338733.123332:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c600/0x83671231080c20a3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338733.123381:0:5843:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787338733.123480:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbd894f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:83642291-0761-4205-9531-7fd25bc2d48e+22:11508:x1874160192144000:12345-192.168.201.53@tcp:35:lhsmtool_posix.0 Request processed in 2548us (2798us total) trans 4294967468 rc 0/0 00000100:00100000:1.0:1787338733.123489:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 50 00000020:00080000:1.0:1787338733.123496:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787338733.125345:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787338733.125360:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c600/0x83671231080c20a3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338733.125373:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbfbe9c600 already unused, calling callback (ffffffffc1546230) 00010000:00010000:2.0:1787338733.125378:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c600/0x83671231080c20a3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338733.125388:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c600/0x83671231080c20a3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338733.125425:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff90bbc2a93c00) 00010000:00010000:2.0:1787338733.125428:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787338733.125433:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c600/0x83671231080c20a3 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338733.125440:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c600/0x83671231080c20a3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338733.125462:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787338733.125464:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787338733.125466:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787338733.302013:0:11676:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787338734.326062:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787338734.654275:0:12525:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787338734.654298:0:12525:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787338734.654332:0:12525:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1787338734.654338:0:12525:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787338734.710402:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787338734.710427:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf3e92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874160212060416:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787338734.710522:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338734.710719:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212060416 00000100:00100000:0.0:1787338734.710729:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212060416 00000100:00100000:0.0:1787338734.710799:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787338734.710811:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1874160212060416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787338734.710851:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787338734.710961:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1874160212060416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 152us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338734.710980:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787338734.711043:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf3e92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874160212060416:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787338734.834637:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338734.837563:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192144256 00000100:00100000:0.0:1787338734.837577:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192144256 00000100:00100000:0.0:1787338734.838590:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 187 00000100:00100000:0.0:1787338734.838605:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf7ed4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+22:11526:x1874160192144256:12345-192.168.201.53@tcp:101:lfs.0 00010000:00010000:0.0:1787338734.838633:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787338734.838653:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5800/0x83671231080c20aa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab968 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338734.838975:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4c00/0x83671231080c20b1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338734.838992:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4c00/0x83671231080c20b1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338734.839004:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4c00/0x83671231080c20b1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787338734.839015:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:0.0:1787338734.839211:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5800/0x83671231080c20aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab968 expref: 25 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338734.839228:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4c00/0x83671231080c20b1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab968 expref: 24 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338734.839935:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff90bbeb14d600) 00010000:00010000:0.0:1787338734.839939:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787338734.839943:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbffef4c00, rc 0) 00000100:00100000:0.0:1787338734.840015:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf7ed4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+24:11526:x1874160192144256:12345-192.168.201.53@tcp:101:lfs.0 Request processed in 1412us (5386us total) trans 4294967469 rc 0/0 00000100:00100000:0.0:1787338734.840023:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 187 00000100:00100000:0.0:1787338734.843269:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338734.843352:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192144384 00000100:00100000:3.0:1787338734.843362:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192144384 00000100:00100000:3.0:1787338734.843420:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 188 00000100:00100000:3.0:1787338734.843431:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf3e92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+24:11526:x1874160192144384:12345-192.168.201.53@tcp:34:lfs.0 00010000:00010000:3.0:1787338734.843514:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c20bf lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338734.843532:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c20bf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338734.843544:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c20bf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338734.843561:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4000/0x83671231080c20c6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338734.843568:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4000/0x83671231080c20c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338734.843575:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4000/0x83671231080c20c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338734.844060:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4800/0x83671231080c20cd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338734.844069:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4800/0x83671231080c20cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338734.844075:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4800/0x83671231080c20cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787338734.844114:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4800/0x83671231080c20cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338734.844134:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c20bf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338734.844139:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c20bf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338734.844146:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c20bf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338734.844151:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea5a00 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:3.0:1787338734.844155:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c20bf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338734.844162:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c20bf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338734.844174:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff90bbeb14d600) 00010000:00010000:3.0:1787338734.844176:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787338734.844180:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c20bf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338734.844185:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c20bf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338734.844196:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4000/0x83671231080c20c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338734.844201:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4000/0x83671231080c20c6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338734.844206:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4000/0x83671231080c20c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338734.844215:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea4000 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:3.0:1787338734.844218:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4000/0x83671231080c20c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338734.844223:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4000/0x83671231080c20c6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338734.844229:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff90bbd38d6100) 00010000:00010000:3.0:1787338734.844231:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787338734.844233:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4000/0x83671231080c20c6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338734.844238:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4000/0x83671231080c20c6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338734.844502:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4800/0x83671231080c20cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338734.844509:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4800/0x83671231080c20cd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338734.844514:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4800/0x83671231080c20cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338734.844518:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea4800 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:3.0:1787338734.844521:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4800/0x83671231080c20cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338734.844526:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4800/0x83671231080c20cd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338734.844543:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90bbd38d6c00) 00010000:00010000:3.0:1787338734.844546:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787338734.844549:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4800/0x83671231080c20cd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338734.844554:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4800/0x83671231080c20cd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338734.844763:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf3e92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+24:11526:x1874160192144384:12345-192.168.201.53@tcp:34:lfs.0 Request processed in 1332us (1503us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338734.844772:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 188 00000100:00100000:0.0:1787338734.925842:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338734.926027:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192144640 00000100:00100000:2.0:1787338734.926036:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192144640 00000100:00100000:2.0:1787338734.926120:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 189 00000100:00100000:2.0:1787338734.926130:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf3e90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+24:11529:x1874160192144640:12345-192.168.201.53@tcp:101:lfs.0 00010000:00010000:2.0:1787338734.926151:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787338734.926172:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52a00/0x83671231080c20d4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab96f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338734.926248:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c53000/0x83671231080c20db lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338734.926262:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c53000/0x83671231080c20db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338734.926300:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c53000/0x83671231080c20db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338734.926314:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c53e00/0x83671231080c20e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338734.926321:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c53e00/0x83671231080c20e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338734.926326:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c53e00/0x83671231080c20e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338734.926778:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52800/0x83671231080c20e9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338734.926788:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52800/0x83671231080c20e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338734.926795:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52800/0x83671231080c20e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787338734.926805:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1787338734.928796:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c53000/0x83671231080c20db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338734.928816:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c53000/0x83671231080c20db lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338734.928824:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c53000/0x83671231080c20db lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338734.928830:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf3c53000 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:3.0:1787338734.928835:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c53000/0x83671231080c20db lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338734.928843:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c53000/0x83671231080c20db lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338734.928860:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff90bbeb14d600) 00010000:00010000:3.0:1787338734.928863:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787338734.928867:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c53000/0x83671231080c20db lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338734.929357:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c53000/0x83671231080c20db lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338734.929370:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c53e00/0x83671231080c20e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338734.929376:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c53e00/0x83671231080c20e2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338734.929383:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c53e00/0x83671231080c20e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338734.929388:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf3c53e00 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:3.0:1787338734.929392:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c53e00/0x83671231080c20e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338734.929398:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c53e00/0x83671231080c20e2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338734.929406:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff90bbdee56900) 00010000:00010000:3.0:1787338734.929409:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787338734.929412:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c53e00/0x83671231080c20e2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338734.929417:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c53e00/0x83671231080c20e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338734.929533:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52a00/0x83671231080c20d4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab96f expref: 27 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338734.929549:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52800/0x83671231080c20e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab96f expref: 26 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338734.929564:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90bbdee56600) 00010000:00010000:3.0:1787338734.929566:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787338734.929569:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf3c52800, rc 0) 00000100:00100000:3.0:1787338734.929682:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf3e90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+26:11529:x1874160192144640:12345-192.168.201.53@tcp:101:lfs.0 Request processed in 3551us (3851us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1787338734.929699:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 189 00000100:00100000:0.0:1787338734.935456:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338734.935538:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192144768 00000100:00100000:3.0:1787338734.935548:0:7647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192144768 00000100:00100000:3.0:1787338734.935607:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 190 00000100:00100000:3.0:1787338734.935618:0:7647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf3e93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+26:11529:x1874160192144768:12345-192.168.201.53@tcp:54:lfs.0 00010000:00010000:3.0:1787338734.936033:0:7647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4800/0x83671231080c20f7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338734.936049:0:7647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4800/0x83671231080c20f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338734.936060:0:7647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4800/0x83671231080c20f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338734.936087:0:7647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4800/0x83671231080c20f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338734.936093:0:7647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4800/0x83671231080c20f7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338734.936100:0:7647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4800/0x83671231080c20f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338734.936105:0:7647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea4800 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:3.0:1787338734.936227:0:7647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4800/0x83671231080c20f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338734.936235:0:7647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4800/0x83671231080c20f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338734.936248:0:7647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90bbdee56600) 00010000:00010000:3.0:1787338734.936252:0:7647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787338734.936256:0:7647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4800/0x83671231080c20f7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338734.936263:0:7647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4800/0x83671231080c20f7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338734.936357:0:7647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf3e93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+26:11529:x1874160192144768:12345-192.168.201.53@tcp:54:lfs.0 Request processed in 739us (909us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338734.936365:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 190 00000100:00100000:0.0:1787338734.941289:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338734.941450:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192145024 00000100:00100000:3.0:1787338734.941461:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192145024 00000100:00100000:3.0:1787338734.941520:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 51 00000100:00100000:3.0:1787338734.941531:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf3e91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:83642291-0761-4205-9531-7fd25bc2d48e+26:11529:x1874160192145024:12345-192.168.201.53@tcp:35:lfs.0 00000100:00100000:3.0:1787338734.941919:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf3e91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:83642291-0761-4205-9531-7fd25bc2d48e+27:11529:x1874160192145024:12345-192.168.201.53@tcp:35:lfs.0 Request processed in 389us (646us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1787338734.941929:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 51 00000100:00100000:1.0:1787338734.974390:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338734.974559:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192145280 00000100:00100000:0.0:1787338734.974581:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192145280 00000100:00100000:0.0:1787338734.974645:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 191 00000100:00100000:0.0:1787338734.974656:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+27:11055:x1874160192145280:12345-192.168.201.53@tcp:101:bash.0 00010000:00010000:0.0:1787338734.974681:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787338734.974715:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5400/0x83671231080c20fe lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab976 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338734.974819:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5800/0x83671231080c2105 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338734.974833:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52800/0x83671231080c20e9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab96f expref: 28 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338734.974842:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5800/0x83671231080c2105 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338734.974912:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52800/0x83671231080c20e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab96f expref: 28 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338734.974927:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52800/0x83671231080c20e9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab96f expref: 28 pid: 5841 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338734.974940:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf3e93800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5839:1874160212060544:192.168.201.53@tcp:104: 00000100:00100000:0.0:1787338734.975030:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbde5f8300 going to sleep for 11 seconds 00000100:00100000:3.0:1787338734.984713:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf3e93800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5839:1874160212060544:192.168.201.53@tcp:104: 00010000:00010000:3.0:1787338734.984747:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5800/0x83671231080c2105 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338734.989346:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338734.989455:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192145408 00000100:00100000:3.0:1787338734.989479:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192145408 00010000:00010000:3.0:1787338734.989520:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52800/0x83671231080c20e9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab96f expref: 29 pid: 5841 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338734.989561:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 74 00000100:00100000:3.0:1787338734.989572:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa2f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:83642291-0761-4205-9531-7fd25bc2d48e+29:2358:x1874160192145408:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787338734.989588:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787338734.989595:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52800/0x83671231080c20e9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab96f expref: 29 pid: 5841 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338734.989609:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52800/0x83671231080c20e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab96f expref: 29 pid: 5841 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338734.989633:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52800/0x83671231080c20e9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab96f expref: 29 pid: 5841 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338734.989649:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90bbdee56600) 00010000:00010000:3.0:1787338734.989655:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5800/0x83671231080c2105 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338734.989664:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5800/0x83671231080c2105 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338734.989671:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5800/0x83671231080c2105 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338734.989864:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787338734.989963:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa2f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:83642291-0761-4205-9531-7fd25bc2d48e+28:2358:x1874160192145408:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 392us (1279us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338734.989981:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 74 00010000:00010000:0.0:1787338734.990573:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5800/0x83671231080c2105 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338734.990584:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5800/0x83671231080c2105 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787338734.990614:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:0.0:1787338734.990825:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5400/0x83671231080c20fe lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab976 expref: 29 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338734.990915:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5800/0x83671231080c2105 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab976 expref: 28 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338734.990924:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90bbdee56600) 00010000:00010000:0.0:1787338734.990926:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787338734.990929:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbffef5800, rc 0) 00000100:00100000:0.0:1787338734.991767:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+28:11055:x1874160192145280:12345-192.168.201.53@tcp:101:bash.0 Request processed in 17109us (17383us total) trans 4294967472 rc 0/0 00000100:00100000:0.0:1787338734.991776:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 191 00000100:00100000:1.0:1787338735.007870:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338735.008026:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192145664 00000100:00100000:3.0:1787338735.008037:0:7647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192145664 00000100:00100000:3.0:1787338735.008115:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 192 00000100:00100000:3.0:1787338735.008126:0:7647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+28:11055:x1874160192145664:12345-192.168.201.53@tcp:36:bash.0 00010000:00010000:3.0:1787338735.008427:0:7647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4800/0x83671231080c2113 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787338735.008536:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787338735.009258:0:7647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4800/0x83671231080c2113 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338735.009287:0:7647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4800/0x83671231080c2113 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787338735.009381:0:7647:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:3.0:1787338735.009419:0:7647:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000039d1c41e reply state 000000006f9466bc transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4800/0x83671231080c2113 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338735.009427:0:7647:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1787338735.010388:0:7647:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:3.0:1787338735.011347:0:7647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+32:11055:x1874160192145664:12345-192.168.201.53@tcp:36:bash.0 Request processed in 3216us (3480us total) trans 4294967475 rc 0/0 00000100:00100000:3.0:1787338735.011356:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 192 00000020:00080000:3.0:1787338735.011362:0:7647:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:0.0:1787338735.015849:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4800/0x83671231080c2113 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338735.015868:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4800/0x83671231080c2113 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338735.015915:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4800/0x83671231080c2113 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338735.015920:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea4800 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:0.0:1787338735.015926:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4800/0x83671231080c2113 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338735.015933:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4800/0x83671231080c2113 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338735.015963:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90bbdee56600) 00010000:00010000:0.0:1787338735.015966:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787338735.015971:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4800/0x83671231080c2113 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338735.015977:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4800/0x83671231080c2113 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338735.018989:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338735.019255:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192145792 00000100:00100000:3.0:1787338735.019267:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192145792 00000100:00100000:3.0:1787338735.019340:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 193 00000100:00100000:3.0:1787338735.019352:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+31:11055:x1874160192145792:12345-192.168.201.53@tcp:101:bash.0 00010000:00010000:3.0:1787338735.019379:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787338735.019415:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4000/0x83671231080c211a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab97d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338735.019478:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4000/0x83671231080c211a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab97d expref: 32 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338735.019493:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4000/0x83671231080c211a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab97d expref: 32 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338735.019513:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90bbdee56600) 00010000:00010000:3.0:1787338735.019516:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787338735.019520:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf7ea4000, rc 0) 00000100:00100000:3.0:1787338735.019580:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+32:11055:x1874160192145792:12345-192.168.201.53@tcp:101:bash.0 Request processed in 230us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338735.019586:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 193 00000100:00100000:3.0:1787338735.025654:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338735.025748:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192145920 00000100:00100000:0.0:1787338735.025759:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192145920 00000100:00100000:0.0:1787338735.025844:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 58 00000100:00100000:0.0:1787338735.025856:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc2d30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:83642291-0761-4205-9531-7fd25bc2d48e+7:11055:x1874160192145920:12345-192.168.201.53@tcp:101:bash.0 00010000:00010000:0.0:1787338735.025904:0:6689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787338735.025926:0:6689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000044a75a54/0x83671231080c2121 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab984 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787338735.025956:0:6689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a889feb, atime: 0x6a889fe9, ctime: 0x6a889feb, blocks: 0xb 00010000:00010000:0.0:1787338735.025981:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=387s v=(0 0) 00010000:00010000:0.0:1787338735.025986:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787338735.025993:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000044a75a54/0x83671231080c2121 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab984 expref: 8 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338735.026009:0:6689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000044a75a54/0x83671231080c2121 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab984 expref: 8 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338735.026022:0:6689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbffef5400, rc 0) 00000100:00100000:0.0:1787338735.026089:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc2d30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:83642291-0761-4205-9531-7fd25bc2d48e+8:11055:x1874160192145920:12345-192.168.201.53@tcp:101:bash.0 Request processed in 235us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338735.026111:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 58 00000100:00080000:2.0:1787338735.026197:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787338735.030923:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338735.030993:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192146048 00000100:00100000:3.0:1787338735.031004:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192146048 00002000:00010000:3.0:1787338735.031051:0:6695:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:3.0:1787338735.031056:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90bbffa2c000 with x1874160192146048 ext(0->18446744073709551615) 00002000:00010000:3.0:1787338735.031067:0:6695:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90bbffa2c000. 00000100:00100000:0.0:1787338735.031154:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 5 00000100:00100000:0.0:1787338735.031168:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:83642291-0761-4205-9531-7fd25bc2d48e+8:2358:x1874160192146048:12345-192.168.201.53@tcp:10:bash.0 00002000:00010000:0.0:1787338735.031532:0:6694:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1787338735.031536:0:6694:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1787338731 -> 1787338735 00002000:00010000:0.0:1787338735.031539:0:6694:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1787338729 -> 1787338729 00002000:00010000:0.0:1787338735.031541:0:6694:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1787338731 -> 1787338735 00002000:00010000:0.0:1787338735.031544:0:6694:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1787338735.031610:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:83642291-0761-4205-9531-7fd25bc2d48e+9:2358:x1874160192146048:12345-192.168.201.53@tcp:10:bash.0 Request processed in 445us (749us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1787338735.031619:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 5 00002000:00010000:0.0:1787338735.031624:0:6694:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:0.0:1787338735.031627:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90bbffa2c000 with x1874160192146048 ext(0->18446744073709551615) 00002000:00010000:0.0:1787338735.031634:0:6694:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90bbffa2c000. 00000100:00100000:3.0:1787338735.171622:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338735.171772:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192146176 00000100:00100000:1.0:1787338735.171782:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192146176 00000100:00100000:1.0:1787338735.171853:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 194 00000100:00100000:1.0:1787338735.171865:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc2d32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+32:11543:x1874160192146176:12345-192.168.201.53@tcp:34:lfs.0 00010000:00010000:1.0:1787338735.171963:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c000/0x83671231080c2128 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338735.172094:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c000/0x83671231080c2128 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338735.172110:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c000/0x83671231080c2128 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338735.172128:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c212f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338735.172136:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c212f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338735.172143:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c212f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338735.173428:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d400/0x83671231080c2136 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338735.173454:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d400/0x83671231080c2136 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338735.173463:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d400/0x83671231080c2136 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787338735.173508:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d400/0x83671231080c2136 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338735.173520:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c000/0x83671231080c2128 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338735.174278:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c000/0x83671231080c2128 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338735.174287:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c000/0x83671231080c2128 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338735.174294:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbfbe9c000 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:1.0:1787338735.174299:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c000/0x83671231080c2128 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338735.174308:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c000/0x83671231080c2128 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338735.174323:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff90bbeb14d600) 00010000:00010000:1.0:1787338735.174326:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787338735.174331:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c000/0x83671231080c2128 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338735.174337:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c000/0x83671231080c2128 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338735.174363:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c212f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338735.174369:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c212f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338735.174375:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c212f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338735.174381:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbfbe9d800 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:1.0:1787338735.174383:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c212f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338735.174389:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c212f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338735.174397:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff90bbc2a93500) 00010000:00010000:1.0:1787338735.174399:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787338735.174402:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c212f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338735.174407:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c212f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338735.174422:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d400/0x83671231080c2136 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338735.174428:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d400/0x83671231080c2136 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338735.174434:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d400/0x83671231080c2136 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338735.174446:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbfbe9d400 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:1.0:1787338735.174449:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d400/0x83671231080c2136 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338735.174455:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d400/0x83671231080c2136 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338735.174464:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90bbdee56600) 00010000:00010000:1.0:1787338735.174466:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787338735.174468:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d400/0x83671231080c2136 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338735.174473:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d400/0x83671231080c2136 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338735.175227:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc2d32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+32:11543:x1874160192146176:12345-192.168.201.53@tcp:34:lfs.0 Request processed in 3356us (3608us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338735.175239:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 194 00000100:00100000:3.0:1787338735.222299:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf7ed6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874160212061056:0@lo:400:kworker.0 00000100:00100000:3.0:1787338735.222370:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338735.222455:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787338735.222463:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf7ed5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d79243c8-b367-45ff-8d76-fbaa4be8becb:3314:1874160212060672:0@lo:400:kworker.0 00000100:00100000:3.0:1787338735.222492:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338735.222548:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf7ed4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1874160212061184:0@lo:400:kworker.0 00000100:00100000:3.0:1787338735.222573:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338735.222605:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212060672 00000100:00100000:3.0:1787338735.222611:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212060672 00000100:00100000:3.0:1787338735.222655:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:3.0:1787338735.222664:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4012050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+19:3314:x1874160212060672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787338735.222712:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4012050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+19:3314:x1874160212060672:12345-0@lo:400:kworker.0 Request processed in 49us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338735.222720:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:3.0:1787338735.222762:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf7ed5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d79243c8-b367-45ff-8d76-fbaa4be8becb:3314:1874160212060672:0@lo:400:kworker.0 00000100:00100000:3.0:1787338735.222790:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212061184 00000100:00100000:3.0:1787338735.222793:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212061184 00000100:00100000:3.0:1787338735.222825:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787338735.222831:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc2d32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874160212061184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787338735.222867:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc2d32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874160212061184:12345-0@lo:400:kworker.0 Request processed in 36us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338735.222901:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787338735.222929:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf7ed4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1874160212061184:0@lo:400:kworker.0 00000100:00100000:1.0:1787338735.223120:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf7ed7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874160212060800:0@lo:400:kworker.0 00000100:00100000:1.0:1787338735.223161:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338735.223189:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf7ed7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874160212061312:0@lo:400:kworker.0 00000100:00100000:1.0:1787338735.223212:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338735.223228:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787338735.223234:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf7ed5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874160212060928:0@lo:400:kworker.0 00000100:00100000:1.0:1787338735.223256:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338735.223297:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212060800 00000100:00100000:1.0:1787338735.223301:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212060800 00000100:00100000:1.0:1787338735.223324:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212060928 00000100:00100000:1.0:1787338735.223333:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212060928 00000100:00100000:1.0:1787338735.223354:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787338735.223361:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf4101180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874160212060800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787338735.223397:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf4101180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874160212060800:12345-0@lo:400:kworker.0 Request processed in 37us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338735.223403:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787338735.223417:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1787338735.223423:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc123100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874160212060928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787338735.223446:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc123100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874160212060928:12345-0@lo:400:kworker.0 Request processed in 24us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338735.223452:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1787338735.223476:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf7ed5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874160212060928:0@lo:400:kworker.0 00000100:00100000:1.0:1787338735.223484:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf7ed7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874160212060800:0@lo:400:kworker.0 00000100:00100000:3.0:1787338735.223901:0:10743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212061056 00000100:00100000:3.0:1787338735.223907:0:10743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212061056 00000100:00100000:3.0:1787338735.223944:0:10743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212061312 00000100:00100000:3.0:1787338735.223947:0:10743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212061312 00000100:00100000:3.0:1787338735.223981:0:10743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787338735.223989:0:10743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc2d33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3314:x1874160212061056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787338735.224031:0:10743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc2d33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3314:x1874160212061056:12345-0@lo:400:kworker.0 Request processed in 43us (1661us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338735.224049:0:10743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787338735.224061:0:10743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787338735.224067:0:10743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf3e9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3316:x1874160212061312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787338735.224102:0:10743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf3e9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3316:x1874160212061312:12345-0@lo:400:kworker.0 Request processed in 35us (890us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338735.224108:0:10743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787338735.224138:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf7ed7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874160212061312:0@lo:400:kworker.0 00000100:00080000:2.0:1787338735.225298:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787338735.225304:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787338735.225307:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787338735.233858:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf7ed6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874160212061056:0@lo:400:kworker.0 00000100:00100000:0.0:1787338735.234725:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338735.234810:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192146432 00000100:00100000:1.0:1787338735.234818:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192146432 00000100:00100000:1.0:1787338735.234900:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 195 00000100:00100000:1.0:1787338735.234911:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf3e90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+32:11546:x1874160192146432:12345-192.168.201.53@tcp:101:lfs.0 00010000:00010000:1.0:1787338735.234930:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787338735.234950:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d400/0x83671231080c213d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab98b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338735.235036:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c2144 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338735.235051:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c2144 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338735.235079:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c2144 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338735.235092:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c000/0x83671231080c214b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338735.235098:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c000/0x83671231080c214b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338735.235105:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c000/0x83671231080c214b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338735.237518:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d000/0x83671231080c2152 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338735.237750:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d000/0x83671231080c2152 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338735.237762:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d000/0x83671231080c2152 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787338735.237776:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1787338735.238696:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c2144 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338735.238707:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c2144 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338735.238714:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c2144 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338735.238719:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbfbe9d800 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:1.0:1787338735.238734:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c2144 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338735.238740:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c2144 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338735.238754:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff90bbeb14d600) 00010000:00010000:1.0:1787338735.238757:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787338735.238761:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c2144 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338735.238768:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c2144 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338735.238783:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c000/0x83671231080c214b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338735.238789:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c000/0x83671231080c214b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338735.238795:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c000/0x83671231080c214b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338735.238800:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbfbe9c000 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:1.0:1787338735.238803:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c000/0x83671231080c214b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338735.238808:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c000/0x83671231080c214b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338735.238816:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff90bbc2a93500) 00010000:00010000:1.0:1787338735.238817:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787338735.238826:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c000/0x83671231080c214b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338735.238831:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c000/0x83671231080c214b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338735.239142:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d400/0x83671231080c213d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab98b expref: 35 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338735.239170:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d000/0x83671231080c2152 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab98b expref: 34 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338735.239178:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90bbdee56600) 00010000:00010000:1.0:1787338735.239180:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787338735.239183:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbfbe9d000, rc 0) 00000100:00100000:1.0:1787338735.239262:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf3e90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+34:11546:x1874160192146432:12345-192.168.201.53@tcp:101:lfs.0 Request processed in 4352us (4539us total) trans 4294967476 rc 0/0 00000100:00100000:1.0:1787338735.239281:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 195 00000100:00100000:2.0:1787338735.262687:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338735.262855:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192146560 00000100:00100000:0.0:1787338735.262866:0:7647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192146560 00000100:00100000:3.0:1787338735.263105:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 196 00000100:00100000:3.0:1787338735.263121:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf7ed6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+34:11546:x1874160192146560:12345-192.168.201.53@tcp:54:lfs.0 00010000:00010000:3.0:1787338735.263206:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c2160 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338735.263225:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5800/0x83671231080c2105 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab976 expref: 34 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338735.263235:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c2160 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338735.263285:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5800/0x83671231080c2105 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab976 expref: 34 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338735.263301:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5800/0x83671231080c2105 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab976 expref: 34 pid: 5839 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338735.263315:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc2d30e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5841:1874160212061440:192.168.201.53@tcp:104: 00000100:00100000:3.0:1787338735.263423:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbedc579c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787338735.265772:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc2d30e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5841:1874160212061440:192.168.201.53@tcp:104: 00010000:00010000:1.0:1787338735.265800:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c2160 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338735.268869:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338735.268984:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192146816 00000100:00100000:3.0:1787338735.268996:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192146816 00000100:00100000:3.0:1787338735.269045:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 52 00000100:00100000:3.0:1787338735.269055:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf7ed6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:83642291-0761-4205-9531-7fd25bc2d48e+35:5596:x1874160192146816:12345-192.168.201.53@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787338735.269383:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf7ed6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:83642291-0761-4205-9531-7fd25bc2d48e+36:5596:x1874160192146816:12345-192.168.201.53@tcp:35:ldlm_bl.0 Request processed in 328us (523us total) trans 4294967477 rc 0/0 00000100:00100000:3.0:1787338735.269391:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 52 00000100:00100000:3.0:1787338735.289765:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338735.290073:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192146944 00000100:00100000:0.0:1787338735.290083:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192146944 00010000:00010000:0.0:1787338735.290130:0:6704:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5800/0x83671231080c2105 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab976 expref: 36 pid: 5839 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338735.290183:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 75 00000100:00100000:0.0:1787338735.290194:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbde53f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:83642291-0761-4205-9531-7fd25bc2d48e+36:2359:x1874160192146944:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787338735.290208:0:6704:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787338735.290227:0:6704:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5800/0x83671231080c2105 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab976 expref: 36 pid: 5839 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338735.290242:0:6704:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5800/0x83671231080c2105 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab976 expref: 36 pid: 5839 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338735.290278:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5800/0x83671231080c2105 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab976 expref: 36 pid: 5839 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338735.290296:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90bbdee56600) 00010000:00010000:0.0:1787338735.290301:0:6704:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c2160 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338735.290310:0:6704:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c2160 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338735.290318:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c2160 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338735.290352:0:6704:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787338735.290421:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbde53f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:83642291-0761-4205-9531-7fd25bc2d48e+35:2359:x1874160192146944:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 228us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338735.290430:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 75 00010000:00010000:1.0:1787338735.290533:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c2160 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338735.290554:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c2160 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338735.290585:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c2160 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338735.290604:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c2160 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338735.290610:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c2160 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338735.290616:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea5a00 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:1.0:1787338735.290621:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c2160 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338735.290628:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c2160 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338735.290638:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90bbdee56600) 00010000:00010000:1.0:1787338735.290641:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787338735.290645:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c2160 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338735.290651:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c2160 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338735.290716:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf7ed6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+34:11546:x1874160192146560:12345-192.168.201.53@tcp:54:lfs.0 Request processed in 27600us (28051us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338735.290725:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 196 00000100:00100000:3.0:1787338735.293485:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338735.293579:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192147200 00000100:00100000:1.0:1787338735.293589:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192147200 00000100:00100000:1.0:1787338735.293653:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 53 00000100:00100000:1.0:1787338735.293680:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc2d30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:83642291-0761-4205-9531-7fd25bc2d48e+34:11546:x1874160192147200:12345-192.168.201.53@tcp:35:lfs.0 00000100:00100000:1.0:1787338735.293967:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc2d30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:83642291-0761-4205-9531-7fd25bc2d48e+35:11546:x1874160192147200:12345-192.168.201.53@tcp:35:lfs.0 Request processed in 305us (492us total) trans 4294967478 rc 0/0 00000100:00100000:1.0:1787338735.293990:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 53 00010000:00010000:2.0:1787338735.352305:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787338735.436690:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338735.436738:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338735.436769:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338735.436805:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338735.436853:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192147712 00000100:00100000:0.0:1787338735.436864:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192147712 00000100:00100000:2.0:1787338735.436910:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192147584 00000100:00100000:2.0:1787338735.436917:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192147584 00000100:00100000:0.0:1787338735.436964:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 162 00000100:00100000:2.0:1787338735.436972:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192147456 00000100:00100000:2.0:1787338735.436977:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192147456 00000100:00100000:0.0:1787338735.436986:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e810cb1b-6993-4b6e-89c4-e8961cf35b35+5:2357:x1874160192147712:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:2.0:1787338735.437003:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 76 00000100:00100000:2.0:1787338735.437012:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf3e93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:83642291-0761-4205-9531-7fd25bc2d48e+5:2357:x1874160192147584:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:1.0:1787338735.437087:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192147328 00000100:00100000:1.0:1787338735.437092:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192147328 00000100:00100000:1.0:1787338735.437125:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 299 00000100:00100000:1.0:1787338735.437132:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4011050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+13:2357:x1874160192147328:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:3.0:1787338735.437200:0:10743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 77 00000100:00100000:3.0:1787338735.437211:0:10743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf3e93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:83642291-0761-4205-9531-7fd25bc2d48e+9:2357:x1874160192147456:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:0.0:1787338735.437445:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e810cb1b-6993-4b6e-89c4-e8961cf35b35+5:2357:x1874160192147712:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 462us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338735.437453:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 162 00000100:00100000:2.0:1787338735.444557:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf3e93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:83642291-0761-4205-9531-7fd25bc2d48e+5:2357:x1874160192147584:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 7534us (7807us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338735.444574:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 76 00000100:00080000:2.0:1787338735.444629:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787338735.444636:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787338735.445118:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4011050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+13:2357:x1874160192147328:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 7983us (8436us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338735.445129:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 299 00000100:00100000:3.0:1787338735.445433:0:10743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf3e93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:83642291-0761-4205-9531-7fd25bc2d48e+9:2357:x1874160192147456:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 8222us (8660us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338735.445441:0:10743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 77 00000100:00100000:3.0:1787338735.457169:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338735.457289:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192147968 00000100:00100000:0.0:1787338735.457299:0:7647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192147968 00000100:00100000:0.0:1787338735.457355:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 197 00000100:00100000:0.0:1787338735.457366:0:7647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc2d31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+35:11557:x1874160192147968:12345-192.168.201.53@tcp:101:cat.0 00010000:00010000:0.0:1787338735.457388:0:7647:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787338735.457408:0:7647:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4600/0x83671231080c2167 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab992 expref: -99 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338735.457485:0:7647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5a00/0x83671231080c216e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338735.457499:0:7647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5a00/0x83671231080c216e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338735.457510:0:7647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5a00/0x83671231080c216e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338735.457523:0:7647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4400/0x83671231080c2175 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338735.457530:0:7647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4400/0x83671231080c2175 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338735.457536:0:7647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4400/0x83671231080c2175 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338735.457989:0:7647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5200/0x83671231080c217c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338735.458000:0:7647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5200/0x83671231080c217c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338735.458007:0:7647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5200/0x83671231080c217c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787338735.458019:0:7647:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:0.0:1787338735.458119:0:7647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5a00/0x83671231080c216e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338735.458126:0:7647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5a00/0x83671231080c216e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338735.458132:0:7647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5a00/0x83671231080c216e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338735.458138:0:7647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbffef5a00 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:0.0:1787338735.458142:0:7647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5a00/0x83671231080c216e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338735.458149:0:7647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5a00/0x83671231080c216e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338735.458161:0:7647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff90bbeb14d600) 00010000:00010000:0.0:1787338735.458164:0:7647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787338735.458169:0:7647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5a00/0x83671231080c216e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338735.458186:0:7647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5a00/0x83671231080c216e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338735.458198:0:7647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4400/0x83671231080c2175 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338735.458203:0:7647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4400/0x83671231080c2175 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338735.458209:0:7647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4400/0x83671231080c2175 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338735.458214:0:7647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbffef4400 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:0.0:1787338735.458218:0:7647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4400/0x83671231080c2175 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338735.458223:0:7647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4400/0x83671231080c2175 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338735.458230:0:7647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff90bbeb14df00) 00010000:00010000:0.0:1787338735.458232:0:7647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787338735.458235:0:7647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4400/0x83671231080c2175 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338735.458240:0:7647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4400/0x83671231080c2175 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338735.458293:0:7647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4600/0x83671231080c2167 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab992 expref: 38 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338735.458308:0:7647:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5200/0x83671231080c217c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab992 expref: 37 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338735.458322:0:7647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90bbdee56600) 00010000:00010000:0.0:1787338735.458324:0:7647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787338735.458327:0:7647:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbffef5200, rc 0) 00000100:00100000:0.0:1787338735.458402:0:7647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc2d31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+37:11557:x1874160192147968:12345-192.168.201.53@tcp:101:cat.0 Request processed in 1036us (1242us total) trans 4294967479 rc 0/0 00000100:00100000:0.0:1787338735.458410:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 197 00000100:00100000:0.0:1787338735.463262:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338735.463533:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192148224 00000100:00100000:1.0:1787338735.463545:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192148224 00000100:00100000:1.0:1787338735.463624:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 54 00000100:00100000:1.0:1787338735.463635:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbef19c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:83642291-0761-4205-9531-7fd25bc2d48e+37:11557:x1874160192148224:12345-192.168.201.53@tcp:35:cat.0 00000100:00100000:1.0:1787338735.464172:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbef19c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:83642291-0761-4205-9531-7fd25bc2d48e+38:11557:x1874160192148224:12345-192.168.201.53@tcp:35:cat.0 Request processed in 536us (917us total) trans 4294967480 rc 0/0 00000100:00100000:1.0:1787338735.464181:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 54 00000100:00100000:2.0:1787338735.497086:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338735.497173:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192148480 00000100:00100000:0.0:1787338735.497184:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192148480 00000100:00100000:0.0:1787338735.497245:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 198 00000100:00100000:0.0:1787338735.497256:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf7ed7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+38:11558:x1874160192148480:12345-192.168.201.53@tcp:36:rm.0 00010000:00010000:0.0:1787338735.497323:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787338735.497352:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5200/0x83671231080c217c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab992 expref: 38 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338735.497372:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d000/0x83671231080c2152 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab98b expref: 37 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338735.497384:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4000/0x83671231080c211a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab97d expref: 36 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338735.497394:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90bbdee56600) 00010000:00010000:0.0:1787338735.497404:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787338735.497423:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4600/0x83671231080c218a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338735.497457:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4600/0x83671231080c218a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338735.497466:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4600/0x83671231080c218a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338735.497479:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4400/0x83671231080c2191 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338735.497485:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4400/0x83671231080c2191 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338735.497491:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4400/0x83671231080c2191 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338735.497816:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5a00/0x83671231080c2198 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338735.497824:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5a00/0x83671231080c2198 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338735.497841:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5a00/0x83671231080c2198 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787338735.498560:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:0.0:1787338735.498571:0:5840:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 388339696537ns, next at 389339694288ns, rc = 0 00010000:00010000:0.0:1787338735.498630:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4800/0x83671231080c219f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338735.498641:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4800/0x83671231080c219f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338735.498660:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4800/0x83671231080c219f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338735.498668:0:5840:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4800/0x83671231080c219f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338735.498674:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4800/0x83671231080c219f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338735.498679:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4800/0x83671231080c219f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338735.498710:0:5840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787338735.498731:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5a00/0x83671231080c2198 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338735.498738:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5a00/0x83671231080c2198 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338735.498744:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5a00/0x83671231080c2198 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338735.498750:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbffef5a00 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:0.0:1787338735.498754:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5a00/0x83671231080c2198 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338735.498762:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5a00/0x83671231080c2198 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338735.498772:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90bbeb14de00) 00010000:00010000:0.0:1787338735.498776:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787338735.498787:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5a00/0x83671231080c2198 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338735.498793:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5a00/0x83671231080c2198 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338735.498810:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4600/0x83671231080c218a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338735.498817:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4600/0x83671231080c218a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338735.498822:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4600/0x83671231080c218a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338735.498828:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbffef4600 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:0.0:1787338735.498831:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4600/0x83671231080c218a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338735.498837:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4600/0x83671231080c218a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338735.498845:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff90bbeb14d600) 00010000:00010000:0.0:1787338735.498847:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787338735.498850:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4600/0x83671231080c218a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338735.498856:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4600/0x83671231080c218a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787338735.498865:0:5840:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000938b700e reply state 000000000f39f880 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4400/0x83671231080c2191 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338735.498923:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787338735.499011:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf7ed7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+37:11558:x1874160192148480:12345-192.168.201.53@tcp:36:rm.0 Request processed in 1753us (1931us total) trans 4294967481 rc 0/0 00000100:00100000:0.0:1787338735.499019:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 198 00010000:00010000:3.0:1787338735.500243:0:11676:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787338735.500254:0:11676:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4800/0x83671231080c219f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338735.500263:0:11676:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbffef4800 already unused, calling callback (ffffffffc1546230) 00010000:00010000:3.0:1787338735.500276:0:11676:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4800/0x83671231080c219f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338735.500284:0:11676:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4800/0x83671231080c219f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338735.500319:0:11676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90bbeb14de00) 00010000:00010000:3.0:1787338735.500322:0:11676:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787338735.500326:0:11676:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4800/0x83671231080c219f lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338735.500332:0:11676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4800/0x83671231080c219f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338735.500355:0:11676:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338735.500356:0:11676:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338735.500358:0:11676:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787338735.504383:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4400/0x83671231080c2191 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338735.504402:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4400/0x83671231080c2191 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338735.504410:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4400/0x83671231080c2191 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338735.504416:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbffef4400 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:0.0:1787338735.504420:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4400/0x83671231080c2191 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338735.504428:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4400/0x83671231080c2191 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338735.504444:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff90bbeb14df00) 00010000:00010000:0.0:1787338735.504447:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787338735.504451:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4400/0x83671231080c2191 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338735.504458:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4400/0x83671231080c2191 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338735.583198:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338735.586102:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192148736 00000100:00100000:0.0:1787338735.586128:0:7647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192148736 00000100:00100000:0.0:1787338735.586212:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 199 00000100:00100000:0.0:1787338735.586223:0:7647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf7ed7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+36:11564:x1874160192148736:12345-192.168.201.53@tcp:101:bash.0 00010000:00010000:0.0:1787338735.586247:0:7647:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787338735.586277:0:7647:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4400/0x83671231080c21a6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab999 expref: -99 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338735.586401:0:7647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4600/0x83671231080c21ad lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338735.586415:0:7647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4600/0x83671231080c21ad lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338735.586425:0:7647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4600/0x83671231080c21ad lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338735.586440:0:7647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5a00/0x83671231080c21b4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338735.586447:0:7647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5a00/0x83671231080c21b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338735.586453:0:7647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5a00/0x83671231080c21b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787338735.589049:0:7647:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:0.0:1787338735.589275:0:7647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5200/0x83671231080c21bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338735.589291:0:7647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5200/0x83671231080c21bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338735.589302:0:7647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5200/0x83671231080c21bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338735.589355:0:7647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4600/0x83671231080c21ad lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338735.589362:0:7647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4600/0x83671231080c21ad lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338735.589368:0:7647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4600/0x83671231080c21ad lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338735.589375:0:7647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbffef4600 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:0.0:1787338735.589379:0:7647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4600/0x83671231080c21ad lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338735.589386:0:7647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4600/0x83671231080c21ad lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338735.589399:0:7647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff90bbeb14d600) 00010000:00010000:0.0:1787338735.589402:0:7647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787338735.589406:0:7647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4600/0x83671231080c21ad lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338735.589411:0:7647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4600/0x83671231080c21ad lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787338735.589424:0:7647:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e202d3ca reply state 00000000c33c65b1 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5a00/0x83671231080c21b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338735.589432:0:7647:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787338735.589465:0:7647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4400/0x83671231080c21a6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab999 expref: 39 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338735.589492:0:7647:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5200/0x83671231080c21bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab999 expref: 38 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338735.589499:0:7647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff90bbeb14dd00) 00010000:00010000:0.0:1787338735.589501:0:7647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787338735.589504:0:7647:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbffef5200, rc 0) 00000100:00100000:0.0:1787338735.589593:0:7647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf7ed7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+39:11564:x1874160192148736:12345-192.168.201.53@tcp:101:bash.0 Request processed in 3371us (6403us total) trans 4294967482 rc 0/0 00000100:00100000:0.0:1787338735.589603:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 199 00010000:00010000:0.0:1787338735.594055:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5a00/0x83671231080c21b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338735.594072:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5a00/0x83671231080c21b4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338735.594080:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5a00/0x83671231080c21b4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338735.594086:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbffef5a00 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:0.0:1787338735.594091:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5a00/0x83671231080c21b4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338735.594099:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5a00/0x83671231080c21b4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338735.594117:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff90bbeb14df00) 00010000:00010000:0.0:1787338735.594120:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787338735.594125:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5a00/0x83671231080c21b4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338735.594151:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5a00/0x83671231080c21b4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338735.595250:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338735.597863:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192148864 00000100:00100000:0.0:1787338735.597901:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192148864 00000100:00100000:0.0:1787338735.597974:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 59 00000100:00100000:0.0:1787338735.597984:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf7ed5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:83642291-0761-4205-9531-7fd25bc2d48e+5:2359:x1874160192148864:12345-192.168.201.53@tcp:101:bash.0 00010000:00010000:0.0:1787338735.598001:0:6689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787338735.598032:0:6689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8f4a49d/0x83671231080c21c9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab9a0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787338735.598060:0:6689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787338735.598079:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=388s v=(0 0) 00010000:00010000:0.0:1787338735.598084:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787338735.598093:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8f4a49d/0x83671231080c21c9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab9a0 expref: 6 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338735.598111:0:6689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a8f4a49d/0x83671231080c21c9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab9a0 expref: 6 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338735.598124:0:6689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbffef4000, rc 0) 00000100:00100000:0.0:1787338735.598846:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf7ed5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:83642291-0761-4205-9531-7fd25bc2d48e+6:2359:x1874160192148864:12345-192.168.201.53@tcp:101:bash.0 Request processed in 860us (3598us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338735.598854:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 59 00000100:00100000:3.0:1787338735.608145:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338735.608254:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192148992 00000100:00100000:2.0:1787338735.608273:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192148992 00000100:00100000:2.0:1787338735.608330:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 60 00000100:00100000:2.0:1787338735.608341:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc2d31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:83642291-0761-4205-9531-7fd25bc2d48e+6:11564:x1874160192148992:12345-192.168.201.53@tcp:101:bash.0 00010000:00010000:2.0:1787338735.608362:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787338735.608380:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014a9f122/0x83671231080c21d0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab9a7 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338735.608412:0:6691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a8f4a49d/0x83671231080c21c9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab9a0 expref: 7 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338735.608421:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787338735.608425:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787338735.608431:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014a9f122/0x83671231080c21d0 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab9a7 expref: 7 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338735.608486:0:6691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a8f4a49d/0x83671231080c21c9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab9a0 expref: 7 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338735.608501:0:6691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a8f4a49d/0x83671231080c21c9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab9a0 expref: 7 pid: 6689 timeout: 488 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338735.608515:0:6691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf7ed4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6691:1874160212061568:192.168.201.53@tcp:104: 00000100:00100000:2.0:1787338735.608629:0:6691:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bac1d33300 going to sleep for 11 seconds 00000100:00100000:2.0:1787338735.611865:0:6691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf7ed4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6691:1874160212061568:192.168.201.53@tcp:104: 00010000:00010000:2.0:1787338735.611931:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000014a9f122/0x83671231080c21d0 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab9a7 expref: 7 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338735.611952:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf3c53200, rc 0) 00000100:00100000:2.0:1787338735.612012:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc2d31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:83642291-0761-4205-9531-7fd25bc2d48e+7:11564:x1874160192148992:12345-192.168.201.53@tcp:101:bash.0 Request processed in 3672us (3878us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338735.612020:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 60 00000100:00100000:0.0:1787338735.621669:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338735.621940:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192149120 00000100:00100000:1.0:1787338735.621952:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192149120 00010000:00010000:1.0:1787338735.621994:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a8f4a49d/0x83671231080c21c9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab9a0 expref: 7 pid: 6689 timeout: 488 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338735.622040:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 76 00000100:00100000:1.0:1787338735.622051:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbef19ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:83642291-0761-4205-9531-7fd25bc2d48e+7:2359:x1874160192149120:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787338735.622067:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787338735.622090:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a8f4a49d/0x83671231080c21c9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab9a0 expref: 7 pid: 6689 timeout: 488 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338735.622131:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a8f4a49d/0x83671231080c21c9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab9a0 expref: 7 pid: 6689 timeout: 488 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338735.622170:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8f4a49d/0x83671231080c21c9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab9a0 expref: 7 pid: 6689 timeout: 488 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338735.622188:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787338735.622193:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787338735.622201:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000014a9f122/0x83671231080c21d0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab9a7 expref: 6 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338735.622211:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014a9f122/0x83671231080c21d0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab9a7 expref: 6 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338735.622249:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000014a9f122/0x83671231080c21d0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab9a7 expref: 6 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338735.622275:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf46fb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5825:1874160212061696:192.168.201.53@tcp:105: 00000100:00100000:1.0:1787338735.622366:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbedd6bd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787338735.635781:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338735.636433:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf46fb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5825:1874160212061696:192.168.201.53@tcp:105: 00010000:00010000:1.0:1787338735.636459:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787338735.636521:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbef19ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:83642291-0761-4205-9531-7fd25bc2d48e+6:2359:x1874160192149120:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 14471us (14872us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338735.636532:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 76 00000100:00100000:0.0:1787338735.636650:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192149376 00000100:00100000:0.0:1787338735.636663:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192149376 00000100:00100000:0.0:1787338735.636714:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 55 00000100:00100000:0.0:1787338735.636724:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc2d33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:83642291-0761-4205-9531-7fd25bc2d48e+38:11564:x1874160192149376:12345-192.168.201.53@tcp:35:bash.0 00000100:00100000:0.0:1787338735.637941:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc2d33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:83642291-0761-4205-9531-7fd25bc2d48e+39:11564:x1874160192149376:12345-192.168.201.53@tcp:35:bash.0 Request processed in 1213us (2164us total) trans 4294967483 rc 0/0 00000100:00100000:0.0:1787338735.637950:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 55 00000100:00100000:1.0:1787338735.734673:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc2d31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874160212061824:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787338735.734747:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338735.734958:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212061824 00000100:00100000:0.0:1787338735.734967:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212061824 00000100:00100000:0.0:1787338735.735027:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787338735.735040:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf46fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3317:x1874160212061824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787338735.735077:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787338735.736858:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf46fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3317:x1874160212061824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1812us (2102us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338735.736870:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787338735.737934:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc2d31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874160212061824:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787338735.904104:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338735.904235:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192149504 00000100:00100000:0.0:1787338735.904244:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192149504 00000100:00100000:0.0:1787338735.904329:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 200 00000100:00100000:0.0:1787338735.904339:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf7ed4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+39:11580:x1874160192149504:12345-192.168.201.53@tcp:101:lfs.0 00010000:00010000:0.0:1787338735.904363:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787338735.904383:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4400/0x83671231080c21d7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab9ae expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338735.904440:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4600/0x83671231080c21de lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338735.904453:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4600/0x83671231080c21de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338735.904481:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4600/0x83671231080c21de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787338735.904539:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:0.0:1787338735.904543:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787338735.904566:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4600/0x83671231080c21de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338735.904594:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4400/0x83671231080c21d7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab9ae expref: 41 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338735.904611:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4600/0x83671231080c21de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab9ae expref: 40 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338735.904632:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff90bbeb14d600) 00010000:00010000:0.0:1787338735.904635:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787338735.904639:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbffef4600, rc 0) 00000100:00100000:0.0:1787338735.904700:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf7ed4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+40:11580:x1874160192149504:12345-192.168.201.53@tcp:101:lfs.0 Request processed in 362us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338735.904706:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 200 00000100:00100000:2.0:1787338735.911740:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338735.911858:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192149760 00000100:00100000:1.0:1787338735.911869:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192149760 00000100:00100000:1.0:1787338735.911982:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 201 00000100:00100000:1.0:1787338735.911992:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf7ed5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+40:11580:x1874160192149760:12345-192.168.201.53@tcp:101:lfs.0 00010000:00010000:1.0:1787338735.912011:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787338735.912031:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c000/0x83671231080c21e5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab9b5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338735.912124:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c21ec lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338735.912137:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c21ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338735.912161:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c21ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787338735.912172:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1787338735.912304:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c000/0x83671231080c21e5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab9b5 expref: 43 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338735.912322:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c21ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab9b5 expref: 42 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338735.912331:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff90bbeb14dd00) 00010000:00010000:1.0:1787338735.912346:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787338735.912349:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbfbe9d800, rc 0) 00000100:00100000:1.0:1787338735.912411:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf7ed5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+42:11580:x1874160192149760:12345-192.168.201.53@tcp:101:lfs.0 Request processed in 421us (682us total) trans 4294967484 rc 0/0 00000100:00100000:1.0:1787338735.912418:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 201 00000100:00100000:3.0:1787338735.919472:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338735.919522:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338735.919628:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192149888 00000100:00100000:0.0:1787338735.919640:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192149888 00000100:00100000:0.0:1787338735.919725:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 15 00000100:00100000:0.0:1787338735.919735:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc2d30e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:83642291-0761-4205-9531-7fd25bc2d48e+42:2359:x1874160192149888:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787338735.919751:0:6704:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787338735.919776:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c21ec lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab9b5 expref: 42 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338735.919832:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff90bbeb14dd00) 00010000:00010000:0.0:1787338735.919837:0:6704:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787338735.919936:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc2d30e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:83642291-0761-4205-9531-7fd25bc2d48e+41:2359:x1874160192149888:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 201us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338735.919943:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 15 00000100:00100000:1.0:1787338735.920632:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192150144 00000100:00100000:1.0:1787338735.920639:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192150144 00000100:00100000:1.0:1787338735.920695:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 202 00000100:00100000:1.0:1787338735.920704:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc2d31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+41:11580:x1874160192150144:12345-192.168.201.53@tcp:101:lfs.0 00010000:00010000:1.0:1787338735.920726:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787338735.920744:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c000/0x83671231080c21fa lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab9bc expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338735.920863:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d000/0x83671231080c2201 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338735.920907:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d000/0x83671231080c2201 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338735.920918:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d000/0x83671231080c2201 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787338735.920931:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1787338735.921053:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c000/0x83671231080c21fa lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab9bc expref: 44 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338735.921071:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d000/0x83671231080c2201 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab9bc expref: 43 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338735.921095:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff90bbeb14dd00) 00010000:00010000:1.0:1787338735.921099:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787338735.921101:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbfbe9d000, rc 0) 00000100:00100000:1.0:1787338735.921415:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc2d31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+43:11580:x1874160192150144:12345-192.168.201.53@tcp:101:lfs.0 Request processed in 710us (1889us total) trans 4294967485 rc 0/0 00000100:00100000:1.0:1787338735.921421:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 202 00000100:00100000:2.0:1787338735.935580:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338735.936043:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192150272 00000100:00100000:1.0:1787338735.936054:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192150272 00000100:00100000:1.0:1787338735.936120:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 61 00000100:00100000:1.0:1787338735.936132:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf7ed4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:83642291-0761-4205-9531-7fd25bc2d48e+6:2359:x1874160192150272:12345-192.168.201.53@tcp:1:lfs.0 00010000:00010000:1.0:1787338735.936431:0:6690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003146de23/0x83671231080c220f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338735.936449:0:6690:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000014a9f122/0x83671231080c21d0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab9a7 expref: 6 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338735.936456:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787338735.936459:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787338735.936463:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003146de23/0x83671231080c220f lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338735.936491:0:6690:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000014a9f122/0x83671231080c21d0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab9a7 expref: 6 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338735.936509:0:6690:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000014a9f122/0x83671231080c21d0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab9a7 expref: 6 pid: 6691 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338735.936532:0:6690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc4096a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6690:1874160212061952:192.168.201.53@tcp:104: 00000100:00100000:1.0:1787338735.936618:0:6690:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbedd6bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787338735.940299:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338735.940389:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192150400 00000100:00100000:2.0:1787338735.940398:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192150400 00002000:00100000:2.0:1787338735.940449:0:6696:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff90bbef19dc00 x1874160192150400/t0(0) o4->83642291-0761-4205-9531-7fd25bc2d48e@192.168.201.53@tcp:66/0 lens 504/0 e 0 to 0 dl 1787338746 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787338735.940460:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90bbef19dc00 with x1874160192150400 ext(0->8) 00010000:00010000:2.0:1787338735.940483:0:6696:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000014a9f122/0x83671231080c21d0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab9a7 expref: 7 pid: 6691 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338735.940498:0:6696:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000014a9f122/0x83671231080c21d0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab9a7 expref: 7 pid: 6691 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787338735.940506:0:6696:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90bbef19dc00 00000100:00100000:2.0:1787338735.940539:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 3 00000100:00100000:2.0:1787338735.940549:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbef19dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:83642291-0761-4205-9531-7fd25bc2d48e+7:2359:x1874160192150400:12345-192.168.201.53@tcp:4:lfs.0 00000100:00100000:2.0:1787338735.941240:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbef19dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:83642291-0761-4205-9531-7fd25bc2d48e+9:2359:x1874160192150400:12345-192.168.201.53@tcp:4:lfs.0 Request processed in 690us (948us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1787338735.941249:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 3 00002000:00100000:2.0:1787338735.941266:0:6696:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff90bbef19dc00 x1874160192150400/t4294967308(0) o4->83642291-0761-4205-9531-7fd25bc2d48e@192.168.201.53@tcp:66/0 lens 504/448 e 0 to 0 dl 1787338746 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787338735.941276:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90bbef19dc00 with x1874160192150400 ext(0->8) 00010000:00010000:2.0:1787338735.941283:0:6696:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000014a9f122/0x83671231080c21d0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab9a7 expref: 9 pid: 6691 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338735.941296:0:6696:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000014a9f122/0x83671231080c21d0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab9a7 expref: 9 pid: 6691 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787338735.941303:0:6696:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90bbef19dc00 00000100:00100000:1.0:1787338735.942539:0:6690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc4096a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6690:1874160212061952:192.168.201.53@tcp:104: 00010000:00010000:1.0:1787338735.942569:0:6690:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003146de23/0x83671231080c220f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338735.952606:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338735.952685:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192150528 00000100:00100000:3.0:1787338735.952696:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192150528 00010000:00010000:3.0:1787338735.952739:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000014a9f122/0x83671231080c21d0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab9a7 expref: 9 pid: 6691 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338735.952795:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 77 00000100:00100000:3.0:1787338735.952806:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf7ed6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:83642291-0761-4205-9531-7fd25bc2d48e+9:2356:x1874160192150528:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787338735.952823:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1787338735.952852:0:5823:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1787338735.952856:0:5823:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787338735 00002000:00010000:3.0:1787338735.952859:0:5823:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787338735 00002000:00010000:3.0:1787338735.952861:0:5823:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1787338735 00010000:00010000:3.0:1787338735.952868:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000014a9f122/0x83671231080c21d0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab9a7 expref: 9 pid: 6691 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338735.952939:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000014a9f122/0x83671231080c21d0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab9a7 expref: 9 pid: 6691 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338735.952965:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014a9f122/0x83671231080c21d0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab9a7 expref: 9 pid: 6691 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338735.952983:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787338735.952987:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787338735.952992:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003146de23/0x83671231080c220f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338735.953003:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003146de23/0x83671231080c220f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338735.953033:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787338735.953084:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf7ed6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:83642291-0761-4205-9531-7fd25bc2d48e+8:2356:x1874160192150528:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 280us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338735.953092:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 77 00010000:00010000:1.0:1787338735.953149:0:6690:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003146de23/0x83671231080c220f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338735.953159:0:6690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003146de23/0x83671231080c220f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338735.953186:0:6690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003146de23/0x83671231080c220f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338735.953195:0:6690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003146de23/0x83671231080c220f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338735.953202:0:6690:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003146de23/0x83671231080c220f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338735.953209:0:6690:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbfbe9d400 already unused, calling callback (ffffffffc1546230) 00010000:00010000:1.0:1787338735.953214:0:6690:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003146de23/0x83671231080c220f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338735.953236:0:6690:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003146de23/0x83671231080c220f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338735.953250:0:6690:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003146de23/0x83671231080c220f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338735.953266:0:6690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003146de23/0x83671231080c220f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338735.953314:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf7ed4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:83642291-0761-4205-9531-7fd25bc2d48e+7:2359:x1874160192150272:12345-192.168.201.53@tcp:1:lfs.0 Request processed in 17185us (17754us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338735.953323:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 61 00000100:00100000:3.0:1787338735.959008:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338735.959192:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192150784 00000100:00100000:2.0:1787338735.959202:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192150784 00000100:00100000:2.0:1787338735.959279:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 56 00000100:00100000:2.0:1787338735.959304:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbd894e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:83642291-0761-4205-9531-7fd25bc2d48e+43:11580:x1874160192150784:12345-192.168.201.53@tcp:35:lfs.0 00000004:00010000:2.0:1787338735.959377:0:5843:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d000/0x83671231080c2201 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab9bc expref: 43 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787338735.960007:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:2.0:1787338735.960057:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:2.0:1787338735.961036:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:2.0:1787338735.961103:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52800/0x83671231080c2216 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338735.961124:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5200/0x83671231080c21bb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab999 expref: 47 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338735.961135:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52800/0x83671231080c2216 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338735.961447:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5200/0x83671231080c21bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab999 expref: 47 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338735.961468:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5200/0x83671231080c21bb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab999 expref: 47 pid: 7647 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338735.961486:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf7ed7b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5843:1874160212062080:192.168.201.53@tcp:104: 00000100:00100000:2.0:1787338735.961762:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bac1d33300 going to sleep for 11 seconds 00000100:00100000:0.0:1787338735.984049:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338735.984391:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192150912 00000100:00100000:3.0:1787338735.984402:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192150912 00010000:00010000:3.0:1787338735.984444:0:6704:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5200/0x83671231080c21bb lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab999 expref: 48 pid: 7647 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338735.984489:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 78 00000100:00100000:3.0:1787338735.984500:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbef19fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:83642291-0761-4205-9531-7fd25bc2d48e+48:2359:x1874160192150912:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787338735.984528:0:6704:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787338735.984536:0:6704:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5200/0x83671231080c21bb lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab999 expref: 48 pid: 7647 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338735.984549:0:6704:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5200/0x83671231080c21bb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab999 expref: 48 pid: 7647 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338735.984583:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff90bbeb14dd00) 00010000:00010000:3.0:1787338735.984589:0:6704:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52800/0x83671231080c2216 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338735.984598:0:6704:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52800/0x83671231080c2216 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338735.984606:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52800/0x83671231080c2216 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338735.984625:0:6704:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787338735.984686:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbef19fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:83642291-0761-4205-9531-7fd25bc2d48e+48:2359:x1874160192150912:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 187us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338735.984694:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 78 00010000:00010000:2.0:1787338735.984946:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5200/0x83671231080c21bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab999 expref: 47 pid: 7647 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338735.984964:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf7ed7b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5843:1874160212062080:192.168.201.53@tcp:104: 00010000:00010000:2.0:1787338735.984995:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52800/0x83671231080c2216 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338735.985005:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52800/0x83671231080c2216 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338735.985010:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52800/0x83671231080c2216 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787338735.985150:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:2.0:1787338735.985462:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:2.0:1787338735.986192:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf7ed7b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5843:1874160212062208:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787338735.986245:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338735.986309:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bac1d33a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787338735.995419:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212062208 00000100:00100000:1.0:1787338735.995438:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212062208 00000100:00100000:1.0:1787338735.995527:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787338735.995539:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf7ed4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5843:x1874160212062208:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787338735.995704:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf7ed4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5843:x1874160212062208:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 168us (9457us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338735.995712:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787338735.995828:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf7ed7b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5843:1874160212062208:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1787338735.996392:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:2.0:1787338735.996492:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf7ed7b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5843:1874160212062336:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787338735.996537:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338735.996559:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bac1d33300 going to sleep for 11 seconds 00000100:00100000:0.0:1787338735.996783:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212062336 00000100:00100000:0.0:1787338735.996790:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212062336 00000100:00100000:0.0:1787338735.996821:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787338735.996829:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbed9c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5843:x1874160212062336:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787338735.997027:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbed9c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5843:x1874160212062336:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 198us (489us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1787338735.997034:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787338735.997472:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf7ed7b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5843:1874160212062336:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1787338735.997531:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:2.0:1787338735.997571:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52800/0x83671231080c2216 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338735.997581:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52800/0x83671231080c2216 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338735.997589:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52800/0x83671231080c2216 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338735.997610:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf3c52800 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:2.0:1787338735.997614:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52800/0x83671231080c2216 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338735.997622:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52800/0x83671231080c2216 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338735.997640:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff90bbeb14dd00) 00010000:00010000:2.0:1787338735.997643:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787338735.997648:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52800/0x83671231080c2216 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338735.997655:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52800/0x83671231080c2216 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787338735.997843:0:5843:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1787338735.997973:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:2.0:1787338735.997984:0:5843:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 388839109034ns, next at 389839106909ns, rc = 0 00000001:00080000:2.0:1787338735.997990:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:2.0:1787338735.998025:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff90bbeb14dd00) 00010000:00010000:2.0:1787338735.998028:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787338735.998036:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d000/0x83671231080c2201 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab9bc expref: 51 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338735.998134:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbd894e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:83642291-0761-4205-9531-7fd25bc2d48e+50:11580:x1874160192150784:12345-192.168.201.53@tcp:35:lfs.0 Request processed in 38831us (39135us total) trans 4294967494 rc 0/0 00000100:00100000:2.0:1787338735.998740:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 56 00000020:00080000:2.0:1787338735.998752:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1787338736.001541:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338736.001607:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192151040 00000100:00100000:1.0:1787338736.001619:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192151040 00000100:00100000:1.0:1787338736.001681:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 203 00000100:00100000:1.0:1787338736.001692:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbef19c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+50:11580:x1874160192151040:12345-192.168.201.53@tcp:101:lfs.0 00010000:00010000:1.0:1787338736.001715:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787338736.001752:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c000/0x83671231080c221d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab9c3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338736.001830:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c000/0x83671231080c221d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab9c3 expref: 51 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338736.001844:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c000/0x83671231080c221d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab9c3 expref: 51 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338736.001863:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff90bbc2a93500) 00010000:00010000:1.0:1787338736.001867:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787338736.001871:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbfbe9c000, rc 0) 00000100:00100000:1.0:1787338736.001958:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbef19c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+51:11580:x1874160192151040:12345-192.168.201.53@tcp:101:lfs.0 Request processed in 267us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338736.001965:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 203 00000100:00100000:0.0:1787338736.008836:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338736.010286:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192151296 00000100:00100000:1.0:1787338736.010301:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192151296 00000100:00100000:1.0:1787338736.010376:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 57 00000100:00100000:1.0:1787338736.010388:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf41b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:83642291-0761-4205-9531-7fd25bc2d48e+51:11580:x1874160192151296:12345-192.168.201.53@tcp:35:lfs.0 00000100:00100000:1.0:1787338736.010660:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf41b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:83642291-0761-4205-9531-7fd25bc2d48e+52:11580:x1874160192151296:12345-192.168.201.53@tcp:35:lfs.0 Request processed in 273us (1834us total) trans 4294967495 rc 0/0 00000100:00100000:1.0:1787338736.010667:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 57 00000100:00100000:3.0:1787338736.151846:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338736.152071:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192151424 00000100:00100000:2.0:1787338736.152081:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192151424 00000100:00100000:2.0:1787338736.152156:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 204 00000100:00100000:2.0:1787338736.152167:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc2d30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+52:11590:x1874160192151424:12345-192.168.201.53@tcp:34:lfs.0 00010000:00010000:2.0:1787338736.152247:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52800/0x83671231080c2224 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338736.152274:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52800/0x83671231080c2224 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338736.152286:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52800/0x83671231080c2224 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338736.152300:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52a00/0x83671231080c222b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338736.152307:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52a00/0x83671231080c222b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338736.152312:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52a00/0x83671231080c222b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338736.152421:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c53e00/0x83671231080c2232 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338736.152429:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c53e00/0x83671231080c2232 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338736.152435:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c53e00/0x83671231080c2232 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787338736.152474:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c53e00/0x83671231080c2232 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338736.152499:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52800/0x83671231080c2224 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338736.152505:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52800/0x83671231080c2224 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338736.152511:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52800/0x83671231080c2224 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338736.152516:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf3c52800 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:2.0:1787338736.152520:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52800/0x83671231080c2224 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338736.152527:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52800/0x83671231080c2224 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338736.152539:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff90bbeb14d600) 00010000:00010000:2.0:1787338736.152542:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787338736.152546:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52800/0x83671231080c2224 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338736.152551:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52800/0x83671231080c2224 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338736.152564:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52a00/0x83671231080c222b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338736.152569:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52a00/0x83671231080c222b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338736.152574:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52a00/0x83671231080c222b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338736.152584:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf3c52a00 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:2.0:1787338736.152587:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52a00/0x83671231080c222b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338736.152593:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52a00/0x83671231080c222b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338736.152600:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff90bbdee56300) 00010000:00010000:2.0:1787338736.152603:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787338736.152605:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52a00/0x83671231080c222b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338736.152611:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52a00/0x83671231080c222b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338736.152625:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c53e00/0x83671231080c2232 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338736.152631:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c53e00/0x83671231080c2232 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338736.152636:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c53e00/0x83671231080c2232 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338736.152641:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf3c53e00 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:2.0:1787338736.152643:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c53e00/0x83671231080c2232 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338736.152648:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c53e00/0x83671231080c2232 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338736.152665:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff90bbc2a93500) 00010000:00010000:2.0:1787338736.152666:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787338736.152669:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c53e00/0x83671231080c2232 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338736.152674:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c53e00/0x83671231080c2232 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338736.152755:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc2d30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+52:11590:x1874160192151424:12345-192.168.201.53@tcp:34:lfs.0 Request processed in 589us (929us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338736.152762:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 204 00000100:00100000:3.0:1787338736.192529:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338736.192641:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192151680 00000100:00100000:1.0:1787338736.192661:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192151680 00000100:00100000:1.0:1787338736.192732:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 205 00000100:00100000:1.0:1787338736.192744:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc2d33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+52:11593:x1874160192151680:12345-192.168.201.53@tcp:101:lfs.0 00010000:00010000:1.0:1787338736.192767:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787338736.192811:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ce00/0x83671231080c2239 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab9ca expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338736.192928:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c400/0x83671231080c2240 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338736.192943:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c400/0x83671231080c2240 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338736.192955:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c400/0x83671231080c2240 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338736.192967:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9dc00/0x83671231080c2247 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338736.192974:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9dc00/0x83671231080c2247 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338736.192979:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9dc00/0x83671231080c2247 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338736.193105:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c224e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338736.193114:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c224e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338736.193120:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c224e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787338736.193129:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1787338736.193477:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c400/0x83671231080c2240 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338736.193498:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c400/0x83671231080c2240 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338736.193505:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c400/0x83671231080c2240 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338736.193510:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbfbe9c400 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:1.0:1787338736.193515:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c400/0x83671231080c2240 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338736.193522:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c400/0x83671231080c2240 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338736.193534:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff90bbeb14d600) 00010000:00010000:1.0:1787338736.193537:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787338736.193540:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c400/0x83671231080c2240 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338736.193546:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c400/0x83671231080c2240 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338736.193559:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9dc00/0x83671231080c2247 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338736.193564:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9dc00/0x83671231080c2247 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338736.193570:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9dc00/0x83671231080c2247 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338736.193574:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbfbe9dc00 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:1.0:1787338736.193582:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9dc00/0x83671231080c2247 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338736.193588:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9dc00/0x83671231080c2247 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338736.193595:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff90bbc2a93200) 00010000:00010000:1.0:1787338736.193597:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787338736.193599:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9dc00/0x83671231080c2247 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338736.193604:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9dc00/0x83671231080c2247 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338736.193660:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ce00/0x83671231080c2239 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab9ca expref: 55 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338736.193674:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c224e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab9ca expref: 54 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338736.193681:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff90bbc2a93500) 00010000:00010000:1.0:1787338736.193682:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787338736.193685:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbfbe9d600, rc 0) 00000100:00100000:1.0:1787338736.193755:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc2d33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+54:11593:x1874160192151680:12345-192.168.201.53@tcp:101:lfs.0 Request processed in 1012us (1239us total) trans 4294967496 rc 0/0 00000100:00100000:1.0:1787338736.193762:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 205 00000100:00100000:0.0:1787338736.196922:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338736.197159:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192151808 00000100:00100000:1.0:1787338736.197169:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192151808 00000100:00100000:1.0:1787338736.197230:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 206 00000100:00100000:1.0:1787338736.197241:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf41b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+54:11593:x1874160192151808:12345-192.168.201.53@tcp:54:lfs.0 00010000:00010000:1.0:1787338736.197335:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9de00/0x83671231080c225c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338736.197352:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9de00/0x83671231080c225c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338736.197362:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9de00/0x83671231080c225c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338736.197389:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9de00/0x83671231080c225c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338736.197397:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9de00/0x83671231080c225c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338736.197404:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9de00/0x83671231080c225c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338736.197409:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbfbe9de00 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:1.0:1787338736.197414:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9de00/0x83671231080c225c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338736.197421:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9de00/0x83671231080c225c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338736.197433:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff90bbc2a93500) 00010000:00010000:1.0:1787338736.197436:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787338736.197440:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9de00/0x83671231080c225c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338736.197446:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9de00/0x83671231080c225c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338736.197533:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf41b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+54:11593:x1874160192151808:12345-192.168.201.53@tcp:54:lfs.0 Request processed in 294us (664us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338736.197540:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 206 00000100:00100000:3.0:1787338736.200023:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338736.200168:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192152064 00000100:00100000:2.0:1787338736.200178:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192152064 00000100:00100000:2.0:1787338736.200233:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 58 00000100:00100000:2.0:1787338736.200243:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee44ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:83642291-0761-4205-9531-7fd25bc2d48e+54:11593:x1874160192152064:12345-192.168.201.53@tcp:35:lfs.0 00000100:00100000:2.0:1787338736.200511:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee44ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:83642291-0761-4205-9531-7fd25bc2d48e+55:11593:x1874160192152064:12345-192.168.201.53@tcp:35:lfs.0 Request processed in 267us (496us total) trans 4294967497 rc 0/0 00000100:00100000:2.0:1787338736.200517:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 58 00000100:00100000:3.0:1787338736.269984:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338736.270152:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192152320 00000100:00100000:0.0:1787338736.270164:0:7647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192152320 00000100:00100000:0.0:1787338736.270231:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 207 00000100:00100000:0.0:1787338736.270244:0:7647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee44df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+55:11603:x1874160192152320:12345-192.168.201.53@tcp:101:bash.0 00010000:00010000:0.0:1787338736.270303:0:7647:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787338736.270307:0:7647:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787338736.270345:0:7647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4600/0x83671231080c21de lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab9ae expref: 55 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338736.270393:0:7647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff90bbeb14d600) 00010000:00010000:0.0:1787338736.270399:0:7647:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787338736.270414:0:7647:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4000/0x83671231080c2263 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab9d1 expref: -99 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338736.270520:0:7647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5a00/0x83671231080c226a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338736.270536:0:7647:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c224e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab9ca expref: 55 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338736.270545:0:7647:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5a00/0x83671231080c226a lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338736.270577:0:7647:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c224e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab9ca expref: 55 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338736.270592:0:7647:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c224e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab9ca expref: 55 pid: 5841 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338736.270606:0:7647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf41b4380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7647:1874160212062464:192.168.201.53@tcp:104: 00000100:00100000:0.0:1787338736.270701:0:7647:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc7c84900 going to sleep for 11 seconds 00000100:00100000:0.0:1787338736.275848:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338736.276006:0:7647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf41b4380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7647:1874160212062464:192.168.201.53@tcp:104: 00010000:00010000:2.0:1787338736.276051:0:7647:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5a00/0x83671231080c226a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338736.276157:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192152448 00000100:00100000:1.0:1787338736.276166:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192152448 00010000:00010000:1.0:1787338736.276207:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c224e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab9ca expref: 56 pid: 5841 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338736.276247:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 79 00000100:00100000:1.0:1787338736.276266:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf41b5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:83642291-0761-4205-9531-7fd25bc2d48e+56:2359:x1874160192152448:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787338736.276282:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787338736.276290:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c224e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab9ca expref: 56 pid: 5841 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338736.276302:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c224e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab9ca expref: 56 pid: 5841 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338736.276325:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c224e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab9ca expref: 56 pid: 5841 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338736.276341:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff90bbc2a93500) 00010000:00010000:1.0:1787338736.276346:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5a00/0x83671231080c226a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338736.276356:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5a00/0x83671231080c226a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338736.276382:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5a00/0x83671231080c226a lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338736.276411:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787338736.276469:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf41b5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:83642291-0761-4205-9531-7fd25bc2d48e+55:2359:x1874160192152448:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 204us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338736.276476:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 79 00010000:00010000:2.0:1787338736.276603:0:7647:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5a00/0x83671231080c226a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338736.276611:0:7647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5a00/0x83671231080c226a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787338736.276640:0:7647:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1787338736.276800:0:7647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4000/0x83671231080c2263 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab9d1 expref: 56 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338736.276816:0:7647:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5a00/0x83671231080c226a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab9d1 expref: 55 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338736.276823:0:7647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff90bbc2a93500) 00010000:00010000:2.0:1787338736.276825:0:7647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787338736.276828:0:7647:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbffef5a00, rc 0) 00000100:00100000:2.0:1787338736.276855:0:7647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee44df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+55:11603:x1874160192152320:12345-192.168.201.53@tcp:101:bash.0 Request processed in 6615us (6885us total) trans 4294967498 rc 0/0 00000100:00100000:2.0:1787338736.276863:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 207 00000100:00100000:3.0:1787338736.281688:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338736.281769:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192152704 00000100:00100000:1.0:1787338736.281779:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192152704 00000100:00100000:1.0:1787338736.281838:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 208 00000100:00100000:1.0:1787338736.281849:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee563b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+55:11603:x1874160192152704:12345-192.168.201.53@tcp:36:bash.0 00010000:00010000:1.0:1787338736.282425:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c2278 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338736.282447:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c2278 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338736.282459:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c2278 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787338736.282511:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:1.0:1787338736.282536:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000aebeab99 reply state 000000001b0509c9 transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c2278 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338736.282545:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787338736.282686:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee563b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+58:11603:x1874160192152704:12345-192.168.201.53@tcp:36:bash.0 Request processed in 837us (1006us total) trans 4294967500 rc 0/0 00000100:00100000:1.0:1787338736.282695:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 208 00000020:00080000:1.0:1787338736.282699:0:5839:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787338736.286746:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338736.287358:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192152832 00000100:00100000:1.0:1787338736.287368:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192152832 00000100:00100000:1.0:1787338736.287435:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 209 00000100:00100000:1.0:1787338736.287446:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf41b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+58:11603:x1874160192152832:12345-192.168.201.53@tcp:101:bash.0 00010000:00010000:1.0:1787338736.287469:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787338736.287488:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9de00/0x83671231080c227f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab9d8 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338736.287564:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ce00/0x83671231080c2286 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338736.287579:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5a00/0x83671231080c226a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab9d1 expref: 59 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338736.287587:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c2278 lrc: 2/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338736.287593:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ce00/0x83671231080c2286 lrc: 5/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338736.287610:0:5841:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c2278 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338736.287635:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5a00/0x83671231080c226a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab9d1 expref: 59 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338736.287659:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5a00/0x83671231080c226a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab9d1 expref: 59 pid: 7647 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338736.287673:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc4096a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5841:1874160212062592:192.168.201.53@tcp:104: 00000100:00100000:1.0:1787338736.287767:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbedd6bd80 going to sleep for 11 seconds 00010000:00010000:3.0:1787338736.290633:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c2278 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338736.290678:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c2278 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338736.290686:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c2278 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338736.290692:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbfbe9d600 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:3.0:1787338736.290697:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c2278 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338736.290704:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c2278 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338736.290722:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff90bbc2a93500) 00010000:00010000:3.0:1787338736.290726:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787338736.290728:0:3300:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ce00/0x83671231080c2286 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338736.290739:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c2278 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338736.290745:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c2278 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338736.291301:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338736.291418:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192152960 00000100:00100000:3.0:1787338736.291427:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192152960 00010000:00010000:3.0:1787338736.291461:0:6704:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5a00/0x83671231080c226a lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab9d1 expref: 59 pid: 7647 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338736.291499:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 80 00000100:00100000:3.0:1787338736.291509:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbed9ca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:83642291-0761-4205-9531-7fd25bc2d48e+59:2358:x1874160192152960:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787338736.291531:0:6704:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787338736.291538:0:6704:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5a00/0x83671231080c226a lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab9d1 expref: 59 pid: 7647 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338736.291550:0:6704:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5a00/0x83671231080c226a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab9d1 expref: 59 pid: 7647 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338736.291568:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff90bbc2a93500) 00010000:00010000:3.0:1787338736.291573:0:6704:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ce00/0x83671231080c2286 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338736.291580:0:6704:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ce00/0x83671231080c2286 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338736.291586:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ce00/0x83671231080c2286 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338736.291605:0:6704:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787338736.291673:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbed9ca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:83642291-0761-4205-9531-7fd25bc2d48e+59:2358:x1874160192152960:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 165us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338736.291680:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 80 00010000:00010000:1.0:1787338736.293474:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5a00/0x83671231080c226a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab9d1 expref: 58 pid: 7647 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338736.293498:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc4096a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5841:1874160212062592:192.168.201.53@tcp:104: 00010000:00010000:1.0:1787338736.293526:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ce00/0x83671231080c2286 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338736.293536:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ce00/0x83671231080c2286 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338736.293541:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ce00/0x83671231080c2286 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787338736.293589:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1787338736.293594:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787338736.293617:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ce00/0x83671231080c2286 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338736.293723:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9de00/0x83671231080c227f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab9d8 expref: 58 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338736.293739:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ce00/0x83671231080c2286 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab9d8 expref: 57 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338736.293747:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff90bbc2a93500) 00010000:00010000:1.0:1787338736.293750:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787338736.293753:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbfbe9ce00, rc 0) 00000100:00100000:1.0:1787338736.293896:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf41b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+57:11603:x1874160192152832:12345-192.168.201.53@tcp:101:bash.0 Request processed in 6430us (7137us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338736.293921:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 209 00000100:00100000:2.0:1787338736.297298:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338736.297394:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192153216 00000100:00100000:3.0:1787338736.297404:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192153216 00000100:00100000:3.0:1787338736.297487:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 59 00000100:00100000:3.0:1787338736.297499:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf3e91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:83642291-0761-4205-9531-7fd25bc2d48e+57:11603:x1874160192153216:12345-192.168.201.53@tcp:35:bash.0 00000100:00100000:3.0:1787338736.297738:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf3e91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:83642291-0761-4205-9531-7fd25bc2d48e+58:11603:x1874160192153216:12345-192.168.201.53@tcp:35:bash.0 Request processed in 240us (449us total) trans 4294967501 rc 0/0 00000100:00100000:3.0:1787338736.297746:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 59 00000100:00100000:0.0:1787338736.367318:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338736.367461:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192153344 00000100:00100000:1.0:1787338736.367470:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192153344 00000100:00100000:1.0:1787338736.367563:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 210 00000100:00100000:1.0:1787338736.367575:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf41b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+58:11609:x1874160192153344:12345-192.168.201.53@tcp:101:lfs.0 00010000:00010000:1.0:1787338736.367598:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787338736.367618:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9de00/0x83671231080c228d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab9df expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338736.367690:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9dc00/0x83671231080c2294 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338736.367703:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9dc00/0x83671231080c2294 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338736.367713:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9dc00/0x83671231080c2294 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787338736.367765:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:1.0:1787338736.367769:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787338736.367790:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9dc00/0x83671231080c2294 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338736.367813:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9de00/0x83671231080c228d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab9df expref: 60 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338736.367977:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9dc00/0x83671231080c2294 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab9df expref: 59 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338736.368004:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff90bbeb14d600) 00010000:00010000:1.0:1787338736.368007:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787338736.368010:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbfbe9dc00, rc 0) 00000100:00100000:1.0:1787338736.368062:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf41b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+59:11609:x1874160192153344:12345-192.168.201.53@tcp:101:lfs.0 Request processed in 489us (753us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338736.368069:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 210 00000100:00100000:2.0:1787338736.371183:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338736.372130:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192153472 00000100:00100000:0.0:1787338736.372149:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192153472 00000100:00100000:0.0:1787338736.372270:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 211 00000100:00100000:0.0:1787338736.372281:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf7ed6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+59:11609:x1874160192153472:12345-192.168.201.53@tcp:101:lfs.0 00010000:00010000:0.0:1787338736.372303:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787338736.372325:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5c00/0x83671231080c229b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab9e6 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338736.372409:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5800/0x83671231080c22a2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338736.372423:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5800/0x83671231080c22a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338736.372433:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5800/0x83671231080c22a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338736.372447:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4200/0x83671231080c22a9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338736.372454:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4200/0x83671231080c22a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338736.372461:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4200/0x83671231080c22a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338736.372571:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4a00/0x83671231080c22b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338736.372580:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4a00/0x83671231080c22b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338736.372587:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4a00/0x83671231080c22b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787338736.372631:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1787338736.372635:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787338736.372663:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4a00/0x83671231080c22b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338736.372676:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4a00/0x83671231080c22b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338736.372684:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5800/0x83671231080c22a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338736.372690:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5800/0x83671231080c22a2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338736.372696:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5800/0x83671231080c22a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338736.372702:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbffef5800 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:0.0:1787338736.372705:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5800/0x83671231080c22a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338736.372712:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5800/0x83671231080c22a2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338736.372725:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff90bbeb14d600) 00010000:00010000:0.0:1787338736.372728:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787338736.372733:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5800/0x83671231080c22a2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338736.372739:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5800/0x83671231080c22a2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338736.372765:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4200/0x83671231080c22a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338736.372772:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4200/0x83671231080c22a9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338736.372777:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4200/0x83671231080c22a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338736.372782:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbffef4200 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:0.0:1787338736.372784:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4200/0x83671231080c22a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338736.372790:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4200/0x83671231080c22a9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338736.372798:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff90bbeb14df00) 00010000:00010000:0.0:1787338736.372801:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787338736.372804:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4200/0x83671231080c22a9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338736.372810:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4200/0x83671231080c22a9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338736.372853:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5c00/0x83671231080c229b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab9e6 expref: 61 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338736.372867:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4a00/0x83671231080c22b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab9e6 expref: 60 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338736.372903:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff90bbc2a93500) 00010000:00010000:0.0:1787338736.372905:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787338736.372908:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbffef4a00, rc 0) 00000100:00100000:0.0:1787338736.372965:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf7ed6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+60:11609:x1874160192153472:12345-192.168.201.53@tcp:101:lfs.0 Request processed in 686us (1790us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338736.372973:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 211 00000100:00100000:3.0:1787338736.376919:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338736.376995:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338736.377657:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192153728 00000100:00100000:2.0:1787338736.377668:0:7647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192153728 00000100:00100000:2.0:1787338736.377737:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 212 00000100:00100000:2.0:1787338736.377748:0:7647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee560700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+60:11609:x1874160192153728:12345-192.168.201.53@tcp:101:lfs.0 00010000:00010000:2.0:1787338736.377766:0:7647:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787338736.377786:0:7647:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52c00/0x83671231080c22b7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab9ed expref: -99 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338736.377906:0:7647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52000/0x83671231080c22be lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338736.377939:0:7647:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ce00/0x83671231080c2286 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab9d8 expref: 61 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338736.377948:0:7647:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4a00/0x83671231080c22b0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab9e6 expref: 61 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338736.377957:0:7647:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52000/0x83671231080c22be lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338736.377996:0:7647:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4a00/0x83671231080c22b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab9e6 expref: 61 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338736.378507:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192153856 00000100:00100000:3.0:1787338736.378515:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192153856 00010000:00010000:3.0:1787338736.378537:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4a00/0x83671231080c22b0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab9e6 expref: 62 pid: 5840 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338736.378562:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 81 00000100:00100000:3.0:1787338736.378569:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbde53cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:83642291-0761-4205-9531-7fd25bc2d48e+62:2358:x1874160192153856:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787338736.378579:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787338736.378584:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4a00/0x83671231080c22b0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab9e6 expref: 62 pid: 5840 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338736.378702:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787338736.379026:0:7647:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4a00/0x83671231080c22b0 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab9e6 expref: 62 pid: 5840 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338736.379043:0:7647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbffa4b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7647:1874160212062720:192.168.201.53@tcp:104: 00010000:00010000:3.0:1787338736.379314:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4a00/0x83671231080c22b0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab9e6 expref: 62 pid: 5840 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338736.379335:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff90bbc2a93500) 00010000:00010000:3.0:1787338736.379340:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52000/0x83671231080c22be lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338736.379347:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52000/0x83671231080c22be lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338736.379354:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787338736.379382:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbde53cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:83642291-0761-4205-9531-7fd25bc2d48e+62:2358:x1874160192153856:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 813us (2386us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338736.379389:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 81 00010000:00010000:2.0:1787338736.381984:0:7647:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ce00/0x83671231080c2286 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab9d8 expref: 61 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338736.382005:0:7647:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ce00/0x83671231080c2286 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab9d8 expref: 61 pid: 5841 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338736.382018:0:7647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc90c3800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7647:1874160212062848:192.168.201.53@tcp:104: 00000100:00100000:2.0:1787338736.382282:0:7647:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bac1d33600 going to sleep for 11 seconds 00010000:00010000:2.0:1787338736.382309:0:7647:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.201.53@tcp) returned -22 from blocking AST (req@000000009e45f01c x1874160212062720) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4a00/0x83671231080c22b0 lrc: 1/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab9e6 expref: 61 pid: 5840 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338736.382347:0:7647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4a00/0x83671231080c22b0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab9e6 expref: 61 pid: 5840 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338736.382363:0:7647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbffa4b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7647:1874160212062720:192.168.201.53@tcp:104: 00000100:00100000:0.0:1787338736.385569:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338736.385669:0:7647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc90c3800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7647:1874160212062848:192.168.201.53@tcp:104: 00010000:00010000:2.0:1787338736.385704:0:7647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff90bbc2a93500) 00010000:00010000:2.0:1787338736.385711:0:7647:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52000/0x83671231080c22be lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338736.385722:0:7647:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52000/0x83671231080c22be lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338736.385731:0:7647:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52000/0x83671231080c22be lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338736.385796:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192153984 00000100:00100000:3.0:1787338736.385803:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192153984 00010000:00010000:3.0:1787338736.385862:0:6704:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ce00/0x83671231080c2286 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab9d8 expref: 61 pid: 5841 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338736.385931:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 82 00000100:00100000:3.0:1787338736.385941:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf41b5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:83642291-0761-4205-9531-7fd25bc2d48e+61:2359:x1874160192153984:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787338736.385957:0:6704:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787338736.385963:0:6704:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ce00/0x83671231080c2286 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab9d8 expref: 61 pid: 5841 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338736.385976:0:6704:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ce00/0x83671231080c2286 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab9d8 expref: 61 pid: 5841 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338736.386000:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ce00/0x83671231080c2286 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab9d8 expref: 61 pid: 5841 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338736.386014:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff90bbc2a93500) 00010000:00010000:3.0:1787338736.386018:0:6704:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52000/0x83671231080c22be lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338736.386025:0:6704:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52000/0x83671231080c22be lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338736.386031:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52000/0x83671231080c22be lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338736.386052:0:6704:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787338736.386101:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf41b5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:83642291-0761-4205-9531-7fd25bc2d48e+60:2359:x1874160192153984:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 161us (541us total) trans 0 rc 0/0 00010000:00010000:2.0:1787338736.386282:0:7647:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52000/0x83671231080c22be lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338736.386290:0:7647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52000/0x83671231080c22be lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787338736.386309:0:7647:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1787338736.386454:0:7647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52c00/0x83671231080c22b7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab9ed expref: 62 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338736.386470:0:7647:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52000/0x83671231080c22be lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab9ed expref: 61 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338736.386488:0:7647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff90bbc2a93500) 00010000:00010000:2.0:1787338736.386490:0:7647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787338736.386493:0:7647:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf3c52000, rc 0) 00000100:00100000:2.0:1787338736.386517:0:7647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee560700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+61:11609:x1874160192153728:12345-192.168.201.53@tcp:101:lfs.0 Request processed in 8772us (9609us total) trans 4294967502 rc 0/0 00000100:00100000:2.0:1787338736.386524:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 212 00000100:00100000:3.0:1787338736.386979:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 82 00000100:00100000:3.0:1787338736.389797:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338736.389920:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192154240 00000100:00100000:0.0:1787338736.389930:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192154240 00000100:00100000:0.0:1787338736.389990:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 16 00000100:00100000:0.0:1787338736.390001:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee563100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:83642291-0761-4205-9531-7fd25bc2d48e+60:11609:x1874160192154240:12345-192.168.201.53@tcp:103:lfs.0 00010000:00010000:0.0:1787338736.390018:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787338736.390044:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c000/0x83671231080c221d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab9c3 expref: 60 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338736.390066:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff90bbc2a93500) 00010000:00010000:0.0:1787338736.390072:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787338736.390245:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee563100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:83642291-0761-4205-9531-7fd25bc2d48e+59:11609:x1874160192154240:12345-192.168.201.53@tcp:103:lfs.0 Request processed in 244us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338736.390262:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 16 00000100:00100000:0.0:1787338736.392386:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338736.392460:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192154368 00000100:00100000:3.0:1787338736.392472:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192154368 00000100:00100000:3.0:1787338736.392529:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 213 00000100:00100000:3.0:1787338736.392539:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc281880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+59:11609:x1874160192154368:12345-192.168.201.53@tcp:58:lfs.0 00010000:00010000:3.0:1787338736.392646:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5200/0x83671231080c22cc lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338736.392665:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5200/0x83671231080c22cc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338736.392678:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5200/0x83671231080c22cc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787338736.393540:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:3.0:1787338736.393654:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc281880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+59:11609:x1874160192154368:12345-192.168.201.53@tcp:58:lfs.0 Request processed in 1107us (1266us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338736.393665:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 213 00000100:00100000:2.0:1787338736.397369:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338736.397559:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192154496 00000100:00100000:1.0:1787338736.397569:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192154496 00000100:00100000:1.0:1787338736.397628:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 214 00000100:00100000:1.0:1787338736.397638:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc90c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+59:11609:x1874160192154496:12345-192.168.201.53@tcp:101:lfs.0 00010000:00010000:1.0:1787338736.397760:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787338736.397782:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9de00/0x83671231080c22d3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab9f4 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338736.397932:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5200/0x83671231080c22cc lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338736.397943:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9de00/0x83671231080c22d3 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab9f4 expref: 60 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338736.397963:0:5839:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5200/0x83671231080c22cc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338736.397977:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9de00/0x83671231080c22d3 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab9f4 expref: 60 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338736.397992:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff90bbc2a93500) 00010000:00010000:1.0:1787338736.398009:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787338736.398013:0:5839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9de00/0x83671231080c22d3 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab9f4 expref: 60 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338736.398021:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbfbe9de00, rc 0) 00000100:00100000:1.0:1787338736.398256:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc90c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+60:11609:x1874160192154496:12345-192.168.201.53@tcp:101:lfs.0 Request processed in 609us (888us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338736.398265:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 214 00000040:00080000:1.0:1787338737.206827:0:11692:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787338737.206837:0:11692:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787338737.206895:0:11692:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:1.0:1787338737.206903:0:11692:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787338737.207034:0:11692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc4096a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11692:1874160212062976:192.168.201.53@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787338737.207141:0:11692:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbedd6bd80 going to sleep for 11 seconds 00000100:00100000:2.0:1787338737.218601:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338737.218669:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192154624 00000100:00100000:0.0:1787338737.218679:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192154624 00000100:00100000:0.0:1787338737.218756:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 215 00000100:00100000:0.0:1787338737.218778:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc90c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+61:11611:x1874160192154624:12345-192.168.201.53@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787338737.218855:0:5840:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787338737.219022:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc90c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+61:11611:x1874160192154624:12345-192.168.201.53@tcp:53:lhsmtool_posix.0 Request processed in 249us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338737.219030:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 215 00000100:00080000:2.0:1787338737.219046:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787338737.221433:0:11692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc4096a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11692:1874160212062976:192.168.201.53@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787338737.232501:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338737.232637:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192154752 00000100:00100000:0.0:1787338737.232647:0:7647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192154752 00000100:00100000:0.0:1787338737.232705:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 216 00000100:00100000:0.0:1787338737.232716:0:7647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+60:11611:x1874160192154752:12345-192.168.201.53@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787338737.232788:0:7647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5c00/0x83671231080c22da lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.232811:0:7647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5c00/0x83671231080c22da lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.232825:0:7647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5c00/0x83671231080c22da lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.232840:0:7647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4200/0x83671231080c22e1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.232847:0:7647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4200/0x83671231080c22e1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.232853:0:7647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4200/0x83671231080c22e1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.232908:0:7647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5800/0x83671231080c22e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.232919:0:7647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5800/0x83671231080c22e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.233256:0:7647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5800/0x83671231080c22e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787338737.233299:0:7647:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1787338737.233303:0:7647:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787338737.233319:0:7647:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5800/0x83671231080c22e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.233331:0:7647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5c00/0x83671231080c22da lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.233338:0:7647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5c00/0x83671231080c22da lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.233345:0:7647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5c00/0x83671231080c22da lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.233350:0:7647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbffef5c00 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:0.0:1787338737.233355:0:7647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5c00/0x83671231080c22da lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.233363:0:7647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5c00/0x83671231080c22da lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.233374:0:7647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90bbdee56100) 00010000:00010000:0.0:1787338737.233377:0:7647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787338737.233382:0:7647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5c00/0x83671231080c22da lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.233387:0:7647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5c00/0x83671231080c22da lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.233411:0:7647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4200/0x83671231080c22e1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.233417:0:7647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4200/0x83671231080c22e1 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.233423:0:7647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4200/0x83671231080c22e1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.233428:0:7647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbffef4200 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:0.0:1787338737.233430:0:7647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4200/0x83671231080c22e1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.233436:0:7647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4200/0x83671231080c22e1 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.233443:0:7647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff90bbeb14df00) 00010000:00010000:0.0:1787338737.233446:0:7647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787338737.233449:0:7647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4200/0x83671231080c22e1 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.233454:0:7647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4200/0x83671231080c22e1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.233471:0:7647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5800/0x83671231080c22e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.233477:0:7647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5800/0x83671231080c22e8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.233483:0:7647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5800/0x83671231080c22e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.233494:0:7647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbffef5800 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:0.0:1787338737.233497:0:7647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5800/0x83671231080c22e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.233503:0:7647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5800/0x83671231080c22e8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.233511:0:7647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff90bbc2a93500) 00010000:00010000:0.0:1787338737.233513:0:7647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787338737.233517:0:7647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5800/0x83671231080c22e8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.233522:0:7647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5800/0x83671231080c22e8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338737.233595:0:7647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+60:11611:x1874160192154752:12345-192.168.201.53@tcp:34:lhsmtool_posix.0 Request processed in 879us (1101us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338737.233603:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 216 00000100:00100000:2.0:1787338737.247497:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338737.247893:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192155008 00000100:00100000:0.0:1787338737.247905:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192155008 00000100:00100000:0.0:1787338737.248094:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 217 00000100:00100000:0.0:1787338737.248104:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee081180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+60:11611:x1874160192155008:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787338737.248125:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787338737.248145:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5800/0x83671231080c22ef lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadab9fb expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.248255:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4200/0x83671231080c22f6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.248289:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4200/0x83671231080c22f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.248301:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4200/0x83671231080c22f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787338737.248314:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1787338737.248410:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4200/0x83671231080c22f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.248418:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4200/0x83671231080c22f6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.248425:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4200/0x83671231080c22f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.248431:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbffef4200 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:0.0:1787338737.248435:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4200/0x83671231080c22f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.248443:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4200/0x83671231080c22f6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.248456:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff90bbc2a93500) 00010000:00010000:0.0:1787338737.248460:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787338737.248465:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4200/0x83671231080c22f6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.248471:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4200/0x83671231080c22f6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.248514:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5800/0x83671231080c22ef lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab9fb expref: 62 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.248532:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90bbdee56100) 00010000:00010000:0.0:1787338737.248535:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787338737.248540:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5800/0x83671231080c22ef lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab9fb expref: 62 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.248549:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbffef5800, rc 0) 00000100:00100000:0.0:1787338737.248648:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee081180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+61:11611:x1874160192155008:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 Request processed in 545us (1162us total) trans 4294967503 rc 301/301 00000100:00100000:0.0:1787338737.248656:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 217 00000100:00100000:2.0:1787338737.253246:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338737.253411:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192155136 00000100:00100000:0.0:1787338737.253422:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192155136 00000100:00100000:0.0:1787338737.253521:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 218 00000100:00100000:0.0:1787338737.253532:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbff8fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+61:11611:x1874160192155136:12345-192.168.201.53@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787338737.253606:0:5839:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787338737.253755:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbff8fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+61:11611:x1874160192155136:12345-192.168.201.53@tcp:53:lhsmtool_posix.0 Request processed in 225us (1190us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338737.253763:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 218 00000100:00100000:2.0:1787338737.259443:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338737.259532:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192155392 00000100:00100000:0.0:1787338737.259544:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192155392 00000100:00100000:0.0:1787338737.259632:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 219 00000100:00100000:0.0:1787338737.259644:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbff8fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+61:11611:x1874160192155392:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787338737.259664:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787338737.259668:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787338737.259694:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9dc00/0x83671231080c2294 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab9df expref: 61 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.259731:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff90bbeb14d600) 00010000:00010000:0.0:1787338737.259736:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787338737.259752:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5c00/0x83671231080c2304 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadaba02 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787338737.260279:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:0.0:1787338737.260509:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4000/0x83671231080c230b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.260522:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4000/0x83671231080c230b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.260532:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4000/0x83671231080c230b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.260589:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5c00/0x83671231080c2304 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadaba02 expref: 63 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.260605:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4000/0x83671231080c230b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadaba02 expref: 62 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.260613:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff90bbeb14df00) 00010000:00010000:0.0:1787338737.260615:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787338737.260618:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbffef4000, rc 0) 00000100:00100000:0.0:1787338737.260677:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbff8fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+62:11611:x1874160192155392:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 Request processed in 1034us (1244us total) trans 4294967504 rc 0/0 00000100:00100000:0.0:1787338737.260685:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 219 00000100:00100000:2.0:1787338737.265830:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338737.265959:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192155648 00000100:00100000:0.0:1787338737.265970:0:7647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192155648 00000100:00100000:0.0:1787338737.266033:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 220 00000100:00100000:0.0:1787338737.266044:0:7647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbff8fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+62:11611:x1874160192155648:12345-192.168.201.53@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787338737.266103:0:7647:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787338737.266133:0:7647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4000/0x83671231080c230b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadaba02 expref: 62 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.266156:0:7647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff90bbeb14df00) 00010000:00010000:0.0:1787338737.266169:0:7647:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787338737.266190:0:7647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4600/0x83671231080c2319 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.266204:0:7647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4600/0x83671231080c2319 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.266215:0:7647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4600/0x83671231080c2319 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.266229:0:7647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4400/0x83671231080c2320 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xe93479ec bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.266249:0:7647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4400/0x83671231080c2320 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xe93479ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.266256:0:7647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4400/0x83671231080c2320 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xe93479ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.266331:0:7647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4600/0x83671231080c2319 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.266357:0:7647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4600/0x83671231080c2319 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.266363:0:7647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4600/0x83671231080c2319 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.266369:0:7647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbffef4600 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:0.0:1787338737.266373:0:7647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4600/0x83671231080c2319 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.266381:0:7647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4600/0x83671231080c2319 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.266390:0:7647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff90bbeb14d600) 00010000:00010000:0.0:1787338737.266393:0:7647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787338737.266397:0:7647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4600/0x83671231080c2319 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.266402:0:7647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4600/0x83671231080c2319 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.266411:0:7647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4400/0x83671231080c2320 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xe93479ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.266417:0:7647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4400/0x83671231080c2320 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xe93479ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.266422:0:7647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4400/0x83671231080c2320 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xe93479ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.266427:0:7647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbffef4400 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:0.0:1787338737.266436:0:7647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4400/0x83671231080c2320 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xe93479ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.266443:0:7647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4400/0x83671231080c2320 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xe93479ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.266451:0:7647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xe93479ec (ffff90bbeb14d200) 00010000:00010000:0.0:1787338737.266453:0:7647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787338737.266455:0:7647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4400/0x83671231080c2320 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xe93479ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.266460:0:7647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4400/0x83671231080c2320 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xe93479ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338737.266549:0:7647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbff8fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+61:11611:x1874160192155648:12345-192.168.201.53@tcp:36:lhsmtool_posix.0 Request processed in 505us (726us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787338737.266556:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 220 00000100:00100000:2.0:1787338737.274000:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338737.274144:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192155776 00000100:00100000:3.0:1787338737.274155:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192155776 00000100:00100000:3.0:1787338737.274217:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 221 00000100:00100000:3.0:1787338737.274230:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbff8fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+61:11611:x1874160192155776:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787338737.274274:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787338737.274305:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4400/0x83671231080c2327 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadaba09 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338737.274345:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4000/0x83671231080c232e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338737.274358:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4000/0x83671231080c232e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338737.274384:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4000/0x83671231080c232e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338737.274480:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4400/0x83671231080c2327 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadaba09 expref: 63 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338737.274500:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4000/0x83671231080c232e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadaba09 expref: 62 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338737.274510:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff90bbd38d6c00) 00010000:00010000:3.0:1787338737.274514:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787338737.274517:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf7ea4000, rc 0) 00000100:00100000:3.0:1787338737.274589:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbff8fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+62:11611:x1874160192155776:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 Request processed in 359us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338737.274605:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 221 00000100:00100000:2.0:1787338737.278149:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338737.281851:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192156032 00000100:00100000:1.0:1787338737.281864:0:7647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192156032 00000100:00100000:1.0:1787338737.282064:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 222 00000100:00100000:1.0:1787338737.282077:0:7647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbff8fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+62:11611:x1874160192156032:12345-192.168.201.53@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787338737.282157:0:7647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c400/0x83671231080c2335 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338737.282173:0:7647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c400/0x83671231080c2335 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338737.282185:0:7647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c400/0x83671231080c2335 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787338737.282434:0:7647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:1.0:1787338737.282443:0:7647:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 390123568650ns, next at 391123566164ns, rc = 0 00000004:00010000:1.0:1787338737.282526:0:7647:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000032d81a59 reply state 0000000025a50924 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c400/0x83671231080c2335 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338737.282536:0:7647:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787338737.292251:0:7647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbff8fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+64:11611:x1874160192156032:12345-192.168.201.53@tcp:36:lhsmtool_posix.0 Request processed in 10153us (14086us total) trans 4294967505 rc 0/0 00000100:00100000:1.0:1787338737.292265:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 222 00010000:00010000:0.0:1787338737.309226:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c400/0x83671231080c2335 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.309256:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c400/0x83671231080c2335 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.309265:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c400/0x83671231080c2335 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338737.309275:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00010000:00010000:0.0:1787338737.309278:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbfbe9c400 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:0.0:1787338737.309285:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c400/0x83671231080c2335 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.309293:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c400/0x83671231080c2335 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.309321:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff90bbd38d6c00) 00010000:00010000:0.0:1787338737.309325:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787338737.309330:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c400/0x83671231080c2335 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.309337:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c400/0x83671231080c2335 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338737.309416:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192156160 00000100:00100000:3.0:1787338737.309425:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192156160 00000100:00100000:3.0:1787338737.309479:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 223 00000100:00100000:3.0:1787338737.309491:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbff8ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+63:11611:x1874160192156160:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787338737.309514:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787338737.309532:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4400/0x83671231080c233c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadaba10 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338737.312686:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4400/0x83671231080c233c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadaba10 expref: 64 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338737.312706:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4400/0x83671231080c233c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadaba10 expref: 64 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338737.312733:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff90bbd38d6c00) 00010000:00010000:2.0:1787338737.312735:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787338737.312739:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf7ea4400, rc 0) 00000100:00100000:2.0:1787338737.312831:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbff8ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+64:11611:x1874160192156160:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 Request processed in 3341us (3560us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338737.312847:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 223 00000100:00100000:1.0:1787338737.316830:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338737.317310:0:10743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192156288 00000100:00100000:3.0:1787338737.317320:0:10743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192156288 00000100:00100000:3.0:1787338737.317391:0:10743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 62 00000100:00100000:3.0:1787338737.317404:0:10743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4096a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:83642291-0761-4205-9531-7fd25bc2d48e+9:2359:x1874160192156288:12345-192.168.201.53@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1787338737.317715:0:10743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4096a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:83642291-0761-4205-9531-7fd25bc2d48e+10:2359:x1874160192156288:12345-192.168.201.53@tcp:2:lhsmtool_posix.0 Request processed in 313us (894us total) trans 4294967319 rc 0/0 00000100:00100000:3.0:1787338737.317723:0:10743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 62 00000100:00080000:3.0:1787338737.317745:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787338737.342709:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338737.342751:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192156544 00000100:00100000:0.0:1787338737.342762:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192156544 00000100:00100000:0.0:1787338737.342814:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 60 00000100:00100000:0.0:1787338737.342825:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc282a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:83642291-0761-4205-9531-7fd25bc2d48e+64:11611:x1874160192156544:12345-192.168.201.53@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787338737.343080:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc282a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:83642291-0761-4205-9531-7fd25bc2d48e+65:11611:x1874160192156544:12345-192.168.201.53@tcp:35:lhsmtool_posix.0 Request processed in 254us (378us total) trans 4294967506 rc 0/0 00000100:00100000:0.0:1787338737.343088:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 60 00000100:00100000:1.0:1787338737.347940:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338737.348178:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192156800 00000100:00100000:2.0:1787338737.348188:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192156800 00000100:00100000:2.0:1787338737.348250:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 224 00000100:00100000:2.0:1787338737.348260:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf4115180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+65:11611:x1874160192156800:12345-192.168.201.53@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787338737.348358:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf4115180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+65:11611:x1874160192156800:12345-192.168.201.53@tcp:57:lhsmtool_posix.0 Request processed in 99us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338737.348365:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 224 00000001:00080000:1.0:1787338737.348736:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:1.0:1787338737.348755:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000100:00100000:0.0:1787338737.351298:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338737.351401:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192156928 00000100:00100000:1.0:1787338737.351413:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192156928 00000100:00100000:1.0:1787338737.351478:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 225 00000100:00100000:1.0:1787338737.351489:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc282300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+65:11611:x1874160192156928:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787338737.351509:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787338737.351532:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c600/0x83671231080c2343 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadaba17 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338737.351819:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9da00/0x83671231080c234a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338737.351978:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9da00/0x83671231080c234a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338737.351991:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9da00/0x83671231080c234a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787338737.352043:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787338737.352062:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9da00/0x83671231080c234a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338737.352089:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c600/0x83671231080c2343 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadaba17 expref: 67 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338737.352107:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9da00/0x83671231080c234a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadaba17 expref: 66 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338737.352116:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff90bbd38d6c00) 00010000:00010000:1.0:1787338737.352119:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787338737.352123:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbfbe9da00, rc 0) 00000100:00100000:1.0:1787338737.352193:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc282300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+66:11611:x1874160192156928:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 Request processed in 705us (906us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338737.352199:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 225 00000100:00100000:0.0:1787338737.358326:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338737.358423:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192157056 00000100:00100000:2.0:1787338737.358433:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192157056 00000100:00100000:2.0:1787338737.358495:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 63 00000100:00100000:2.0:1787338737.358505:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc281c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:83642291-0761-4205-9531-7fd25bc2d48e+10:2358:x1874160192157056:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787338737.358523:0:6689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787338737.358541:0:6689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000094ec1110/0x83671231080c2351 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadaba1e expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787338737.358567:0:6689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a889ff1, blocks: 0x1 00010000:00010000:2.0:1787338737.358586:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=390s v=(0 0) 00010000:00010000:2.0:1787338737.358590:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787338737.358600:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094ec1110/0x83671231080c2351 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadaba1e expref: 11 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338737.358619:0:6689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000094ec1110/0x83671231080c2351 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadaba1e expref: 11 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338737.358655:0:6689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf3c53600, rc 0) 00000100:00100000:2.0:1787338737.358715:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc281c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:83642291-0761-4205-9531-7fd25bc2d48e+11:2358:x1874160192157056:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 Request processed in 211us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338737.358722:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 63 00000100:00100000:3.0:1787338737.362622:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338737.363027:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192157312 00000100:00100000:2.0:1787338737.365135:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192157312 00000100:00100000:2.0:1787338737.365213:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 226 00000100:00100000:2.0:1787338737.365225:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee562d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+66:11611:x1874160192157312:12345-192.168.201.53@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787338737.365424:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee562d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+66:11611:x1874160192157312:12345-192.168.201.53@tcp:57:lhsmtool_posix.0 Request processed in 202us (2817us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338737.365432:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 226 00000100:00100000:0.0:1787338737.378766:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338737.379003:0:10743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192157440 00000100:00100000:3.0:1787338737.379014:0:10743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192157440 00000100:00100000:3.0:1787338737.379079:0:10743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 64 00000100:00100000:3.0:1787338737.379089:0:10743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc282d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:83642291-0761-4205-9531-7fd25bc2d48e+11:11611:x1874160192157440:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787338737.379110:0:10743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787338737.379129:0:10743:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f3186d5/0x83671231080c2358 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadaba25 expref: -99 pid: 10743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338737.379165:0:10743:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000094ec1110/0x83671231080c2351 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadaba1e expref: 12 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338737.379173:0:10743:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787338737.379177:0:10743:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787338737.379182:0:10743:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f3186d5/0x83671231080c2358 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadaba25 expref: 12 pid: 10743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338737.379215:0:10743:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000094ec1110/0x83671231080c2351 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadaba1e expref: 12 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338737.379229:0:10743:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000094ec1110/0x83671231080c2351 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadaba1e expref: 12 pid: 6689 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338737.379277:0:10743:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee562a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10743:1874160212063104:192.168.201.53@tcp:104: 00000100:00100000:3.0:1787338737.379378:0:10743:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbedc57000 going to sleep for 11 seconds 00000100:00100000:1.0:1787338737.388257:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338737.388342:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192157568 00000100:00100000:0.0:1787338737.388351:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192157568 00010000:00010000:0.0:1787338737.388396:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000094ec1110/0x83671231080c2351 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadaba1e expref: 13 pid: 6689 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338737.388447:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 83 00000100:00100000:0.0:1787338737.388457:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf4707800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:83642291-0761-4205-9531-7fd25bc2d48e+13:2358:x1874160192157568:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787338737.388482:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787338737.388508:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000094ec1110/0x83671231080c2351 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadaba1e expref: 13 pid: 6689 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.388522:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000094ec1110/0x83671231080c2351 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadaba1e expref: 13 pid: 6689 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.388547:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787338737.388552:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787338737.388796:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002f3186d5/0x83671231080c2358 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadaba25 expref: 13 pid: 10743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.388813:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f3186d5/0x83671231080c2358 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadaba25 expref: 13 pid: 10743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.388859:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000002f3186d5/0x83671231080c2358 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadaba25 expref: 13 pid: 10743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338737.388894:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc280700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5824:1874160212063232:192.168.201.53@tcp:105: 00000100:00100000:0.0:1787338737.388980:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbd0cea540 going to sleep for 11 seconds 00010000:00010000:3.0:1787338737.389526:0:10743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000094ec1110/0x83671231080c2351 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadaba1e expref: 13 pid: 6689 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338737.389541:0:10743:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee562a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10743:1874160212063104:192.168.201.53@tcp:104: 00010000:00010000:3.0:1787338737.389663:0:10743:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002f3186d5/0x83671231080c2358 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadaba25 expref: 12 pid: 10743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338737.389676:0:10743:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf7ea5a00, rc 0) 00000100:00100000:3.0:1787338737.389756:0:10743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc282d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:83642291-0761-4205-9531-7fd25bc2d48e+12:11611:x1874160192157440:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 Request processed in 10668us (10999us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338737.389764:0:10743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 64 00000100:00100000:1.0:1787338737.396278:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338737.396701:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192157696 00000100:00100000:2.0:1787338737.396712:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192157696 00002000:00100000:2.0:1787338737.396764:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff90bbf4706d80 x1874160192157696/t0(0) o4->83642291-0761-4205-9531-7fd25bc2d48e@192.168.201.53@tcp:68/0 lens 504/0 e 0 to 0 dl 1787338748 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787338737.396776:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90bbf4706d80 with x1874160192157696 ext(0->12) 00002000:00010000:2.0:1787338737.396782:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90bbf4706d80 00000100:00100000:2.0:1787338737.396822:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 6 00000100:00100000:2.0:1787338737.396841:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf4706d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:83642291-0761-4205-9531-7fd25bc2d48e+12:2359:x1874160192157696:12345-192.168.201.53@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787338737.397587:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf4706d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:83642291-0761-4205-9531-7fd25bc2d48e+14:2359:x1874160192157696:12345-192.168.201.53@tcp:4:lhsmtool_posix.0 Request processed in 751us (1314us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1787338737.397596:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 6 00002000:00100000:2.0:1787338737.397604:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff90bbf4706d80 x1874160192157696/t4294967320(0) o4->83642291-0761-4205-9531-7fd25bc2d48e@192.168.201.53@tcp:68/0 lens 504/448 e 0 to 0 dl 1787338748 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787338737.397619:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90bbf4706d80 with x1874160192157696 ext(0->12) 00002000:00010000:2.0:1787338737.397624:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90bbf4706d80 00000100:00100000:1.0:1787338737.402414:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338737.402549:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192157824 00000100:00100000:2.0:1787338737.402559:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192157824 00000100:00100000:2.0:1787338737.402698:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 227 00000100:00100000:2.0:1787338737.402709:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf4704a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+66:11611:x1874160192157824:12345-192.168.201.53@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1787338737.403115:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc280700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5824:1874160212063232:192.168.201.53@tcp:105: 00010000:00010000:0.0:1787338737.403154:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787338737.403215:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf4707800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:83642291-0761-4205-9531-7fd25bc2d48e+13:2358:x1874160192157568:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 14759us (14968us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338737.403225:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 83 00010000:00010000:0.0:1787338737.403313:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787338737.482753:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf4704a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+66:11611:x1874160192157824:12345-192.168.201.53@tcp:44:lhsmtool_posix.0 Request processed in 80038us (80340us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338737.482767:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 227 00000001:00080000:2.0:1787338737.485030:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:2.0:1787338737.485054:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:2.0:1787338737.485091:0:5861:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90bbf41c1240 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:2.0:1787338737.485096:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90bbffebf900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90bbc34d1c00 00000020:00080000:2.0:1787338737.485100:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90bbffebf000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90bbee0d4c00 00000004:00080000:2.0:1787338737.485130:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000020:00080000:2.0:1787338737.485157:0:5861:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000004:00080000:2.0:1787338737.485171:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:2.0:1787338737.485193:0:5861:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90bac1d33a80 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:2.0:1787338737.485196:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90bbc3e46300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90bac1d33c00 00000020:00080000:2.0:1787338737.485199:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90bbc3e46f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90bbef28b000 00000020:00080000:3.0:1787338737.485292:0:5872:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:3.0:1787338737.485507:0:5872:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1787338737.485718:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc280700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874160212063360:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787338737.485788:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338737.486047:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212063360 00000100:00100000:0.0:1787338737.486056:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212063360 00000100:00100000:0.0:1787338737.486122:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787338737.486132:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee562a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874160212063360:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1787338737.486159:0:6689:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:0.0:1787338737.486190:0:6689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a889fef, atime: 0x6a889fef, ctime: 0x6a889fef, blocks: 0xb 00010000:00010000:0.0:1787338737.486199:0:6689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ae237a6/0x83671231080c235f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.486215:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=390s v=(0 0) 00010000:00010000:0.0:1787338737.486219:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787338737.486226:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009ae237a6/0x83671231080c235f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.486252:0:6689:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009ae237a6/0x83671231080c235f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.486263:0:6689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ae237a6/0x83671231080c235f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.486271:0:6689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009ae237a6/0x83671231080c235f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.486290:0:6689:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787338737.486791:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee562a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3314:x1874160212063360:12345-0@lo:6:osp-syn-1-0.0 Request processed in 659us (1001us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1787338737.486809:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00010000:0.0:1787338737.486978:0:11676:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787338737.486985:0:11676:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009ae237a6/0x83671231080c235f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.486994:0:11676:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbffef5c00 already unused, calling callback (ffffffffc1546230) 00010000:00010000:0.0:1787338737.486999:0:11676:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009ae237a6/0x83671231080c235f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.487009:0:11676:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009ae237a6/0x83671231080c235f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.487026:0:11676:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009ae237a6/0x83671231080c235f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.487033:0:11676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009ae237a6/0x83671231080c235f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.487053:0:11676:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787338737.487055:0:11676:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787338737.487056:0:11676:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787338737.487089:0:3314:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:0.0:1787338737.487093:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90bbffa2ea00, transno 4294967307 00000004:00080000:0.0:1787338737.487103:0:3314:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967309 00000100:00100000:0.0:1787338737.487124:0:3314:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff90bbfc280700 x1874160212063360/t4294967310(4294967310) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787338753 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1787338737.487135:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90bbfc280700/2, rc 0, transno 4294967310 00000100:00100000:0.0:1787338737.487146:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc280700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874160212063360:0@lo:6:osp-syn-1-0.0 00000100:00080000:3.0:1787338737.487412:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787338737.488543:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787338737.488560:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf4705180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874160212063616:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787338737.488637:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338737.488729:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf4704380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874160212063488:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787338737.488758:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338737.488811:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212063616 00000100:00100000:2.0:1787338737.488818:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212063616 00000100:00100000:2.0:1787338737.488899:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212063488 00000100:00100000:2.0:1787338737.488903:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212063488 00000100:00100000:2.0:1787338737.488925:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787338737.488934:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf4707480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3317:x1874160212063616:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1787338737.489086:0:6691:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1787338737.489089:0:6691:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1787338737 00002000:00010000:2.0:1787338737.489091:0:6691:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787338737.489093:0:6691:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1787338737 -> 1787338737 00002000:00010000:2.0:1787338737.489094:0:6691:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1787338737.489129:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf4707480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3317:x1874160212063616:12345-0@lo:2:osp-syn-0-0.0 Request processed in 196us (492us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1787338737.489136:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787338737.489155:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787338737.489160:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbff8fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3315:x1874160212063488:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1787338737.489175:0:6691:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:2.0:1787338737.489191:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001c71a9a/0x83671231080c2366 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338737.489210:0:6691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000044a75a54/0x83671231080c2121 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab984 expref: 12 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338737.489219:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=3s v=(0 0) 00010000:00010000:2.0:1787338737.489223:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787338737.489228:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001c71a9a/0x83671231080c2366 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338737.489265:0:6691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000044a75a54/0x83671231080c2121 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab984 expref: 12 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338737.489280:0:6691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000044a75a54/0x83671231080c2121 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab984 expref: 12 pid: 6689 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338737.489301:0:6691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbff8ff800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6691:1874160212063744:192.168.201.53@tcp:104: 00000100:00100000:2.0:1787338737.489367:0:6691:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bac1d33d80 going to sleep for 11 seconds 00000100:00080000:2.0:1787338737.489379:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1787338737.489405:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90bbf4705180/2, rc 0, transno 4294967321 00000100:00100000:2.0:1787338737.489409:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf4705180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874160212063616:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787338737.493043:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338737.493204:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192157952 00000100:00100000:2.0:1787338737.493212:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192157952 00000100:00100000:2.0:1787338737.493278:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 68 00000100:00100000:2.0:1787338737.493289:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf4705880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:83642291-0761-4205-9531-7fd25bc2d48e+13:2358:x1874160192157952:12345-192.168.201.53@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1787338737.493315:0:6691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbff8ff800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6691:1874160212063744:192.168.201.53@tcp:104: 00010000:00010000:3.0:1787338737.493339:0:6691:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000001c71a9a/0x83671231080c2366 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338737.496469:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338737.496535:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192158080 00000100:00100000:3.0:1787338737.496544:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192158080 00010000:00010000:3.0:1787338737.496584:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000044a75a54/0x83671231080c2121 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab984 expref: 14 pid: 6689 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338737.496628:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 84 00000100:00100000:3.0:1787338737.496638:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf4706680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:83642291-0761-4205-9531-7fd25bc2d48e+14:2358:x1874160192158080:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787338737.496652:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787338737.496658:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000044a75a54/0x83671231080c2121 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab984 expref: 14 pid: 6689 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338737.496671:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000044a75a54/0x83671231080c2121 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab984 expref: 14 pid: 6689 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338737.496696:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000044a75a54/0x83671231080c2121 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab984 expref: 14 pid: 6689 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338737.496712:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787338737.496716:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787338737.496722:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000001c71a9a/0x83671231080c2366 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338737.496732:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001c71a9a/0x83671231080c2366 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338737.497026:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787338737.497087:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf4706680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:83642291-0761-4205-9531-7fd25bc2d48e+13:2358:x1874160192158080:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 449us (627us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338737.497096:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 84 00010000:00010000:0.0:1787338737.497409:0:6691:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000001c71a9a/0x83671231080c2366 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.497421:0:6691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001c71a9a/0x83671231080c2366 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.497432:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001c71a9a/0x83671231080c2366 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.497440:0:6691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000001c71a9a/0x83671231080c2366 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.497457:0:6691:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787338737.499193:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbff8fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3315:x1874160212063488:12345-0@lo:6:osp-syn-0-0.0 Request processed in 10023us (10425us total) trans 4294967322 rc 0/0 00000100:00100000:0.0:1787338737.499207:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00010000:0.0:1787338737.499259:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787338737.499267:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000001c71a9a/0x83671231080c2366 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.499279:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf3c52e00 already unused, calling callback (ffffffffc1546230) 00010000:00010000:0.0:1787338737.499285:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000001c71a9a/0x83671231080c2366 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.499296:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000001c71a9a/0x83671231080c2366 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.499336:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000001c71a9a/0x83671231080c2366 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.499345:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001c71a9a/0x83671231080c2366 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.499368:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787338737.499370:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787338737.499372:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787338737.506909:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90bbf4704380/2, rc 0, transno 4294967322 00000100:00100000:2.0:1787338737.506928:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf4704380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874160212063488:0@lo:6:osp-syn-0-0.0 00000001:00080000:1.0:1787338737.557366:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967318 is committed 00000001:00080000:1.0:1787338737.557391:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000001:00080000:1.0:1787338737.557397:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000100:00100000:0.0:1787338737.557672:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf4705880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:83642291-0761-4205-9531-7fd25bc2d48e+7:2358:x1874160192157952:12345-192.168.201.53@tcp:16:lhsmtool_posix.0 Request processed in 64378us (64632us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338737.557684:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 68 00000100:00100000:2.0:1787338737.568354:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338737.568468:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192158336 00000100:00100000:1.0:1787338737.568478:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192158336 00000100:00100000:1.0:1787338737.568635:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 228 00000100:00100000:1.0:1787338737.568647:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbff8ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+20:11611:x1874160192158336:12345-192.168.201.53@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787338737.568703:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787338737.568732:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9da00/0x83671231080c234a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadaba17 expref: 20 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338737.568999:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff90bbd38d6c00) 00010000:00010000:1.0:1787338737.569005:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787338737.569040:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ca00/0x83671231080c236d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338737.569055:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ca00/0x83671231080c236d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338737.569065:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ca00/0x83671231080c236d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787338737.570588:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009ae58548 reply state 000000000fc78c29 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ca00/0x83671231080c236d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338737.570606:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787338737.570754:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbff8ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+21:11611:x1874160192158336:12345-192.168.201.53@tcp:36:lhsmtool_posix.0 Request processed in 2098us (2402us total) trans 4294967507 rc 0/0 00000100:00100000:1.0:1787338737.570764:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 228 00000100:00100000:1.0:1787338737.576438:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00010000:00010000:3.0:1787338737.576716:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ca00/0x83671231080c236d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338737.576728:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ca00/0x83671231080c236d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338737.576736:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ca00/0x83671231080c236d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338737.576752:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbfbe9ca00 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:3.0:1787338737.576758:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ca00/0x83671231080c236d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338737.576766:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ca00/0x83671231080c236d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338737.576784:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff90bbd38d6c00) 00010000:00010000:3.0:1787338737.576788:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787338737.576801:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ca00/0x83671231080c236d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338737.576807:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ca00/0x83671231080c236d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338737.576990:0:10743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192158464 00000100:00100000:2.0:1787338737.577000:0:10743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192158464 00000100:00100000:2.0:1787338737.577057:0:10743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 69 00000100:00100000:2.0:1787338737.577066:0:10743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf4704700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:83642291-0761-4205-9531-7fd25bc2d48e+7:2359:x1874160192158464:12345-192.168.201.53@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787338737.577280:0:10743:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1787338737.577284:0:10743:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1787338737 -> 1787338736 00002000:00010000:2.0:1787338737.577287:0:10743:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1787338735 00002000:00010000:2.0:1787338737.577289:0:10743:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1787338737 -> 1787338736 00002000:00010000:2.0:1787338737.577291:0:10743:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1787338737.577348:0:10743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf4704700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:83642291-0761-4205-9531-7fd25bc2d48e+8:2359:x1874160192158464:12345-192.168.201.53@tcp:2:lhsmtool_posix.0 Request processed in 282us (918us total) trans 4294967323 rc 0/0 00000100:00100000:2.0:1787338737.577373:0:10743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 69 00000100:00100000:2.0:1787338737.581091:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338737.581168:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192158720 00000100:00100000:3.0:1787338737.581189:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192158720 00000100:00100000:3.0:1787338737.581251:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 229 00000100:00100000:3.0:1787338737.581261:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbff8ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+20:11611:x1874160192158720:12345-192.168.201.53@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787338737.581347:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4800/0x83671231080c2374 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338737.581363:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4000/0x83671231080c232e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadaba09 expref: 20 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338737.581372:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4800/0x83671231080c2374 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338737.581409:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4000/0x83671231080c232e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadaba09 expref: 20 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338737.581422:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4000/0x83671231080c232e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadaba09 expref: 20 pid: 5841 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338737.581436:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc2d30e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5841:1874160212063872:192.168.201.53@tcp:104: 00000100:00100000:3.0:1787338737.581529:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbf41c1540 going to sleep for 11 seconds 00000100:00100000:2.0:1787338737.586766:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338737.586981:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192158848 00000100:00100000:3.0:1787338737.586992:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192158848 00010000:00010000:3.0:1787338737.587033:0:6704:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4000/0x83671231080c232e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadaba09 expref: 21 pid: 5841 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338737.587080:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 85 00000100:00100000:3.0:1787338737.587092:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc7c6f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:83642291-0761-4205-9531-7fd25bc2d48e+21:2358:x1874160192158848:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787338737.587118:0:6704:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787338737.587132:0:6704:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4000/0x83671231080c232e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadaba09 expref: 21 pid: 5841 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338737.587146:0:6704:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4000/0x83671231080c232e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadaba09 expref: 21 pid: 5841 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338737.587169:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff90bbd38d6c00) 00010000:00010000:3.0:1787338737.587173:0:6704:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4800/0x83671231080c2374 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338737.587183:0:6704:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4800/0x83671231080c2374 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338737.587190:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4800/0x83671231080c2374 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338737.587208:0:6704:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787338737.587275:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc7c6f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:83642291-0761-4205-9531-7fd25bc2d48e+21:2358:x1874160192158848:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 185us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338737.587283:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 85 00010000:00010000:1.0:1787338737.591449:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4000/0x83671231080c232e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadaba09 expref: 20 pid: 5841 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338737.591501:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc2d30e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5841:1874160212063872:192.168.201.53@tcp:104: 00010000:00010000:1.0:1787338737.591525:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4800/0x83671231080c2374 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338737.591536:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4800/0x83671231080c2374 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338737.591541:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4800/0x83671231080c2374 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338737.592336:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4800/0x83671231080c2374 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338737.592349:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4800/0x83671231080c2374 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338737.592356:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4800/0x83671231080c2374 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338737.592363:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea4800 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:1.0:1787338737.592368:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4800/0x83671231080c2374 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338737.592375:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4800/0x83671231080c2374 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338737.592392:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff90bbd38d6c00) 00010000:00010000:1.0:1787338737.592394:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787338737.592398:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4800/0x83671231080c2374 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338737.592419:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4800/0x83671231080c2374 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338737.592547:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbff8ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+19:11611:x1874160192158720:12345-192.168.201.53@tcp:55:lhsmtool_posix.0 Request processed in 11284us (11461us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787338737.592557:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 229 00000100:00100000:2.0:1787338737.598765:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338737.598844:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192158976 00000100:00100000:0.0:1787338737.598856:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192158976 00000100:00100000:0.0:1787338737.598940:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 70 00000100:00100000:0.0:1787338737.598951:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc95e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:83642291-0761-4205-9531-7fd25bc2d48e+8:2359:x1874160192158976:12345-192.168.201.53@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787338737.598996:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009ae237a6/0x83671231080c237b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.599017:0:6691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002f3186d5/0x83671231080c2358 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadaba25 expref: 8 pid: 10743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.599025:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787338737.599029:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787338737.599034:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ae237a6/0x83671231080c237b lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.599085:0:6691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002f3186d5/0x83671231080c2358 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadaba25 expref: 8 pid: 10743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.599101:0:6691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002f3186d5/0x83671231080c2358 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadaba25 expref: 8 pid: 10743 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338737.599114:0:6691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbffa2ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6691:1874160212064000:192.168.201.53@tcp:104: 00000100:00100000:0.0:1787338737.599583:0:6691:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbd0cea0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787338737.604809:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338737.604997:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192159104 00000100:00100000:1.0:1787338737.605007:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192159104 00010000:00010000:1.0:1787338737.605051:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002f3186d5/0x83671231080c2358 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadaba25 expref: 9 pid: 10743 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338737.605093:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 86 00000100:00100000:1.0:1787338737.605105:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc2d30e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:83642291-0761-4205-9531-7fd25bc2d48e+9:2356:x1874160192159104:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787338737.605121:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787338737.605144:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002f3186d5/0x83671231080c2358 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadaba25 expref: 9 pid: 10743 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338737.605157:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002f3186d5/0x83671231080c2358 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadaba25 expref: 9 pid: 10743 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338737.605182:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787338737.605186:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787338737.605192:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009ae237a6/0x83671231080c237b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338737.605201:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ae237a6/0x83671231080c237b lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338737.605246:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787338737.605301:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc2d30e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:83642291-0761-4205-9531-7fd25bc2d48e+9:2356:x1874160192159104:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 198us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338737.605310:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 86 00010000:00010000:0.0:1787338737.606504:0:6691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f3186d5/0x83671231080c2358 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadaba25 expref: 8 pid: 10743 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338737.606527:0:6691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbffa2ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6691:1874160212064000:192.168.201.53@tcp:104: 00010000:00010000:0.0:1787338737.606553:0:6691:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009ae237a6/0x83671231080c237b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.606563:0:6691:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009ae237a6/0x83671231080c237b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.606570:0:6691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ae237a6/0x83671231080c237b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.606599:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009ae237a6/0x83671231080c237b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.606638:0:6691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ae237a6/0x83671231080c237b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.606646:0:6691:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ae237a6/0x83671231080c237b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.606653:0:6691:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbffef5c00 already unused, calling callback (ffffffffc1546230) 00010000:00010000:0.0:1787338737.606656:0:6691:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ae237a6/0x83671231080c237b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.606664:0:6691:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ae237a6/0x83671231080c237b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.606679:0:6691:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ae237a6/0x83671231080c237b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.606686:0:6691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ae237a6/0x83671231080c237b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338737.606763:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc95e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:83642291-0761-4205-9531-7fd25bc2d48e+7:2359:x1874160192158976:12345-192.168.201.53@tcp:1:lhsmtool_posix.0 Request processed in 7813us (8009us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338737.606773:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 70 00000100:00100000:3.0:1787338737.613724:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338737.614327:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192159360 00000100:00100000:0.0:1787338737.614339:0:7647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192159360 00000100:00100000:0.0:1787338737.614442:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 230 00000100:00100000:0.0:1787338737.614469:0:7647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc2d30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+19:11611:x1874160192159360:12345-192.168.201.53@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787338737.614547:0:7647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5800/0x83671231080c2382 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.614578:0:7647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5800/0x83671231080c2382 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.614590:0:7647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5800/0x83671231080c2382 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.615145:0:7647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4200/0x83671231080c2389 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.615159:0:7647:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4400/0x83671231080c233c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadaba10 expref: 20 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.615169:0:7647:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4200/0x83671231080c2389 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.615203:0:7647:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4400/0x83671231080c233c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadaba10 expref: 20 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.615217:0:7647:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4400/0x83671231080c233c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadaba10 expref: 20 pid: 5841 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338737.615242:0:7647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbffa2e300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7647:1874160212064128:192.168.201.53@tcp:104: 00000100:00100000:0.0:1787338737.615335:0:7647:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbd0cea0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787338737.618819:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338737.619041:0:7647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbffa2e300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7647:1874160212064128:192.168.201.53@tcp:104: 00010000:00010000:0.0:1787338737.619069:0:7647:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4200/0x83671231080c2389 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338737.619279:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192159488 00000100:00100000:1.0:1787338737.619287:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192159488 00010000:00010000:1.0:1787338737.619321:0:6704:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4400/0x83671231080c233c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadaba10 expref: 21 pid: 5841 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338737.619360:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 87 00000100:00100000:1.0:1787338737.619370:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbde53dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:83642291-0761-4205-9531-7fd25bc2d48e+21:2359:x1874160192159488:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787338737.619385:0:6704:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787338737.619392:0:6704:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4400/0x83671231080c233c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadaba10 expref: 21 pid: 5841 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338737.619403:0:6704:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4400/0x83671231080c233c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadaba10 expref: 21 pid: 5841 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338737.619425:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4400/0x83671231080c233c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadaba10 expref: 21 pid: 5841 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338737.619440:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff90bbd38d6c00) 00010000:00010000:1.0:1787338737.619445:0:6704:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4200/0x83671231080c2389 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338737.619453:0:6704:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4200/0x83671231080c2389 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338737.619466:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4200/0x83671231080c2389 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338737.619495:0:6704:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787338737.619548:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbde53dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:83642291-0761-4205-9531-7fd25bc2d48e+20:2359:x1874160192159488:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 180us (739us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338737.619556:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 87 00010000:00010000:2.0:1787338737.619656:0:7647:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4200/0x83671231080c2389 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338737.619663:0:7647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4200/0x83671231080c2389 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787338737.619867:0:7647:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:2.0:1787338737.620041:0:7647:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:2.0:1787338737.620086:0:7647:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:2.0:1787338737.620173:0:7647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc7c6e300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7647:1874160212064256:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787338737.620217:0:7647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338737.620262:0:7647:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bac1d33d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787338737.620530:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212064256 00000100:00100000:1.0:1787338737.620537:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212064256 00000100:00100000:1.0:1787338737.620581:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787338737.620589:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc7c6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7647:x1874160212064256:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787338737.620671:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc7c6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7647:x1874160212064256:12345-0@lo:1000:mdt00_003.0 Request processed in 82us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338737.620678:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787338737.622197:0:7647:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:2.0:1787338737.622207:0:7647:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:2.0:1787338737.622244:0:7647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90bbf4705180, transno 4294967321 00000100:00100000:2.0:1787338737.622480:0:7647:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff90bbf4704380 x1874160212063488/t4294967322(4294967322) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787338753 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787338737.622493:0:7647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc7c6e300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7647:1874160212064256:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1787338737.623274:0:7647:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:2.0:1787338737.623351:0:7647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc7c6e300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7647:1874160212064384:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787338737.623406:0:7647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338737.623488:0:7647:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bac1d33180 going to sleep for 11 seconds 00000100:00100000:0.0:1787338737.628822:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212064384 00000100:00100000:0.0:1787338737.629010:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212064384 00000100:00100000:0.0:1787338737.629089:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787338737.629100:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc7c6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7647:x1874160212064384:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787338737.629616:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc7c6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:7647:x1874160212064384:12345-0@lo:1000:mdt00_003.0 Request processed in 517us (6208us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1787338737.629633:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787338737.631200:0:7647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc7c6e300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7647:1874160212064384:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1787338737.631343:0:7647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4200/0x83671231080c2389 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338737.631371:0:7647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4200/0x83671231080c2389 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338737.631379:0:7647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4200/0x83671231080c2389 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338737.631385:0:7647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbffef4200 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:2.0:1787338737.631389:0:7647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4200/0x83671231080c2389 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338737.631396:0:7647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4200/0x83671231080c2389 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338737.631412:0:7647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff90bbd38d6c00) 00010000:00010000:2.0:1787338737.631416:0:7647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787338737.631421:0:7647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4200/0x83671231080c2389 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338737.631427:0:7647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4200/0x83671231080c2389 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338737.631460:0:7647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5200/0x83671231080c22cc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338737.631465:0:7647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5200/0x83671231080c22cc lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338737.631471:0:7647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5200/0x83671231080c22cc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338737.631475:0:7647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea5200 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:2.0:1787338737.631484:0:7647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5200/0x83671231080c22cc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338737.631490:0:7647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5200/0x83671231080c22cc lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338737.631499:0:7647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff90bbc2a93500) 00010000:00010000:2.0:1787338737.631502:0:7647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787338737.631509:0:7647:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9de00/0x83671231080c22d3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab9f4 expref: 23 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338737.631519:0:7647:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9de00/0x83671231080c22d3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab9f4 expref: 23 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338737.631527:0:7647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9de00/0x83671231080c22d3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab9f4 expref: 23 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338737.631687:0:7647:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9de00/0x83671231080c22d3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab9f4 expref: 23 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338737.631703:0:7647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc7c6ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7647:1874160212064512:192.168.201.53@tcp:105: 00000100:00100000:2.0:1787338737.632040:0:7647:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bac1d333c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787338737.636069:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338737.636219:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192159616 00000100:00100000:1.0:1787338737.636240:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192159616 00000100:00100000:1.0:1787338737.636303:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 61 00000100:00100000:1.0:1787338737.636314:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc2d33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:83642291-0761-4205-9531-7fd25bc2d48e+24:11609:x1874160192159616:12345-192.168.201.53@tcp:49:lfs.0 00000100:00100000:1.0:1787338737.636440:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc2d33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:83642291-0761-4205-9531-7fd25bc2d48e+24:11609:x1874160192159616:12345-192.168.201.53@tcp:49:lfs.0 Request processed in 128us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338737.636447:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 61 00000100:00100000:3.0:1787338737.639215:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338737.639312:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192159872 00000100:00100000:1.0:1787338737.639320:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192159872 00000100:00100000:1.0:1787338737.639378:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 231 00000100:00100000:1.0:1787338737.639388:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc2d31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+24:11609:x1874160192159872:12345-192.168.201.53@tcp:58:lfs.0 00000040:00080000:1.0:1787338737.639762:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:1.0:1787338737.639897:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc2d31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+24:11609:x1874160192159872:12345-192.168.201.53@tcp:58:lfs.0 Request processed in 485us (664us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338737.639907:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 231 00000100:00100000:0.0:1787338737.647763:0:7647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc7c6ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7647:1874160212064512:192.168.201.53@tcp:105: 00010000:00010000:0.0:1787338737.647810:0:7647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5200/0x83671231080c22cc lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.647821:0:7647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5200/0x83671231080c22cc lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338737.647968:0:7647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c200/0x83671231080c2390 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338737.647983:0:7647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c200/0x83671231080c2390 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338737.647993:0:7647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c200/0x83671231080c2390 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338737.648004:0:7647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c200/0x83671231080c2390 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338737.648010:0:7647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c200/0x83671231080c2390 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338737.648016:0:7647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c200/0x83671231080c2390 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338737.648021:0:7647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbfbe9c200 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:1.0:1787338737.648025:0:7647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c200/0x83671231080c2390 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338737.648031:0:7647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c200/0x83671231080c2390 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338737.648041:0:7647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff90bbc2a93500) 00010000:00010000:1.0:1787338737.648044:0:7647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787338737.648047:0:7647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c200/0x83671231080c2390 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338737.648070:0:7647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c200/0x83671231080c2390 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338737.648081:0:7647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5800/0x83671231080c2382 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338737.648087:0:7647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5800/0x83671231080c2382 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338737.648093:0:7647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5800/0x83671231080c2382 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338737.648097:0:7647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbffef5800 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:1.0:1787338737.648100:0:7647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5800/0x83671231080c2382 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338737.648105:0:7647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5800/0x83671231080c2382 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338737.648113:0:7647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff90bbc2a93500) 00010000:00010000:1.0:1787338737.648116:0:7647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787338737.648119:0:7647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5800/0x83671231080c2382 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338737.648124:0:7647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5800/0x83671231080c2382 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338737.648339:0:7647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc2d30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+23:11611:x1874160192159360:12345-192.168.201.53@tcp:57:lhsmtool_posix.0 Request processed in 33872us (34623us total) trans 4294967512 rc 0/0 00000100:00100000:1.0:1787338737.648349:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 230 00000020:00080000:1.0:1787338737.648362:0:7647:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1787338737.648564:0:11692:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787338737.648569:0:11692:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787338737.648612:0:11692:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1787338737.648623:0:11692:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787338737.648735:0:11692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc2d30e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11692:1874160212064640:192.168.201.53@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787338737.648784:0:11692:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbf41c19c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787338737.658021:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338737.658157:0:11692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc2d30e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11692:1874160212064640:192.168.201.53@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787338737.665446:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192160000 00000100:00100000:2.0:1787338737.665463:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192160000 00000100:00100000:2.0:1787338737.665534:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 232 00000100:00100000:2.0:1787338737.665545:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf7ed5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+23:11612:x1874160192160000:12345-192.168.201.53@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787338737.665577:0:5839:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787338737.665695:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf7ed5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+23:11612:x1874160192160000:12345-192.168.201.53@tcp:53:lhsmtool_posix.0 Request processed in 150us (7683us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338737.665719:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 232 00000100:00100000:0.0:1787338737.671190:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338737.671279:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192160256 00000100:00100000:1.0:1787338737.671288:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192160256 00000100:00100000:1.0:1787338737.671344:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 62 00000100:00100000:1.0:1787338737.671355:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbd894fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:83642291-0761-4205-9531-7fd25bc2d48e+23:11611:x1874160192160256:12345-192.168.201.53@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1787338737.672055:0:5842:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1787338737.672157:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:1.0:1787338737.672200:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c200/0x83671231080c2397 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338737.672216:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c200/0x83671231080c2397 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338737.672238:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c200/0x83671231080c2397 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338737.672246:0:5842:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c200/0x83671231080c2397 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338737.672252:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c200/0x83671231080c2397 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338737.672258:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c200/0x83671231080c2397 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338737.672279:0:5842:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787338737.673732:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbd894fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:83642291-0761-4205-9531-7fd25bc2d48e+25:11611:x1874160192160256:12345-192.168.201.53@tcp:35:lhsmtool_posix.0 Request processed in 2368us (2541us total) trans 4294967514 rc 0/0 00000100:00100000:1.0:1787338737.673745:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 62 00000020:00080000:1.0:1787338737.673769:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787338737.673979:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787338737.673988:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c200/0x83671231080c2397 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.673998:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbfbe9c200 already unused, calling callback (ffffffffc1546230) 00010000:00010000:0.0:1787338737.674002:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c200/0x83671231080c2397 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.674012:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c200/0x83671231080c2397 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.674029:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff90bbc2a93200) 00010000:00010000:0.0:1787338737.674032:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787338737.674046:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c200/0x83671231080c2397 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.674052:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c200/0x83671231080c2397 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338737.674076:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787338737.674078:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787338737.674079:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787338737.686292:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338737.686335:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338737.686417:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192160512 00000100:00100000:3.0:1787338737.686429:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192160512 00000100:00100000:3.0:1787338737.686494:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192160640 00000100:00100000:3.0:1787338737.686498:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192160640 00000100:00100000:3.0:1787338737.686534:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 233 00000100:00100000:3.0:1787338737.686545:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+26:11612:x1874160192160512:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787338737.686567:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787338737.686591:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5000/0x83671231080c239e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadaba2c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338737.686699:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5c00/0x83671231080c23a5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338737.686715:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5c00/0x83671231080c23a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338737.686726:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5c00/0x83671231080c23a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787338737.686737:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1787338737.686930:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5000/0x83671231080c239e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadaba2c expref: 29 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338737.686948:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5c00/0x83671231080c23a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadaba2c expref: 28 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338737.686979:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff90bbc2a93500) 00010000:00010000:3.0:1787338737.686982:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787338737.686986:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf7ea5c00, rc 0) 00000100:00100000:3.0:1787338737.687046:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+28:11612:x1874160192160512:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 Request processed in 502us (764us total) trans 4294967515 rc 0/0 00000100:00100000:3.0:1787338737.687053:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 233 00000100:00100000:3.0:1787338737.687072:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 234 00000100:00100000:3.0:1787338737.687080:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+27:11614:x1874160192160640:12345-192.168.201.53@tcp:101:lfs.0 00010000:00010000:3.0:1787338737.687089:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787338737.687098:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c23b3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadaba33 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338737.687132:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c23ba lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338737.687141:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c23ba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338737.687147:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c23ba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338737.687162:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4c00/0x83671231080c23c1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338737.687169:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4c00/0x83671231080c23c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338737.687175:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4c00/0x83671231080c23c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338737.687495:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4200/0x83671231080c23c8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338737.687506:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52000/0x83671231080c22be lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab9ed expref: 28 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338737.687515:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4200/0x83671231080c23c8 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338737.687547:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52000/0x83671231080c22be lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab9ed expref: 28 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338737.687560:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52000/0x83671231080c22be lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab9ed expref: 28 pid: 7647 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338737.687574:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf7ed7800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5841:1874160212064768:192.168.201.53@tcp:104: 00000100:00100000:3.0:1787338737.687628:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbf41c1540 going to sleep for 11 seconds 00000100:00100000:1.0:1787338737.692071:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf7ed7800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5841:1874160212064768:192.168.201.53@tcp:104: 00010000:00010000:1.0:1787338737.692103:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4200/0x83671231080c23c8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338737.698140:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338737.698245:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338737.698334:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192160896 00000100:00100000:1.0:1787338737.698345:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192160896 00000100:00100000:1.0:1787338737.698411:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 235 00000100:00100000:1.0:1787338737.698424:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf7eafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+29:11612:x1874160192160896:12345-192.168.201.53@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787338737.698516:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9dc00/0x83671231080c23cf lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338737.698536:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9dc00/0x83671231080c23cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338737.698548:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9dc00/0x83671231080c23cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338737.698739:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9dc00/0x83671231080c23cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338737.698748:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9dc00/0x83671231080c23cf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338737.698755:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9dc00/0x83671231080c23cf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338737.698761:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbfbe9dc00 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:1.0:1787338737.698766:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9dc00/0x83671231080c23cf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338737.698800:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9dc00/0x83671231080c23cf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338737.698812:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff90bbc2a93500) 00010000:00010000:1.0:1787338737.698816:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787338737.698821:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9dc00/0x83671231080c23cf lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338737.698826:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9dc00/0x83671231080c23cf lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338737.699021:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf7eafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83642291-0761-4205-9531-7fd25bc2d48e+30:11612:x1874160192160896:12345-192.168.201.53@tcp:57:lhsmtool_posix.0 Request processed in 598us (892us total) trans 4294967516 rc 0/0 00000100:00100000:1.0:1787338737.699030:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 235 00000040:00080000:1.0:1787338737.699143:0:11692:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787338737.699147:0:11692:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787338737.699612:0:11692:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1787338737.699622:0:11692:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787338737.699738:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192161152 00000100:00100000:3.0:1787338737.699746:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192161152 00000100:00100000:3.0:1787338737.699788:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 63 00000100:00100000:3.0:1787338737.699797:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:83642291-0761-4205-9531-7fd25bc2d48e+30:5596:x1874160192161152:12345-192.168.201.53@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787338737.699979:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:83642291-0761-4205-9531-7fd25bc2d48e+31:5596:x1874160192161152:12345-192.168.201.53@tcp:35:ldlm_bl.0 Request processed in 183us (1733us total) trans 4294967517 rc 0/0 00000100:00100000:3.0:1787338737.699985:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 63 00000100:00100000:3.0:1787338737.702926:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338737.703019:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192161280 00000100:00100000:1.0:1787338737.703028:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192161280 00010000:00010000:1.0:1787338737.703064:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52000/0x83671231080c22be lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab9ed expref: 31 pid: 7647 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338737.703103:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 88 00000100:00100000:1.0:1787338737.703113:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf7ed5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:83642291-0761-4205-9531-7fd25bc2d48e+31:2356:x1874160192161280:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787338737.703127:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787338737.703133:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52000/0x83671231080c22be lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab9ed expref: 31 pid: 7647 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338737.703164:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52000/0x83671231080c22be lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab9ed expref: 31 pid: 7647 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338737.703184:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c52000/0x83671231080c22be lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab9ed expref: 31 pid: 7647 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338737.703200:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff90bbc2a93500) 00010000:00010000:1.0:1787338737.703205:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4200/0x83671231080c23c8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338737.703213:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4200/0x83671231080c23c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338737.703220:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4200/0x83671231080c23c8 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338737.703266:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787338737.703312:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf7ed5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:83642291-0761-4205-9531-7fd25bc2d48e+30:2356:x1874160192161280:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 200us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338737.703320:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 88 00010000:00010000:2.0:1787338737.703513:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4200/0x83671231080c23c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338737.703521:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4200/0x83671231080c23c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787338737.703561:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1787338737.703566:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787338737.703584:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4200/0x83671231080c23c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338737.703595:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4200/0x83671231080c23c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338737.703604:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c23ba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338737.703610:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c23ba lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338737.703615:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c23ba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338737.703620:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea5800 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:2.0:1787338737.703624:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c23ba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338737.703630:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c23ba lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338737.703639:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff90bbeb14d600) 00010000:00010000:2.0:1787338737.703650:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787338737.703654:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c23ba lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338737.703659:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c23ba lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338737.703671:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4c00/0x83671231080c23c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338737.703677:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4c00/0x83671231080c23c1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338737.703682:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4c00/0x83671231080c23c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338737.703687:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea4c00 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:2.0:1787338737.703689:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4c00/0x83671231080c23c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338737.703694:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4c00/0x83671231080c23c1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338737.703701:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff90bbd38d6100) 00010000:00010000:2.0:1787338737.703704:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787338737.703706:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4c00/0x83671231080c23c1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338737.703711:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4c00/0x83671231080c23c1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338737.703742:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c23b3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadaba33 expref: 30 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338737.703768:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4200/0x83671231080c23c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadaba33 expref: 29 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338737.703776:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff90bbc2a93500) 00010000:00010000:2.0:1787338737.703779:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787338737.703781:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf7ea4200, rc 0) 00000100:00100000:2.0:1787338737.703825:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+29:11614:x1874160192160640:12345-192.168.201.53@tcp:101:lfs.0 Request processed in 16746us (17490us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338737.703832:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 234 00000100:00100000:3.0:1787338737.706811:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338737.707111:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192161536 00000100:00100000:0.0:1787338737.707121:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192161536 00000100:00100000:0.0:1787338737.707177:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 64 00000100:00100000:0.0:1787338737.707187:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf7ed4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:83642291-0761-4205-9531-7fd25bc2d48e+29:11612:x1874160192161536:12345-192.168.201.53@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787338737.707442:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf7ed4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:83642291-0761-4205-9531-7fd25bc2d48e+30:11612:x1874160192161536:12345-192.168.201.53@tcp:35:lhsmtool_posix.0 Request processed in 255us (651us total) trans 4294967518 rc 0/0 00000100:00100000:0.0:1787338737.707451:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 64 00000040:00080000:3.0:1787338738.405774:0:12580:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787338738.405792:0:12580:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787338738.405839:0:12580:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1787338738.405846:0:12580:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787338738.421994:0:11676:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787338738.625413:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338738.625503:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192161792 00000100:00100000:2.0:1787338738.625516:0:7647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192161792 00000100:00100000:2.0:1787338738.625578:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 236 00000100:00100000:2.0:1787338738.625591:0:7647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbef17a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+30:11637:x1874160192161792:12345-192.168.201.53@tcp:101:lfs.0 00010000:00010000:2.0:1787338738.625617:0:7647:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787338738.625638:0:7647:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c53400/0x83671231080c23d6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadaba3a expref: -99 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338738.625756:0:7647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c53800/0x83671231080c23dd lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338738.625772:0:7647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c53800/0x83671231080c23dd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338738.625794:0:7647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c53800/0x83671231080c23dd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7647 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787338738.625807:0:7647:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1787338738.625981:0:7647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c53400/0x83671231080c23d6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadaba3a expref: 33 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338738.626000:0:7647:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c53800/0x83671231080c23dd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadaba3a expref: 32 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338738.626009:0:7647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff90bbc2a93500) 00010000:00010000:2.0:1787338738.626012:0:7647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787338738.626016:0:7647:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf3c53800, rc 0) 00000100:00100000:2.0:1787338738.626070:0:7647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbef17a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83642291-0761-4205-9531-7fd25bc2d48e+32:11637:x1874160192161792:12345-192.168.201.53@tcp:101:lfs.0 Request processed in 481us (667us total) trans 4294967519 rc 0/0 00000100:00100000:2.0:1787338738.626078:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 236 00000100:00100000:3.0:1787338738.629950:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338738.630596:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192161920 00000100:00100000:0.0:1787338738.630609:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192161920 00000100:00100000:0.0:1787338738.630688:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 237 00000100:00100000:0.0:1787338738.630699:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf7ed7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+32:11637:x1874160192161920:12345-192.168.201.53@tcp:54:lfs.0 00010000:00010000:0.0:1787338738.630774:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4e00/0x83671231080c23eb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338738.630808:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4e00/0x83671231080c23eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338738.630820:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4e00/0x83671231080c23eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338738.630850:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4e00/0x83671231080c23eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338738.630857:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4e00/0x83671231080c23eb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338738.630864:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4e00/0x83671231080c23eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338738.630869:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbffef4e00 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:0.0:1787338738.630895:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4e00/0x83671231080c23eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338738.630903:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4e00/0x83671231080c23eb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338738.630915:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff90bbc2a93500) 00010000:00010000:0.0:1787338738.630919:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787338738.630924:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4e00/0x83671231080c23eb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338738.630931:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4e00/0x83671231080c23eb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338738.631001:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf7ed7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+32:11637:x1874160192161920:12345-192.168.201.53@tcp:54:lfs.0 Request processed in 304us (1060us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338738.631014:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 237 00000100:00100000:3.0:1787338738.731199:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338738.731355:0:10743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192162048 00000100:00100000:2.0:1787338738.731366:0:10743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192162048 00000100:00100000:2.0:1787338738.731481:0:10743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 71 00000100:00100000:2.0:1787338738.731490:0:10743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf7ed6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:83642291-0761-4205-9531-7fd25bc2d48e+7:2359:x1874160192162048:12345-192.168.201.53@tcp:101:cat.0 00010000:00010000:2.0:1787338738.731506:0:10743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787338738.731523:0:10743:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e70fae7/0x83671231080c23f2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadaba41 expref: -99 pid: 10743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787338738.731549:0:10743:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a889ff0, atime: 0x6a889fef, ctime: 0x6a889ff0, blocks: 0xb 00010000:00010000:2.0:1787338738.731580:0:10743:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=391s v=(0 0) 00010000:00010000:2.0:1787338738.731585:0:10743:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787338738.731595:0:10743:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e70fae7/0x83671231080c23f2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadaba41 expref: 8 pid: 10743 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338738.731613:0:10743:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007e70fae7/0x83671231080c23f2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadaba41 expref: 8 pid: 10743 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338738.731642:0:10743:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf3c52400, rc 0) 00000100:00100000:2.0:1787338738.731691:0:10743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf7ed6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:83642291-0761-4205-9531-7fd25bc2d48e+8:2359:x1874160192162048:12345-192.168.201.53@tcp:101:cat.0 Request processed in 202us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338738.731696:0:10743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 71 00000100:00100000:3.0:1787338738.735849:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338738.735896:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192162176 00000100:00100000:0.0:1787338738.735908:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192162176 00002000:00100000:0.0:1787338738.735966:0:6694:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff90bbf7ed7800 x1874160192162176/t0(0) o3->83642291-0761-4205-9531-7fd25bc2d48e@192.168.201.53@tcp:69/0 lens 488/0 e 0 to 0 dl 1787338749 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787338738.735979:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90bbf7ed7800 with x1874160192162176 ext(0->4095) 00002000:00010000:0.0:1787338738.735985:0:6694:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90bbf7ed7800 00000100:00100000:0.0:1787338738.736015:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 7 00000100:00100000:0.0:1787338738.736026:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf7ed7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:83642291-0761-4205-9531-7fd25bc2d48e+8:2358:x1874160192162176:12345-192.168.201.53@tcp:3:cat.0 00000100:00100000:0.0:1787338738.736353:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf7ed7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:83642291-0761-4205-9531-7fd25bc2d48e+8:2358:x1874160192162176:12345-192.168.201.53@tcp:3:cat.0 Request processed in 327us (513us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787338738.736362:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 7 00002000:00100000:0.0:1787338738.736369:0:6694:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff90bbf7ed7800 x1874160192162176/t0(0) o3->83642291-0761-4205-9531-7fd25bc2d48e@192.168.201.53@tcp:69/0 lens 488/4536 e 0 to 0 dl 1787338749 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787338738.736377:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90bbf7ed7800 with x1874160192162176 ext(0->4095) 00002000:00010000:0.0:1787338738.736380:0:6694:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90bbf7ed7800 00010000:00010000:1.0:1787338739.447573:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787338739.768051:0:11692:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787338739.768060:0:11692:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787338739.768094:0:11692:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1787338739.768102:0:11692:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787338739.830340:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbef179500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874160212064896:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787338739.830411:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338739.830524:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212064896 00000100:00100000:0.0:1787338739.830532:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212064896 00000100:00100000:0.0:1787338739.830592:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787338739.830602:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc7c6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3317:x1874160212064896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787338739.830636:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787338739.830682:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc7c6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3317:x1874160212064896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338739.830689:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787338739.830752:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbef179500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874160212064896:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787338739.830806:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787338740.342221:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbef179500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d79243c8-b367-45ff-8d76-fbaa4be8becb:3314:1874160212065024:0@lo:400:kworker.0 00000100:00100000:0.0:1787338740.342245:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc122d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874160212065280:0@lo:400:kworker.0 00000100:00100000:2.0:1787338740.342363:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee083480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874160212065152:0@lo:400:kworker.0 00000100:00100000:1.0:1787338740.342934:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc120700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874160212065408:0@lo:400:kworker.0 00000100:00100000:3.0:1787338740.344300:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338740.344325:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338740.344356:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338740.344394:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbd17ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1874160212065536:0@lo:400:kworker.0 00000100:00100000:0.0:1787338740.344410:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212065152 00000100:00100000:0.0:1787338740.344418:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212065152 00000100:00100000:3.0:1787338740.344428:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338740.344460:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212065024 00000100:00100000:3.0:1787338740.344464:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212065024 00000100:00100000:3.0:1787338740.344505:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:3.0:1787338740.344516:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4012c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+19:3314:x1874160212065024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787338740.344516:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212065280 00000100:00100000:0.0:1787338740.344519:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212065280 00000100:00100000:0.0:1787338740.344544:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212065536 00000100:00100000:0.0:1787338740.344546:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212065536 00000100:00100000:0.0:1787338740.344558:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1787338740.344564:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc7c6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874160212065152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787338740.344569:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4012c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+19:3314:x1874160212065024:12345-0@lo:400:kworker.0 Request processed in 56us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338740.344577:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:0.0:1787338740.344608:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc7c6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874160212065152:12345-0@lo:400:kworker.0 Request processed in 44us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338740.344615:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1787338740.344630:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1787338740.344636:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc90c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874160212065280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787338740.344667:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc90c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874160212065280:12345-0@lo:400:kworker.0 Request processed in 32us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338740.344673:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1787338740.344684:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1787338740.344690:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbef19ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874160212065536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787338740.344823:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee083480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874160212065152:0@lo:400:kworker.0 00000100:00100000:2.0:1787338740.344832:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbd17efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874160212065664:0@lo:400:kworker.0 00000100:00100000:1.0:1787338740.347923:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338740.348027:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212065408 00000100:00100000:1.0:1787338740.348036:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212065408 00000100:00100000:2.0:1787338740.348060:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338740.348080:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212065664 00000100:00100000:1.0:1787338740.348083:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212065664 00000100:00080000:2.0:1787338740.348109:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787338740.348109:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00080000:2.0:1787338740.348114:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787338740.348120:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf4705180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3317:x1874160212065408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787338740.348126:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787338740.348132:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc7c6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3315:x1874160212065664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787338740.348173:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc7c6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3315:x1874160212065664:12345-0@lo:400:kworker.0 Request processed in 40us (111us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338740.348173:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf4705180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3317:x1874160212065408:12345-0@lo:400:kworker.0 Request processed in 54us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338740.348233:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787338740.348237:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787338740.349115:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbef179500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d79243c8-b367-45ff-8d76-fbaa4be8becb:3314:1874160212065024:0@lo:400:kworker.0 00000100:00100000:3.0:1787338740.350084:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc122d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874160212065280:0@lo:400:kworker.0 00000100:00100000:0.0:1787338740.354654:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbef19ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874160212065536:12345-0@lo:400:kworker.0 Request processed in 9953us (10213us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338740.354670:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1787338740.354711:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc120700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874160212065408:0@lo:400:kworker.0 00000100:00100000:3.0:1787338740.354820:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbd17ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1874160212065536:0@lo:400:kworker.0 00000100:00100000:2.0:1787338740.355200:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbd17efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874160212065664:0@lo:400:kworker.0 00010000:00010000:0.0:1787338740.469998:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787338740.557561:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338740.557608:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338740.557643:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338740.557674:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338740.557734:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338740.557766:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192162816 00000100:00100000:3.0:1787338740.557776:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192162816 00000100:00100000:3.0:1787338740.557842:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192162432 00000100:00100000:3.0:1787338740.557845:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192162432 00000100:00100000:3.0:1787338740.557869:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 166 00000100:00100000:3.0:1787338740.557915:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbd17efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e810cb1b-6993-4b6e-89c4-e8961cf35b35+5:2359:x1874160192162816:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:0.0:1787338740.557919:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 167 00000100:00100000:0.0:1787338740.557944:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbd17ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+32:2359:x1874160192162432:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:3.0:1787338740.557993:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbd17efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e810cb1b-6993-4b6e-89c4-e8961cf35b35+5:2359:x1874160192162816:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 80us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338740.557996:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbd17ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+32:2359:x1874160192162432:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 56us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338740.558005:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 166 00000100:00100000:2.0:1787338740.558009:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192162560 00000100:00100000:0.0:1787338740.558022:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 167 00000100:00100000:2.0:1787338740.558025:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192162560 00000100:00100000:3.0:1787338740.558035:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192162688 00000100:00100000:3.0:1787338740.558040:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192162688 00000100:00100000:2.0:1787338740.558065:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 80 00000100:00100000:3.0:1787338740.558087:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 81 00000100:00100000:2.0:1787338740.558094:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbef19fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:83642291-0761-4205-9531-7fd25bc2d48e+8:2359:x1874160192162560:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:3.0:1787338740.558099:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc120700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:83642291-0761-4205-9531-7fd25bc2d48e+5:2359:x1874160192162688:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:2.0:1787338740.558132:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbef19fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:83642291-0761-4205-9531-7fd25bc2d48e+8:2359:x1874160192162560:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 51us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338740.558139:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc120700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:83642291-0761-4205-9531-7fd25bc2d48e+5:2359:x1874160192162688:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 42us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338740.558145:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 80 00000100:00100000:3.0:1787338740.558153:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 81 00000100:00080000:0.0:1787338740.558171:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787338740.558188:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787338740.558191:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787338740.558401:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192162304 00000100:00100000:1.0:1787338740.558406:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192162304 00000100:00100000:1.0:1787338740.558448:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 301 00000100:00100000:1.0:1787338740.558455:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4012450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+13:2359:x1874160192162304:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:1.0:1787338740.558498:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4012450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+13:2359:x1874160192162304:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 44us (949us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338740.558505:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 301 00000100:00100000:2.0:1787338740.854060:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787338740.858259:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf4707800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874160212065792:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787338740.858347:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338740.860749:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212065792 00000100:00100000:1.0:1787338740.860767:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212065792 00000100:00100000:1.0:1787338740.860858:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787338740.860869:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc7c6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3317:x1874160212065792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787338740.860926:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787338740.861004:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc7c6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3317:x1874160212065792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 136us (2656us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338740.861011:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787338740.864034:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf4707800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874160212065792:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787338741.497097:0:11676:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787338742.449773:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00010000:00010000:2.0:1787338742.518633:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787338742.983004:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967518 is committed 00000001:00080000:2.0:1787338742.983048:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:2.0:1787338742.983059:0:5861:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90bac1d33d80 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:2.0:1787338742.983064:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90bbf3d61c00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90bac1d33540 00000020:00080000:2.0:1787338742.983068:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90bbf3d61800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90bbff901000 00000020:00080000:2.0:1787338742.983107:0:5861:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:0.0:1787338742.983188:0:5872:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:0.0:1787338742.983404:0:5872:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000001:00080000:1.0:1787338742.988267:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:1.0:1787338742.988297:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000100:00100000:3.0:1787338743.390404:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338743.390522:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192162944 00000100:00100000:1.0:1787338743.390531:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192162944 00000100:00100000:1.0:1787338743.390642:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 238 00000100:00100000:1.0:1787338743.390653:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc122d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+19:11290:x1874160192162944:12345-192.168.201.53@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1787338743.390765:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc122d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83642291-0761-4205-9531-7fd25bc2d48e+19:11290:x1874160192162944:12345-192.168.201.53@tcp:60:lhsmtool_posix.0 Request processed in 115us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338743.390773:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 238 00000100:00080000:0.0:1787338743.398806:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787338743.400139:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338743.400267:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192163200 00000100:00100000:3.0:1787338743.400280:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192163200 00000100:00100000:3.0:1787338743.400391:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 65 00000100:00100000:3.0:1787338743.400403:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc90c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:83642291-0761-4205-9531-7fd25bc2d48e+19:11290:x1874160192163200:12345-192.168.201.53@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787338743.400969:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc90c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:83642291-0761-4205-9531-7fd25bc2d48e+20:11290:x1874160192163200:12345-192.168.201.53@tcp:35:lhsmtool_posix.0 Request processed in 567us (844us total) trans 4294967520 rc 0/0 00000100:00100000:3.0:1787338743.400978:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 65 00010000:00010000:0.0:1787338743.542116:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787338743.542670:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338743.542830:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192163328 00000100:00100000:0.0:1787338743.542838:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192163328 00000100:00100000:0.0:1787338743.542954:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 239 00000100:00100000:0.0:1787338743.542963:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc7c6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e810cb1b-6993-4b6e-89c4-e8961cf35b35+5:12088:x1874160192163328:12345-192.168.201.53@tcp:101:lsof.0 00010000:00010000:0.0:1787338743.542979:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787338743.542996:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4600/0x83671231080c23f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadaba48 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338743.543045:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4400/0x83671231080c2400 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338743.543055:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4400/0x83671231080c2400 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338743.543062:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4400/0x83671231080c2400 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787338743.543264:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:0.0:1787338743.543284:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787338743.543288:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1787338743.543393:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4400/0x83671231080c2400 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338743.543419:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4600/0x83671231080c23f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadaba48 expref: 7 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338743.543436:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4400/0x83671231080c2400 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadaba48 expref: 6 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338743.543445:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90bbeb14d900) 00010000:00010000:0.0:1787338743.543448:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787338743.543451:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbffef4400, rc 0) 00000100:00100000:0.0:1787338743.543518:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc7c6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e810cb1b-6993-4b6e-89c4-e8961cf35b35+6:12088:x1874160192163328:12345-192.168.201.53@tcp:101:lsof.0 Request processed in 554us (851us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338743.543526:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 239 00010000:00010000:0.0:1787338744.566019:0:11676:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787338744.953406:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc90c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874160212065920:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787338744.953475:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338744.954144:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212065920 00000100:00100000:0.0:1787338744.954153:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212065920 00000100:00100000:0.0:1787338744.954236:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787338744.954247:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc7c6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874160212065920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787338744.954282:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787338744.954334:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc7c6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874160212065920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (858us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338744.954341:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787338744.954386:0:3317:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:0.0:1787338744.954404:0:3317:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90bbf4704380, transno 4294967322 00000004:00080000:0.0:1787338744.954416:0:3317:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:0.0:1787338744.954445:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc90c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874160212065920:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787338744.954946:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787338745.466763:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf4707100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874160212066176:0@lo:400:kworker.0 00000100:00100000:2.0:1787338745.466835:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338745.466918:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf4706a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874160212066432:0@lo:400:kworker.0 00000100:00100000:2.0:1787338745.466920:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf4704e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874160212066688:0@lo:400:kworker.0 00000100:00100000:2.0:1787338745.466945:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338745.466955:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212066176 00000100:00100000:1.0:1787338745.466962:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212066176 00000100:00100000:2.0:1787338745.466971:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787338745.466991:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf4706680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d79243c8-b367-45ff-8d76-fbaa4be8becb:3315:1874160212066048:0@lo:400:kworker.0 00000100:00100000:1.0:1787338745.467003:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1787338745.467011:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc7c6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874160212066176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787338745.467018:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338745.467035:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf4705500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1874160212066560:0@lo:400:kworker.0 00000100:00100000:2.0:1787338745.467053:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338745.467054:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc7c6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874160212066176:12345-0@lo:400:kworker.0 Request processed in 43us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338745.467061:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1787338745.467076:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212066560 00000100:00100000:1.0:1787338745.467078:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212066560 00000100:00100000:2.0:1787338745.467081:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf4707100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874160212066176:0@lo:400:kworker.0 00000100:00100000:2.0:1787338745.467118:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212066688 00000100:00100000:1.0:1787338745.467119:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1787338745.467121:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212066688 00000100:00100000:1.0:1787338745.467125:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc7c6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874160212066560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787338745.467147:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787338745.467154:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc7c6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1874160212066688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787338745.467157:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc7c6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874160212066560:12345-0@lo:400:kworker.0 Request processed in 33us (104us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338745.467162:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00080000:1.0:1787338745.467178:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787338745.467181:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc7c6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1874160212066688:12345-0@lo:400:kworker.0 Request processed in 28us (235us total) trans 0 rc 0/0 00000100:00080000:1.0:1787338745.467183:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787338745.467187:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787338745.467194:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338745.467262:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212066048 00000100:00100000:3.0:1787338745.467271:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212066048 00000100:00100000:3.0:1787338745.467300:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:3.0:1787338745.467306:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4010850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+19:3315:x1874160212066048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787338745.467340:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4010850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d79243c8-b367-45ff-8d76-fbaa4be8becb+19:3315:x1874160212066048:12345-0@lo:400:kworker.0 Request processed in 35us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338745.467346:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1787338745.467394:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787338745.467407:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf4706300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1874160212066304:0@lo:400:kworker.0 00000100:00100000:1.0:1787338745.467430:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338745.467461:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf4706680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d79243c8-b367-45ff-8d76-fbaa4be8becb:3315:1874160212066048:0@lo:400:kworker.0 00000100:00100000:1.0:1787338745.467471:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf4705500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1874160212066560:0@lo:400:kworker.0 00000100:00100000:1.0:1787338745.467479:0:3315:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1787338745.467483:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90bbfc280700, transno 4294967310 00000100:00100000:1.0:1787338745.467493:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf4704e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874160212066688:0@lo:400:kworker.0 00000100:00100000:1.0:1787338745.467796:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212066304 00000100:00100000:1.0:1787338745.467801:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212066304 00000100:00100000:1.0:1787338745.467836:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1787338745.467843:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf4705c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874160212066304:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787338745.467895:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787338745.467897:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf4705c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874160212066304:12345-0@lo:400:kworker.0 Request processed in 54us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338745.467902:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1787338745.467929:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf4706300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1874160212066304:0@lo:400:kworker.0 00000100:00100000:2.0:1787338745.473794:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212066432 00000100:00100000:2.0:1787338745.473812:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212066432 00000100:00100000:2.0:1787338745.474778:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787338745.474794:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf4704000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1874160212066432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787338745.474909:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf4704000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1874160212066432:12345-0@lo:400:kworker.0 Request processed in 122us (7713us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338745.474916:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787338745.474975:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf4706a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874160212066432:0@lo:400:kworker.0 00010000:00010000:2.0:1787338745.590219:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787338745.685580:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338745.685691:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192163456 00000100:00100000:3.0:1787338745.685701:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192163456 00000100:00100000:3.0:1787338745.685759:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 303 00000100:00100000:3.0:1787338745.685770:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4010050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+13:2358:x1874160192163456:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:3.0:1787338745.685860:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4010050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+13:2358:x1874160192163456:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 91us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338745.685869:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 303 00000100:00100000:3.0:1787338745.687182:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338745.687328:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192163584 00000100:00100000:0.0:1787338745.687337:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192163584 00000100:00100000:0.0:1787338745.687401:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 171 00000100:00100000:0.0:1787338745.687410:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbef179500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+20:2358:x1874160192163584:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:0.0:1787338745.687490:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbef179500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+20:2358:x1874160192163584:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 71us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338745.687497:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 171 00000100:00080000:1.0:1787338745.688024:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787338745.698434:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338745.698491:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338745.698531:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338745.698626:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192163840 00000100:00100000:0.0:1787338745.698639:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192163840 00000100:00100000:0.0:1787338745.698712:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192163712 00000100:00100000:0.0:1787338745.698716:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192163712 00000100:00100000:0.0:1787338745.698743:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 84 00000100:00100000:0.0:1787338745.698753:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbed9caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:83642291-0761-4205-9531-7fd25bc2d48e+5:2359:x1874160192163840:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:0.0:1787338745.698825:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbed9caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:83642291-0761-4205-9531-7fd25bc2d48e+5:2359:x1874160192163840:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 74us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338745.698833:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 84 00000100:00100000:0.0:1787338745.698869:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 85 00000100:00100000:0.0:1787338745.698905:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbed9ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:83642291-0761-4205-9531-7fd25bc2d48e+7:2359:x1874160192163712:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:0.0:1787338745.698932:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbed9ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:83642291-0761-4205-9531-7fd25bc2d48e+7:2359:x1874160192163712:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 30us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338745.698955:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 85 00000100:00080000:3.0:1787338745.699327:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787338745.699333:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787338745.703193:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192163968 00000100:00100000:1.0:1787338745.703209:0:7647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192163968 00000100:00100000:1.0:1787338745.703301:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 172 00000100:00100000:1.0:1787338745.703311:0:7647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbd172f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e810cb1b-6993-4b6e-89c4-e8961cf35b35+6:2359:x1874160192163968:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:1.0:1787338745.703391:0:7647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbd172f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e810cb1b-6993-4b6e-89c4-e8961cf35b35+6:2359:x1874160192163968:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 82us (4859us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338745.703399:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 172 00000100:00080000:3.0:1787338745.703925:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787338745.975407:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787338745.975430:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf4704e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874160212066816:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787338745.975502:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338745.975740:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212066816 00000100:00100000:1.0:1787338745.975748:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212066816 00000100:00100000:1.0:1787338745.975799:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787338745.975809:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbd172fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874160212066816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787338745.975862:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787338745.975944:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbd172fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874160212066816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 136us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338745.975951:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787338745.976175:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf4704e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874160212066816:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787338746.615424:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787338747.329916:0:12781:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 14:59:05 (1787338745) 00010000:00010000:0.0:1787338747.639653:0:11676:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1787338748.061748:0:5861:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000001:00080000:3.0:1787338748.061778:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:0.0:1787338748.061980:0:5872:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:0.0:1787338748.061992:0:5872:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:2.0:1787338748.664466:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787338749.686059:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787338750.008215:0:11692:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787338750.008224:0:11692:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787338750.008613:0:11692:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:0.0:1787338750.008619:0:11692:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787338750.070356:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787338750.070586:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc90c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874160212066944:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787338750.070659:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338750.071059:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212066944 00000100:00100000:0.0:1787338750.071069:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212066944 00000100:00100000:0.0:1787338750.071147:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787338750.071160:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf4705500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874160212066944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787338750.071199:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787338750.071313:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf4705500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874160212066944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 155us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338750.071322:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:3.0:1787338750.071333:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787338750.072115:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc90c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874160212066944:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787338750.585274:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc90c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874160212067200:0@lo:400:kworker.0 00000100:00100000:1.0:1787338750.585348:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338750.585414:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc91de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874160212067712:0@lo:400:kworker.0 00000100:00100000:1.0:1787338750.585442:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338750.585468:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf4100700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874160212067456:0@lo:400:kworker.0 00000100:00100000:1.0:1787338750.585478:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787338750.585487:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc90c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d79243c8-b367-45ff-8d76-fbaa4be8becb:3315:1874160212067072:0@lo:400:kworker.0 00000100:00100000:2.0:1787338750.585525:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338750.585545:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338750.585565:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787338750.585576:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf4117800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1874160212067328:0@lo:400:kworker.0 00000100:00100000:1.0:1787338750.585581:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc91dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1874160212067584:0@lo:400:kworker.0 00000100:00100000:2.0:1787338750.585613:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338750.585627:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212067072 00000100:00100000:1.0:1787338750.585636:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212067072 00000100:00100000:2.0:1787338750.585652:0:10743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212067712 00000100:00100000:2.0:1787338750.585658:0:10743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212067712 00000100:00100000:1.0:1787338750.585683:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1787338750.585695:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4010450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+19:3315:x1874160212067072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787338750.585702:0:10743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212067456 00000100:00100000:2.0:1787338750.585706:0:10743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212067456 00000100:00100000:2.0:1787338750.585741:0:10743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787338750.585752:0:10743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf4705f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1874160212067712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787338750.585759:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4010450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d79243c8-b367-45ff-8d76-fbaa4be8becb+19:3315:x1874160212067072:12345-0@lo:400:kworker.0 Request processed in 64us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338750.585767:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1787338750.585799:0:10743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf4705f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1874160212067712:12345-0@lo:400:kworker.0 Request processed in 50us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338750.585806:0:10743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787338750.585822:0:10743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787338750.585829:0:10743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc7c6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1874160212067456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787338750.585839:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338750.585899:0:10743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc7c6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1874160212067456:12345-0@lo:400:kworker.0 Request processed in 43us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338750.585903:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc91de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874160212067712:0@lo:400:kworker.0 00000100:00100000:2.0:1787338750.585911:0:10743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787338750.585933:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc90c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d79243c8-b367-45ff-8d76-fbaa4be8becb:3315:1874160212067072:0@lo:400:kworker.0 00000100:00100000:2.0:1787338750.585953:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf4100700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874160212067456:0@lo:400:kworker.0 00000100:00100000:0.0:1787338750.586597:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212067200 00000100:00100000:0.0:1787338750.586604:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212067200 00000100:00100000:0.0:1787338750.586644:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212067328 00000100:00100000:0.0:1787338750.586648:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212067328 00000100:00100000:0.0:1787338750.586662:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212067584 00000100:00100000:0.0:1787338750.586665:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212067584 00000100:00100000:0.0:1787338750.586679:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1787338750.586686:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf4706680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874160212067200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787338750.586763:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf4706680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874160212067200:12345-0@lo:400:kworker.0 Request processed in 76us (1414us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338750.586769:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1787338750.586784:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1787338750.586792:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc7c6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874160212067328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787338750.586822:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc90c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874160212067200:0@lo:400:kworker.0 00000100:00100000:2.0:1787338750.586896:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1787338750.586905:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf4707b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874160212067584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787338750.586943:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf4707b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874160212067584:12345-0@lo:400:kworker.0 Request processed in 40us (1105us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338750.586950:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1787338750.586998:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc91dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1874160212067584:0@lo:400:kworker.0 00000100:00100000:0.0:1787338750.587086:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc7c6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874160212067328:12345-0@lo:400:kworker.0 Request processed in 294us (1473us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338750.587093:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1787338750.587134:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf4117800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1874160212067328:0@lo:400:kworker.0 00000100:00080000:3.0:1787338750.588245:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787338750.588254:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787338750.710386:0:11676:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787338750.792722:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338750.792779:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338750.792821:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338750.792857:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338750.792918:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338750.792948:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192164224 00000100:00100000:0.0:1787338750.792958:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192164224 00000100:00100000:0.0:1787338750.793019:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192164608 00000100:00100000:0.0:1787338750.793023:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192164608 00000100:00100000:0.0:1787338750.793047:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 176 00000100:00100000:0.0:1787338750.793056:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc91dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+19:2358:x1874160192164224:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:0.0:1787338750.793131:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc91dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+19:2358:x1874160192164224:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 75us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338750.793138:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 176 00000100:00100000:0.0:1787338750.793154:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 177 00000100:00100000:0.0:1787338750.793160:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf3e9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e810cb1b-6993-4b6e-89c4-e8961cf35b35+6:2359:x1874160192164608:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:0.0:1787338750.793180:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf3e9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e810cb1b-6993-4b6e-89c4-e8961cf35b35+6:2359:x1874160192164608:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 21us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338750.793200:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 177 00000100:00100000:1.0:1787338750.793744:0:10743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192164352 00000100:00100000:1.0:1787338750.793750:0:10743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192164352 00000100:00100000:1.0:1787338750.793803:0:10743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192164480 00000100:00100000:1.0:1787338750.793807:0:10743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192164480 00000100:00100000:1.0:1787338750.793831:0:10743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 88 00000100:00100000:1.0:1787338750.793838:0:10743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc91de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:83642291-0761-4205-9531-7fd25bc2d48e+7:2359:x1874160192164352:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:2.0:1787338750.793902:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 89 00000100:00100000:1.0:1787338750.793909:0:10743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc91de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:83642291-0761-4205-9531-7fd25bc2d48e+7:2359:x1874160192164352:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 70us (1086us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338750.793917:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc280700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:83642291-0761-4205-9531-7fd25bc2d48e+5:2358:x1874160192164480:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:1.0:1787338750.793922:0:10743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 88 00000100:00100000:2.0:1787338750.793982:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc280700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:83642291-0761-4205-9531-7fd25bc2d48e+5:2358:x1874160192164480:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 59us (1050us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338750.793990:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 89 00000100:00100000:3.0:1787338750.794989:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192164096 00000100:00100000:3.0:1787338750.795010:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192164096 00000100:00100000:3.0:1787338750.795116:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 305 00000100:00100000:3.0:1787338750.795126:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4013450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+13:2359:x1874160192164096:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:3.0:1787338750.795189:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4013450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+13:2359:x1874160192164096:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 64us (2476us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338750.795196:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 305 00000100:00080000:3.0:1787338750.795247:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787338750.795252:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787338750.795255:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787338751.094432:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf4704e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874160212067840:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787338751.094502:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338751.094699:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212067840 00000100:00100000:0.0:1787338751.094707:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212067840 00000100:00100000:0.0:1787338751.094764:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787338751.094774:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc7c6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874160212067840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787338751.094809:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787338751.095346:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc7c6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874160212067840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 571us (840us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338751.095355:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787338751.096095:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf4704e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874160212067840:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787338751.286556:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338751.286662:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192164864 00000100:00100000:3.0:1787338751.286672:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192164864 00000100:00100000:3.0:1787338751.286727:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 66 00000100:00100000:3.0:1787338751.286737:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc282a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:83642291-0761-4205-9531-7fd25bc2d48e+19:12310:x1874160192164864:12345-192.168.201.53@tcp:35:umount.0 00000100:00100000:3.0:1787338751.287293:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc282a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:83642291-0761-4205-9531-7fd25bc2d48e+20:12310:x1874160192164864:12345-192.168.201.53@tcp:35:umount.0 Request processed in 555us (745us total) trans 4294967521 rc 0/0 00000100:00100000:3.0:1787338751.287301:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 66 00000100:00100000:2.0:1787338751.290587:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338751.294124:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192165120 00000100:00100000:1.0:1787338751.294144:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192165120 00000100:00100000:1.0:1787338751.294244:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 67 00000100:00100000:1.0:1787338751.294256:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc7c6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:83642291-0761-4205-9531-7fd25bc2d48e+20:12310:x1874160192165120:12345-192.168.201.53@tcp:35:umount.0 00000100:00100000:1.0:1787338751.295030:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc7c6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:83642291-0761-4205-9531-7fd25bc2d48e+21:12310:x1874160192165120:12345-192.168.201.53@tcp:35:umount.0 Request processed in 774us (4450us total) trans 4294967522 rc 0/0 00000100:00100000:1.0:1787338751.295040:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 67 00000100:00100000:1.0:1787338751.306264:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338751.306412:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192165376 00000100:00100000:0.0:1787338751.306422:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192165376 00000100:00100000:0.0:1787338751.306477:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 68 00000100:00100000:0.0:1787338751.306484:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbd894d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:83642291-0761-4205-9531-7fd25bc2d48e+21:12310:x1874160192165376:12345-192.168.201.53@tcp:35:umount.0 00000100:00100000:0.0:1787338751.306900:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbd894d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:83642291-0761-4205-9531-7fd25bc2d48e+22:12310:x1874160192165376:12345-192.168.201.53@tcp:35:umount.0 Request processed in 408us (639us total) trans 4294967523 rc 0/0 00000100:00100000:0.0:1787338751.306908:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 68 00000100:00100000:0.0:1787338751.314656:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338751.314755:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192165632 00000100:00100000:1.0:1787338751.314766:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192165632 00000100:00100000:1.0:1787338751.314822:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 69 00000100:00100000:1.0:1787338751.314833:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc282a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:83642291-0761-4205-9531-7fd25bc2d48e+22:12310:x1874160192165632:12345-192.168.201.53@tcp:35:umount.0 00000100:00100000:1.0:1787338751.315237:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc282a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:83642291-0761-4205-9531-7fd25bc2d48e+23:12310:x1874160192165632:12345-192.168.201.53@tcp:35:umount.0 Request processed in 406us (589us total) trans 4294967524 rc 0/0 00000100:00100000:1.0:1787338751.315246:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 69 00000100:00100000:2.0:1787338751.320926:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338751.320960:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338751.321211:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192165760 00000100:00100000:1.0:1787338751.321234:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192165760 00000100:00100000:1.0:1787338751.321298:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192165888 00000100:00100000:1.0:1787338751.321302:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192165888 00000100:00100000:1.0:1787338751.321329:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 17 00000100:00100000:1.0:1787338751.321339:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc7c6c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+14:2356:x1874160192165760:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787338751.321367:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787338751.321387:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90bc02045800/0x83671231080c1416 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab5d3 expref: 14 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338751.321415:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787338751.321498:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 18 00000100:00100000:3.0:1787338751.321508:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc7c6e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+13:2356:x1874160192165888:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787338751.321516:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787338751.321526:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90bbc0031200/0x83671231080c13de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab59b expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338751.321536:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787338751.322527:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc7c6c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+12:2356:x1874160192165760:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 1184us (1607us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338751.322536:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 17 00000100:00100000:3.0:1787338751.322746:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc7c6e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+11:2356:x1874160192165888:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 1239us (1784us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338751.322754:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 18 00000100:00100000:2.0:1787338751.322999:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338751.323758:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192166016 00000100:00100000:1.0:1787338751.323768:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192166016 00000100:00100000:1.0:1787338751.323869:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 19 00000100:00100000:1.0:1787338751.323922:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc7c6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+11:2358:x1874160192166016:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787338751.323937:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787338751.323957:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90bc021c8a00/0x83671231080c1662 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab69e expref: 11 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338751.323977:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787338751.324033:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc7c6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+10:2358:x1874160192166016:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 114us (1043us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338751.324040:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 19 00000100:00100000:0.0:1787338751.324294:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338751.328157:0:10743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192166144 00000100:00100000:1.0:1787338751.328170:0:10743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192166144 00000100:00100000:1.0:1787338751.328241:0:10743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 72 00000100:00100000:1.0:1787338751.328267:0:10743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc281c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:83642291-0761-4205-9531-7fd25bc2d48e+5:2355:x1874160192166144:12345-192.168.201.53@tcp:9:umount.0 00000020:00000080:1.0:1787338751.328301:0:10743:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x83671231080c1750 00000100:00080000:1.0:1787338751.328311:0:10743:0:(import.c:65:import_set_state_nolock()) ffff90bbedf92800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787338751.328610:0:10743:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:1.0:1787338751.328936:0:10743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc281c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:83642291-0761-4205-9531-7fd25bc2d48e+2:2355:x1874160192166144:12345-192.168.201.53@tcp:9:umount.0 Request processed in 668us (4641us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338751.328946:0:10743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 72 00010000:00010000:3.0:1787338751.329496:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787338751.335713:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338751.335809:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192166528 00000100:00100000:1.0:1787338751.335821:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192166528 00000100:00100000:1.0:1787338751.335920:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 73 00000100:00100000:1.0:1787338751.335931:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc7c6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:83642291-0761-4205-9531-7fd25bc2d48e+7:2355:x1874160192166528:12345-192.168.201.53@tcp:9:umount.0 00000020:00000080:1.0:1787338751.335960:0:6690:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x83671231080c19b1 00000020:00010000:1.0:1787338751.335970:0:6690:0:(genops.c:1921:obd_stale_export_put()) Put export ffff90bbfdb73000: total 0 00000100:00080000:1.0:1787338751.335975:0:6690:0:(import.c:65:import_set_state_nolock()) ffff90bbfdb70000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787338751.336023:0:6690:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:1.0:1787338751.336369:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc7c6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:83642291-0761-4205-9531-7fd25bc2d48e+5:2355:x1874160192166528:12345-192.168.201.53@tcp:9:umount.0 Request processed in 438us (664us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338751.336378:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 73 00000020:00010000:2.0:1787338751.336554:0:5827:0:(genops.c:1907:obd_stale_export_get()) Get export ffff90bbfdb73000: total 0 00010000:00010000:2.0:1787338751.336584:0:5827:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff90bbfdb73000, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1787338751.336638:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e70fae7/0x83671231080c23f2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadaba41 expref: 4 pid: 10743 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338751.336673:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000062c75baa/0x83671231080c1d54 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab873 expref: 3 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338751.336689:0:5827:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff90bbfdb73000, canceled 2 locks, left on hash table 0. 00010000:00010000:2.0:1787338751.336714:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787338751.336716:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787338751.336717:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787338751.348634:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338751.348753:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192167552 00000100:00100000:2.0:1787338751.348764:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192167552 00000100:00100000:2.0:1787338751.348823:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 240 00000100:00100000:2.0:1787338751.348833:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc282d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+23:2355:x1874160192167552:12345-192.168.201.53@tcp:39:umount.0 00000020:00000080:2.0:1787338751.348866:0:5839:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x83671231080c13ec 00000020:00010000:2.0:1787338751.349117:0:5839:0:(genops.c:1921:obd_stale_export_put()) Put export ffff90bac1f19000: total 0 00000100:00080000:2.0:1787338751.349123:0:5839:0:(import.c:65:import_set_state_nolock()) ffff90bac1f18800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787338751.349144:0:5839:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00100000:2.0:1787338751.349790:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc282d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83642291-0761-4205-9531-7fd25bc2d48e+22:2355:x1874160192167552:12345-192.168.201.53@tcp:39:umount.0 Request processed in 952us (1157us total) trans 4294967525 rc 0/0 00000100:00100000:2.0:1787338751.349801:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 240 00000020:00010000:0.0:1787338751.350231:0:11676:0:(genops.c:1907:obd_stale_export_get()) Get export ffff90bac1f19000: total 0 00010000:00010000:0.0:1787338751.350273:0:11676:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff90bac1f19000, canceled 0 locks, left on hash table 14. 00010000:00010000:0.0:1787338751.350316:0:11676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff90bbd38d6200) 00010000:00010000:0.0:1787338751.350320:0:11676:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787338751.350328:0:11676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4600/0x83671231080c16b6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab6ac expref: 21 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338751.350387:0:11676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90bbeb14d700) 00010000:00010000:0.0:1787338751.350390:0:11676:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787338751.350515:0:11676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031400/0x83671231080c1d3f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab86c expref: 20 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338751.350536:0:11676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff90bbeb14d600) 00010000:00010000:0.0:1787338751.350539:0:11676:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787338751.350544:0:11676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4c00/0x83671231080c20b1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab968 expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338751.350557:0:11676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff90bbdee56e00) 00010000:00010000:0.0:1787338751.350560:0:11676:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787338751.350564:0:11676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3600/0x83671231080c1a13 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab79a expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338751.350578:0:11676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff90bbeb14d600) 00010000:00010000:0.0:1787338751.350580:0:11676:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787338751.350584:0:11676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031a00/0x83671231080c1dd2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab896 expref: 17 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338751.350599:0:11676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90bbeb14d700) 00010000:00010000:0.0:1787338751.350601:0:11676:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787338751.350605:0:11676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c1c35 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab826 expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338751.350617:0:11676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff90bbdee56e00) 00010000:00010000:0.0:1787338751.350619:0:11676:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787338751.350633:0:11676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3c00/0x83671231080c1726 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab6c8 expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338751.350650:0:11676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff90bbc2a93500) 00010000:00010000:0.0:1787338751.350653:0:11676:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787338751.350657:0:11676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9de00/0x83671231080c22d3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab9f4 expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338751.350669:0:11676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff90bbc2a93500) 00010000:00010000:0.0:1787338751.350671:0:11676:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787338751.350674:0:11676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4200/0x83671231080c23c8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadaba33 expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338751.350686:0:11676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90bbdee56100) 00010000:00010000:0.0:1787338751.350689:0:11676:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787338751.350692:0:11676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2400/0x83671231080c16d2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab6b3 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338751.350707:0:11676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff90bbc2a93500) 00010000:00010000:0.0:1787338751.350709:0:11676:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787338751.350712:0:11676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5c00/0x83671231080c23a5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadaba2c expref: 11 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338751.350725:0:11676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90bbeb14d900) 00010000:00010000:0.0:1787338751.350727:0:11676:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787338751.350731:0:11676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031800/0x83671231080c1db6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab88f expref: 10 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338751.350818:0:11676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff90bbc2a93500) 00010000:00010000:0.0:1787338751.350827:0:11676:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787338751.350832:0:11676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf3c53800/0x83671231080c23dd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadaba3a expref: 9 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338751.350849:0:11676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90bbeb14d700) 00010000:00010000:0.0:1787338751.350852:0:11676:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787338751.350856:0:11676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4a00/0x83671231080c1d15 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab85e expref: 8 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338751.350869:0:11676:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff90bac1f19000, canceled 14 locks, left on hash table 0. 00010000:00010000:1.0:1787338751.351330:0:11676:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338751.351334:0:11676:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338751.351336:0:11676:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338751.734523:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787338752.726198:0:7651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 83642291-0761-4205-9531-7fd25bc2d48e 00000020:00000080:3.0:1787338752.726209:0:7651:0:(genops.c:885:class_export_put()) final put ffff90bbedf90000/83642291-0761-4205-9531-7fd25bc2d48e 00000020:00000080:1.0:1787338752.726336:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90bbedf90000/83642291-0761-4205-9531-7fd25bc2d48e for lustre-OST0001 00000020:00000080:1.0:1787338752.726399:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90bbedf92800 for lustre-OST0001 00010000:00010000:2.0:1787338752.759125:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787338753.230426:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967523 is committed 00000001:00080000:2.0:1787338753.230449:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967524 is committed 00000001:00100000:2.0:1787338753.230457:0:5861:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 83642291-0761-4205-9531-7fd25bc2d48e 00000001:00080000:2.0:1787338753.230463:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:2.0:1787338753.230469:0:5861:0:(genops.c:885:class_export_put()) final put ffff90bac1f19000/83642291-0761-4205-9531-7fd25bc2d48e 00000020:00000080:3.0:1787338753.230811:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90bac1f19000/83642291-0761-4205-9531-7fd25bc2d48e for lustre-MDT0000 00000020:00000080:3.0:1787338753.230904:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90bac1f18800 for lustre-MDT0000 00000001:00100000:1.0:1787338753.234261:0:6714:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 83642291-0761-4205-9531-7fd25bc2d48e 00000020:00000080:1.0:1787338753.234271:0:6714:0:(genops.c:885:class_export_put()) final put ffff90bbfdb73000/83642291-0761-4205-9531-7fd25bc2d48e 00000020:00000080:3.0:1787338753.234414:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90bbfdb73000/83642291-0761-4205-9531-7fd25bc2d48e for lustre-OST0000 00000020:00000080:3.0:1787338753.234463:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90bbfdb70000 for lustre-OST0000 00010000:00010000:1.0:1787338753.782523:0:11676:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787338753.803082:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338753.803131:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338753.803201:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338753.803287:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192167680 00000100:00100000:3.0:1787338753.803298:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192167680 00000100:00100000:3.0:1787338753.803475:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192167808 00000100:00100000:3.0:1787338753.803479:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192167808 00000100:00100000:3.0:1787338753.803497:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192167936 00000100:00100000:3.0:1787338753.803500:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192167936 00000100:00100000:2.0:1787338753.803678:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 20 00000100:00100000:2.0:1787338753.803690:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf4117800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+12:2359:x1874160192167680:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787338753.803714:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787338753.803736:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90bbf40e3400/0x83671231080c14be lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab5e8 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338753.803768:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787338753.803824:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf4117800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+11:2359:x1874160192167680:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 135us (754us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338753.803830:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 21 00000100:00100000:1.0:1787338753.803849:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf4100700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+11:2359:x1874160192167808:12345-192.168.201.53@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787338753.803853:0:6704:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00010000:00010000:1.0:1787338753.803859:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1787338753.803863:0:6704:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00010000:00010000:1.0:1787338753.803909:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90bbc0031c00/0x83671231080c14c5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab612 expref: 11 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338753.803920:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787338753.803941:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf4100700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+10:2359:x1874160192167808:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 96us (810us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338753.812276:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 20 00000100:00100000:2.0:1787338753.812327:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 22 00000100:00100000:2.0:1787338753.812345:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbde53d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+9:2356:x1874160192167936:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787338753.812379:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787338753.812404:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90bbf40e2200/0x83671231080c165b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab697 expref: 9 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338753.812422:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787338753.812491:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbde53d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+8:2356:x1874160192167936:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 155us (9290us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338753.812498:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 22 00000100:00100000:1.0:1787338753.816758:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 21 00000100:00100000:2.0:1787338753.820813:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338753.821089:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192168192 00000100:00100000:1.0:1787338753.821103:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192168192 00000100:00100000:1.0:1787338753.821314:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 241 00000100:00080000:3.0:1787338753.821319:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787338753.821330:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf4100700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e810cb1b-6993-4b6e-89c4-e8961cf35b35+6:2355:x1874160192168192:12345-192.168.201.53@tcp:39:umount.0 00000020:00000080:1.0:1787338753.821390:0:5841:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x83671231080c14d3 00000020:00010000:1.0:1787338753.821399:0:5841:0:(genops.c:1921:obd_stale_export_put()) Put export ffff90bbde3cd000: total 0 00000100:00080000:1.0:1787338753.821404:0:5841:0:(import.c:65:import_set_state_nolock()) ffff90bbde3cc000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787338753.821434:0:5841:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000020:00010000:3.0:1787338753.821768:0:5826:0:(genops.c:1907:obd_stale_export_get()) Get export ffff90bbde3cd000: total 0 00010000:00010000:3.0:1787338753.821772:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338753.821826:0:5826:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff90bbde3cd000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1787338753.821856:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90bbeb14d900) 00010000:00010000:3.0:1787338753.821860:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787338753.821867:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4400/0x83671231080c2400 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadaba48 expref: 6 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338753.821922:0:5826:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff90bbde3cd000, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1787338753.821936:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338753.821938:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338753.821940:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787338753.822171:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf4100700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e810cb1b-6993-4b6e-89c4-e8961cf35b35+3:2355:x1874160192168192:12345-192.168.201.53@tcp:39:umount.0 Request processed in 845us (1365us total) trans 4294967526 rc 0/0 00000100:00100000:1.0:1787338753.822180:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 241 00000100:00100000:2.0:1787338753.854639:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338753.854738:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192168448 00000100:00100000:3.0:1787338753.854766:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192168448 00000100:00100000:3.0:1787338753.854827:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 306 00000100:00100000:3.0:1787338753.854839:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4013050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+7:2355:x1874160192168448:12345-192.168.201.53@tcp:251:umount.0 00000020:00000080:3.0:1787338753.854922:0:5833:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x83671231080c13c9 00000020:00010000:3.0:1787338753.854929:0:5833:0:(genops.c:1921:obd_stale_export_put()) Put export ffff90bbfc173000: total 0 00000100:00080000:3.0:1787338753.854934:0:5833:0:(import.c:65:import_set_state_nolock()) ffff90bbfc171800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1787338753.855010:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4013050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a12c8ed-039c-40f4-9fb4-eae17c6a12e4+3:2355:x1874160192168448:12345-192.168.201.53@tcp:251:umount.0 Request processed in 173us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338753.855018:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 306 00000020:00010000:2.0:1787338753.855181:0:5827:0:(genops.c:1907:obd_stale_export_get()) Get export ffff90bbfc173000: total 0 00010000:00010000:2.0:1787338753.855221:0:5827:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff90bbfc173000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1787338753.855255:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90bbf7ea5600/0x83671231080c141d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadab5da expref: 2 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338753.855268:0:5827:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff90bbfc173000, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1787338753.855277:0:5827:0:(genops.c:885:class_export_put()) final put ffff90bbfc173000/7a12c8ed-039c-40f4-9fb4-eae17c6a12e4 00010000:00010000:2.0:1787338753.855294:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787338753.855297:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787338753.855299:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787338753.855328:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90bbfc173000/7a12c8ed-039c-40f4-9fb4-eae17c6a12e4 for MGS 00000020:00000080:1.0:1787338753.855378:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90bbfc171800 for MGS 00010000:00010000:1.0:1787338754.818187:0:11676:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787338755.190476:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787338755.190513:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbffa4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874160212067968:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787338755.190598:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338755.190626:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212067968 00000100:00100000:3.0:1787338755.190638:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212067968 00000100:00100000:3.0:1787338755.190717:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787338755.190727:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee083480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874160212067968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787338755.190771:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787338755.190817:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee083480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874160212067968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338755.190824:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:0.0:1787338755.191068:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787338755.194198:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbffa4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874160212067968:0@lo:13:osp-pre-0-0.0 00000020:01000004:2.0:1787338755.377582:0:12982:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1787338755.403153:0:12982:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1787338755.403206:0:12982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bc02044a00/0x83671231080c147f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c1486 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338755.403222:0:12982:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bc02044a00/0x83671231080c147f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x83671231080c1486 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338755.403231:0:12982:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bc02044a00/0x83671231080c147f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x83671231080c1486 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338755.403238:0:12982:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.153@tcp lock: ffff90bc02044a00/0x83671231080c147f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x83671231080c1486 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338755.403264:0:12982:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787338755.403269:0:12982:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1787338755.403291:0:12982:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787338755.403296:0:12982:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1787338755.403302:0:12982:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787338755.403329:0:12982:0:(import.c:65:import_set_state_nolock()) ffff90bbef174800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1787338755.403446:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787338755.403454:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.153@tcp lock: ffff90bc02044a00/0x83671231080c147f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x83671231080c1486 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338755.403462:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bc02044a00 already unused, calling callback (ffffffffc1b2ec20) 10000000:00010000:3.0:1787338755.403465:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.153@tcp lock: ffff90bc02044a00/0x83671231080c147f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x83671231080c1486 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338755.403474:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.153@tcp lock: ffff90bc02044a00/0x83671231080c147f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x83671231080c1486 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787338755.403562:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.153@tcp lock: ffff90bc02044a00/0x83671231080c147f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x83671231080c1486 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787338755.403568:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787338755.403570:0:5826:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1787338755.403572:0:5826:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1787338755.403597:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.153@tcp lock: ffff90bc02044a00/0x83671231080c147f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x83671231080c1486 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338755.403604:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787338755.403635:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.153@tcp lock: ffff90bc02044a00/0x83671231080c147f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x83671231080c1486 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338755.403642:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.153@tcp lock: ffff90bc02044a00/0x83671231080c147f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x83671231080c1486 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338755.403655:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338755.403656:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338755.403658:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787338755.403691:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787338755.403709:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbedcb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d79243c8-b367-45ff-8d76-fbaa4be8becb:3315:1874160212068224:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787338755.403794:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338755.404113:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212068224 00000100:00100000:0.0:1787338755.404121:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212068224 00000100:00100000:0.0:1787338755.404174:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787338755.404184:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee562a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d79243c8-b367-45ff-8d76-fbaa4be8becb+19:3315:x1874160212068224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787338755.404197:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787338755.404211:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90bbf40e2000/0x83671231080c1486 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x83671231080c147f expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338755.404223:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787338755.404323:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee562a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d79243c8-b367-45ff-8d76-fbaa4be8becb+18:3315:x1874160212068224:12345-0@lo:103:ldlm_bl.0 Request processed in 140us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338755.404330:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787338755.404462:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee563100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874160212068096:0@lo:39:umount.0 00000100:00100000:1.0:1787338755.404563:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338755.404632:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212068096 00000100:00100000:3.0:1787338755.404636:0:7647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212068096 00000100:00100000:3.0:1787338755.404676:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1787338755.404683:0:7647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf4706a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874160212068096:12345-0@lo:39:umount.0 00000020:00000080:3.0:1787338755.404705:0:7647:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x83671231080c11d8 00000100:00080000:3.0:1787338755.404713:0:7647:0:(import.c:65:import_set_state_nolock()) ffff90bbfad52000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1787338755.404778:0:7647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf4706a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3313:x1874160212068096:12345-0@lo:39:umount.0 Request processed in 97us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338755.404784:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:3.0:1787338755.404790:0:7647:0:(genops.c:885:class_export_put()) final put ffff90bbfad55000/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:3.0:1787338755.404840:0:3313:0:(import.c:65:import_set_state_nolock()) ffff90bbef174800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1787338755.404850:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee563100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874160212068096:0@lo:39:umount.0 00000020:00000080:3.0:1787338755.404896:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90bbfad55000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1787338755.404963:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90bbfad52000 for lustre-MDT0000 00010000:00010000:1.0:1787338755.405069:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787338755.405250:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbedcb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d79243c8-b367-45ff-8d76-fbaa4be8becb:3315:1874160212068224:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1787338755.405272:0:12982:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787338755.405275:0:12982:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787338755.405285:0:12982:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1787338755.406859:0:12982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bc021c9800/0x83671231080c148d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c1494 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338755.407144:0:12982:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bc021c9800/0x83671231080c148d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x83671231080c1494 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338755.407153:0:12982:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bc021c9800/0x83671231080c148d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x83671231080c1494 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338755.407159:0:12982:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.153@tcp lock: ffff90bc021c9800/0x83671231080c148d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x83671231080c1494 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338755.407209:0:12982:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787338755.407216:0:12982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbc14a9400/0x83671231080c1383 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c138a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338755.407222:0:12982:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbc14a9400/0x83671231080c1383 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x83671231080c138a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338755.407227:0:12982:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbc14a9400/0x83671231080c1383 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x83671231080c138a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338755.407233:0:12982:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.153@tcp lock: ffff90bbc14a9400/0x83671231080c1383 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x83671231080c138a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338755.407283:0:11676:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787338755.407302:0:11676:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.153@tcp lock: ffff90bc021c9800/0x83671231080c148d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x83671231080c1494 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338755.407309:0:11676:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bc021c9800 already unused, calling callback (ffffffffc1b2ec20) 10000000:00010000:1.0:1787338755.407314:0:11676:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.153@tcp lock: ffff90bc021c9800/0x83671231080c148d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x83671231080c1494 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338755.407324:0:11676:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.153@tcp lock: ffff90bc021c9800/0x83671231080c148d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x83671231080c1494 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787338755.407331:0:11676:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.153@tcp lock: ffff90bc021c9800/0x83671231080c148d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x83671231080c1494 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787338755.407337:0:11676:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787338755.407340:0:11676:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1787338755.407382:0:11676:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.153@tcp lock: ffff90bc021c9800/0x83671231080c148d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x83671231080c1494 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338755.407389:0:11676:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787338755.407421:0:11676:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.153@tcp lock: ffff90bc021c9800/0x83671231080c148d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x83671231080c1494 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338755.407427:0:11676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.153@tcp lock: ffff90bc021c9800/0x83671231080c148d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x83671231080c1494 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338755.407440:0:11676:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787338755.407443:0:11676:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.153@tcp lock: ffff90bbc14a9400/0x83671231080c1383 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x83671231080c138a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338755.407448:0:11676:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbc14a9400 already unused, calling callback (ffffffffc1b2ec20) 10000000:00010000:1.0:1787338755.407451:0:11676:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.153@tcp lock: ffff90bbc14a9400/0x83671231080c1383 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x83671231080c138a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338755.407463:0:11676:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.153@tcp lock: ffff90bbc14a9400/0x83671231080c1383 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x83671231080c138a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787338755.407470:0:11676:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.153@tcp lock: ffff90bbc14a9400/0x83671231080c1383 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x83671231080c138a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787338755.407475:0:11676:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1787338755.407477:0:11676:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00000100:00100000:3.0:1787338755.407624:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf4706300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d79243c8-b367-45ff-8d76-fbaa4be8becb:3315:1874160212068352:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787338755.407690:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338755.407748:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212068352 00000100:00100000:3.0:1787338755.407754:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212068352 00000100:00100000:3.0:1787338755.407795:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787338755.407804:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbedcb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d79243c8-b367-45ff-8d76-fbaa4be8becb+18:3315:x1874160212068352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787338755.407816:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787338755.407829:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90bbf40e2e00/0x83671231080c1494 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x83671231080c148d expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338755.407843:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787338755.407910:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbedcb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d79243c8-b367-45ff-8d76-fbaa4be8becb+17:3315:x1874160212068352:12345-0@lo:103:ldlm_bl.0 Request processed in 106us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338755.407951:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787338755.407996:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf4706300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d79243c8-b367-45ff-8d76-fbaa4be8becb:3315:1874160212068352:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787338755.408276:0:11676:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.153@tcp lock: ffff90bbc14a9400/0x83671231080c1383 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x83671231080c138a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338755.408284:0:11676:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787338755.408308:0:11676:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.153@tcp lock: ffff90bbc14a9400/0x83671231080c1383 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x83671231080c138a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338755.408317:0:11676:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338755.408319:0:11676:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338755.408321:0:11676:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787338755.408331:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787338755.408340:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf4707100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d79243c8-b367-45ff-8d76-fbaa4be8becb:3317:1874160212068480:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787338755.408377:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338755.409350:0:12896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212068480 00000100:00100000:3.0:1787338755.409368:0:12896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212068480 00000100:00100000:3.0:1787338755.409446:0:12896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787338755.409455:0:12896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf4704380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d79243c8-b367-45ff-8d76-fbaa4be8becb+17:3317:x1874160212068480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787338755.409466:0:12896:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787338755.409613:0:12896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90bc021c9c00/0x83671231080c138a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x83671231080c1383 expref: 17 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338755.409651:0:12896:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787338755.409713:0:12896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf4704380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d79243c8-b367-45ff-8d76-fbaa4be8becb+16:3317:x1874160212068480:12345-0@lo:103:ldlm_bl.0 Request processed in 259us (1334us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338755.409720:0:12896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787338755.409797:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf4707100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d79243c8-b367-45ff-8d76-fbaa4be8becb:3317:1874160212068480:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787338755.409908:0:12982:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787338755.409926:0:12982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.153@tcp lock: ffff90bbc14a9400/0x83671231080c1383 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x83671231080c138a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338755.410043:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787338755.410070:0:12982:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1787338755.410089:0:12982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bc021c8800/0x83671231080c1685 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c168c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338755.410098:0:12982:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bc021c8800/0x83671231080c1685 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x83671231080c168c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338755.410106:0:12982:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bc021c8800/0x83671231080c1685 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x83671231080c168c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338755.410112:0:12982:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.153@tcp lock: ffff90bc021c8800/0x83671231080c1685 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x83671231080c168c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338755.410131:0:12982:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787338755.410137:0:12982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bc02044e00/0x83671231080c1137 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c113e expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338755.410144:0:12982:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bc02044e00/0x83671231080c1137 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x83671231080c113e expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338755.410150:0:12982:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bc02044e00/0x83671231080c1137 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x83671231080c113e expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338755.410156:0:12982:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.153@tcp lock: ffff90bc02044e00/0x83671231080c1137 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x83671231080c113e expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338755.410197:0:12982:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1787338755.410200:0:12982:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:2.0:1787338755.410204:0:12982:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1787338755.410232:0:12982:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1787338755.410236:0:12982:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1787338755.410240:0:12982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787338755.410251:0:12982:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/7 00000020:00080000:2.0:1787338755.410256:0:12982:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff90bbfc178800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787338755.410262:0:12982:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff90bbf3c20000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787338755.410270:0:12982:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff90bbde3cd000 e810cb1b-6993-4b6e-89c4-e8961cf35b35 192.168.201.53@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787338755.410276:0:12982:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff90bbee59cd28) has exports, disconnecting them 00000020:00080000:2.0:1787338755.410280:0:12982:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff90bbfc178800), last request at 1787338750 00000020:00000080:2.0:1787338755.410288:0:12982:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x83671231080c134b 00000100:00080000:2.0:1787338755.410305:0:12982:0:(import.c:65:import_set_state_nolock()) ffff90bbfc17a000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1787338755.410449:0:11676:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787338755.410456:0:11676:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.153@tcp lock: ffff90bc021c8800/0x83671231080c1685 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x83671231080c168c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338755.410464:0:11676:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bc021c8800 already unused, calling callback (ffffffffc1b2ec20) 10000000:00010000:0.0:1787338755.410472:0:11676:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.153@tcp lock: ffff90bc021c8800/0x83671231080c1685 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x83671231080c168c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338755.410480:0:11676:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.153@tcp lock: ffff90bc021c8800/0x83671231080c1685 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x83671231080c168c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787338755.410554:0:11676:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.153@tcp lock: ffff90bc021c8800/0x83671231080c1685 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x83671231080c168c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787338755.410560:0:11676:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1787338755.410562:0:11676:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1787338755.410564:0:11676:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1787338755.410591:0:11676:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.153@tcp lock: ffff90bc021c8800/0x83671231080c1685 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x83671231080c168c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338755.410598:0:11676:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787338755.410644:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbffa4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d79243c8-b367-45ff-8d76-fbaa4be8becb:3317:1874160212068608:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787338755.410694:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:2.0:1787338755.410787:0:12982:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff90bbfc178800): rc 0 00000020:00000080:2.0:1787338755.410790:0:12982:0:(genops.c:885:class_export_put()) final put ffff90bbfc178800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1787338755.410800:0:12982:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff90bbf3c20000), last request at 1787338750 00000020:00000080:2.0:1787338755.410804:0:12982:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x83671231080c1280 00000100:00080000:2.0:1787338755.410809:0:12982:0:(import.c:65:import_set_state_nolock()) ffff90bbf3c20800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1787338755.410815:0:12982:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff90bbf3c20000): rc 0 00000020:00000080:2.0:1787338755.410817:0:12982:0:(genops.c:885:class_export_put()) final put ffff90bbf3c20000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:2.0:1787338755.410824:0:12982:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa35141c6bae0 00000100:00080000:2.0:1787338755.410843:0:12982:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787338755.410846:0:12982:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:2.0:1787338755.410858:0:12982:0:(osp_dev.c:1634:osp_import_event()) got inactive 00010000:00010000:0.0:1787338755.411022:0:11676:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.153@tcp lock: ffff90bc021c8800/0x83671231080c1685 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x83671231080c168c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338755.411029:0:11676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.153@tcp lock: ffff90bc021c8800/0x83671231080c1685 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x83671231080c168c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338755.411041:0:11676:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787338755.411044:0:11676:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.153@tcp lock: ffff90bc02044e00/0x83671231080c1137 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x83671231080c113e expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338755.411049:0:11676:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bc02044e00 already unused, calling callback (ffffffffc1b2ec20) 10000000:00010000:0.0:1787338755.411052:0:11676:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.153@tcp lock: ffff90bc02044e00/0x83671231080c1137 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x83671231080c113e expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338755.411058:0:11676:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.153@tcp lock: ffff90bc02044e00/0x83671231080c1137 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x83671231080c113e expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787338755.411071:0:11676:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.153@tcp lock: ffff90bc02044e00/0x83671231080c1137 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x83671231080c113e expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787338755.411076:0:11676:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1787338755.411078:0:11676:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1787338755.411080:0:11676:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1787338755.411095:0:11676:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.153@tcp lock: ffff90bc02044e00/0x83671231080c1137 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x83671231080c113e expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338755.411100:0:11676:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787338755.411114:0:11676:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.153@tcp lock: ffff90bc02044e00/0x83671231080c1137 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x83671231080c113e expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338755.411120:0:11676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.153@tcp lock: ffff90bc02044e00/0x83671231080c1137 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x83671231080c113e expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338755.411131:0:11676:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787338755.411132:0:11676:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787338755.411134:0:11676:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787338755.411147:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf7ed5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d79243c8-b367-45ff-8d76-fbaa4be8becb:3314:1874160212068736:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787338755.411195:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787338755.411225:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338755.411268:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787338755.411276:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90bbfc178800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1787338755.411321:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90bbf3c20000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1787338755.411343:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90bbfc17a000 for lustre-MDT0000 00000020:00000080:1.0:1787338755.411347:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90bbf3c20800 for lustre-MDT0000 00000100:00080000:2.0:1787338755.411457:0:12982:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1787338755.411471:0:12982:0:(import.c:65:import_set_state_nolock()) ffff90bbc40f0800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1787338755.411557:0:12982:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787338755.411560:0:12982:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:2.0:1787338755.411568:0:12982:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1787338755.411630:0:12982:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1787338755.411640:0:12982:0:(import.c:65:import_set_state_nolock()) ffff90bac1f18000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1787338755.411673:0:12982:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff90bbee59cd28) has no exports 00000100:00100000:1.0:1787338755.412176:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee563100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1874160212068864:0@lo:9:umount.0 00000100:00100000:1.0:1787338755.412225:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338755.412255:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc01c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1874160212068992:0@lo:9:umount.0 00000100:00100000:1.0:1787338755.412273:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338755.412304:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212068864 00000100:00100000:1.0:1787338755.412311:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212068864 00000100:00100000:1.0:1787338755.412344:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212068992 00000100:00100000:1.0:1787338755.412346:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212068992 00000100:00100000:0.0:1787338755.412442:0:10743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787338755.412453:0:10743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf4707100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874160212068864:12345-0@lo:9:umount.0 00000020:00000080:0.0:1787338755.412478:0:10743:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x83671231080c12cd 00000100:00080000:0.0:1787338755.412551:0:10743:0:(import.c:65:import_set_state_nolock()) ffff90bbffa93000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787338755.412584:0:10743:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:0.0:1787338755.413005:0:10743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf4707100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3313:x1874160212068864:12345-0@lo:9:umount.0 Request processed in 553us (778us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338755.413021:0:10743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00010000:0.0:1787338755.413042:0:11676:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787338755.413108:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787338755.413116:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf4707800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874160212068992:12345-0@lo:9:umount.0 00000020:00000080:1.0:1787338755.413130:0:6689:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x83671231080c13b4 00000100:00080000:1.0:1787338755.413135:0:6689:0:(import.c:65:import_set_state_nolock()) ffff90bac1f1d800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787338755.413157:0:6689:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:1.0:1787338755.413616:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf4707800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3313:x1874160212068992:12345-0@lo:9:umount.0 Request processed in 500us (1339us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338755.413623:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:1.0:1787338755.413645:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787338755.413652:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787338755.413692:0:3313:0:(import.c:65:import_set_state_nolock()) ffff90bbc40f0800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1787338755.413842:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212068608 00000100:00100000:3.0:1787338755.413848:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212068608 00000100:00100000:3.0:1787338755.413899:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212068736 00000100:00100000:3.0:1787338755.413903:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212068736 00000100:00100000:3.0:1787338755.413947:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787338755.413955:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbedcb4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d79243c8-b367-45ff-8d76-fbaa4be8becb+17:3317:x1874160212068608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787338755.413967:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787338755.413985:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90bbf40e2800/0x83671231080c168c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x83671231080c1685 expref: 17 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338755.414002:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787338755.414035:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbedcb4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d79243c8-b367-45ff-8d76-fbaa4be8becb+16:3317:x1874160212068608:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (3341us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338755.414041:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787338755.414054:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787338755.414059:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf7ed4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d79243c8-b367-45ff-8d76-fbaa4be8becb+15:3314:x1874160212068736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787338755.414066:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787338755.414074:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90bc021c8600/0x83671231080c113e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x83671231080c1137 expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338755.414098:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787338755.414124:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf7ed4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d79243c8-b367-45ff-8d76-fbaa4be8becb+14:3314:x1874160212068736:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (2929us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338755.414130:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787338755.414181:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf7ed5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d79243c8-b367-45ff-8d76-fbaa4be8becb:3314:1874160212068736:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787338755.414236:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbffa4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d79243c8-b367-45ff-8d76-fbaa4be8becb:3317:1874160212068608:0@lo:103:ldlm_bl.0 00000004:00080000:1.0:1787338755.414383:0:3313:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1787338755.414712:0:3313:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787338755.414718:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee563100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1874160212068864:0@lo:9:umount.0 00000100:00080000:1.0:1787338755.414754:0:3313:0:(import.c:65:import_set_state_nolock()) ffff90bac1f18000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1787338755.414771:0:3313:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1787338755.414773:0:3313:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787338755.414775:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc01c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1874160212068992:0@lo:9:umount.0 00000020:00080000:3.0:1787338755.420481:0:12982:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff90bbee59cd28) has no exports 00000020:00000080:3.0:1787338755.458363:0:12982:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x83671231080c1192 00000020:00000080:3.0:1787338755.458381:0:12982:0:(genops.c:885:class_export_put()) final put ffff90bbfb943800/lustre-QMT0000_UUID 00000020:01000000:3.0:1787338755.458596:0:12982:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1787338755.458785:0:12982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787338755.458810:0:12982:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787338755.458815:0:12982:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff90bbd1734d28) has no exports 00000020:00000080:2.0:1787338755.464041:0:12982:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x83671231080c118b 00000020:00000080:2.0:1787338755.464060:0:12982:0:(genops.c:885:class_export_put()) final put ffff90bbef174000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787338755.464138:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90bbfb943800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1787338755.464440:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90bbef174000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787338755.464529:0:12982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787338755.464541:0:12982:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1787338755.464544:0:12982:0:(genops.c:885:class_export_put()) final put ffff90bbef175800/lustre-QMT0000_UUID 00000020:00000080:2.0:1787338755.464547:0:12982:0:(genops.c:844:class_export_destroy()) destroying export ffff90bbef175800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1787338755.464558:0:12982:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000100:00100000:0.0:1787338755.702208:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787338755.702230:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc4096a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1874160212069248:0@lo:400:kworker.0 00000100:00100000:0.0:1787338755.702304:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338755.702677:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787338755.702690:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf7ed5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1874160212069120:0@lo:400:kworker.0 00000100:00100000:1.0:1787338755.702723:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338755.702833:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212069248 00000100:00100000:0.0:1787338755.702842:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212069248 00000100:00100000:0.0:1787338755.702920:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212069120 00000100:00100000:0.0:1787338755.702925:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212069120 00000100:00100000:0.0:1787338755.702948:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1787338755.702955:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf3e91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3317:x1874160212069248:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1787338755.702965:0:5841:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1787338755.703013:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf3e91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3317:x1874160212069248:12345-0@lo:400:kworker.0 Request processed in 56us (709us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787338755.703021:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1787338755.703040:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1787338755.703044:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf4707480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3314:x1874160212069120:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1787338755.703049:0:5841:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1787338755.703077:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf4707480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3314:x1874160212069120:12345-0@lo:400:kworker.0 Request processed in 31us (353us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787338755.703084:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00080000:0.0:1787338755.703119:0:3317:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1787338755.703124:0:3317:0:(import.c:65:import_set_state_nolock()) ffff90bbf41a4000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1787338755.703128:0:3317:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1787338755.704017:0:3314:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787338755.704022:0:3314:0:(import.c:65:import_set_state_nolock()) ffff90bbffa95800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1787338755.704026:0:3314:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1787338755.704031:0:3314:0:(import.c:65:import_set_state_nolock()) ffff90bbffa95800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787338755.704035:0:3314:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 194 00000100:00080000:1.0:1787338755.704041:0:3314:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff90bbffa95800 using connection 192.168.201.153@tcp/0@lo 00000100:00100000:1.0:1787338755.704067:0:3314:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90bbf4705880 x1874160212069376/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787338755.704089:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf7ed5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1874160212069120:0@lo:400:kworker.0 00000100:00100000:1.0:1787338755.704118:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf4705880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3313:1874160212069376:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1787338755.704162:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338755.704203:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212069376 00000100:00100000:1.0:1787338755.704209:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212069376 00000100:00100000:1.0:1787338755.704233:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1787338755.704239:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf4704700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3313:x1874160212069376:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:1.0:1787338755.704258:0:5841:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:0.0:1787338755.717831:0:3317:0:(import.c:65:import_set_state_nolock()) ffff90bbf41a4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787338755.717841:0:3317:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 217 00000100:00080000:0.0:1787338755.717850:0:3317:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff90bbf41a4000 using connection 192.168.201.153@tcp/0@lo 00000100:00100000:0.0:1787338755.717969:0:3317:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90bbf3e93480 x1874160212069504/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787338755.718008:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc4096a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1874160212069248:0@lo:400:kworker.0 00000100:00100000:3.0:1787338755.718400:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf3e93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3313:1874160212069504:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1787338755.718472:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338755.718720:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212069504 00000100:00100000:2.0:1787338755.718728:0:7647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212069504 00000100:00100000:2.0:1787338755.718765:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1787338755.718772:0:7647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbedcb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3313:x1874160212069504:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:2.0:1787338755.718791:0:7647:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1787338755.718838:0:7647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbedcb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3313:x1874160212069504:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 64us (365us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787338755.718845:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00080000:3.0:1787338755.719070:0:3313:0:(import.c:65:import_set_state_nolock()) ffff90bbf41a4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787338755.719076:0:3313:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787338755.719079:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf3e93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3313:1874160212069504:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1787338755.736621:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf4704700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3313:x1874160212069376:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 32371us (32449us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787338755.736637:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:3.0:1787338755.736808:0:3313:0:(import.c:65:import_set_state_nolock()) ffff90bbffa95800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787338755.736817:0:3313:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787338755.736821:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf4705880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3313:1874160212069376:0@lo:38:ptlrpcd_00_00.0 00010000:00010000:1.0:1787338755.837611:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787338756.857147:0:11676:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787338757.785745:0:7651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787338757.785756:0:7651:0:(genops.c:885:class_export_put()) final put ffff90bac1f1c800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787338757.785828:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90bac1f1c800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1787338757.785908:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90bac1f1d800 for lustre-OST0001 00010000:00010000:1.0:1787338757.884692:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787338758.328070:0:5861:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e810cb1b-6993-4b6e-89c4-e8961cf35b35 00000001:00080000:2.0:1787338758.328088:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:2.0:1787338758.328094:0:5861:0:(genops.c:885:class_export_put()) final put ffff90bbde3cd000/e810cb1b-6993-4b6e-89c4-e8961cf35b35 00000020:00000080:1.0:1787338758.328433:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90bbde3cd000/e810cb1b-6993-4b6e-89c4-e8961cf35b35 for lustre-MDT0000 00000020:00000080:1.0:1787338758.328500:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90bbde3cc000 for lustre-MDT0000 00000001:00100000:2.0:1787338758.335181:0:6714:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787338758.335192:0:6714:0:(genops.c:885:class_export_put()) final put ffff90bbffa91000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787338758.336094:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90bbffa91000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1787338758.336150:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90bbffa93000 for lustre-OST0000 00010000:00010000:1.0:1787338758.902183:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787338759.926674:0:11676:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787338760.822609:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787338760.822616:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787338760.822620:0:37:0:(import.c:65:import_set_state_nolock()) ffff90bbffa95800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787338760.822628:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 408 00000100:00080000:0.0:1787338760.822634:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787338760.822639:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff90bbffa95800 using connection 192.168.201.153@tcp/0@lo 00000100:00100000:0.0:1787338760.822665:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90bbf3e93480 x1874160212069760/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787338760.822691:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787338760.822694:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787338760.822696:0:37:0:(import.c:65:import_set_state_nolock()) ffff90bbf41a4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787338760.822700:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 408 00000100:00080000:0.0:1787338760.822702:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787338760.822706:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff90bbf41a4000 using connection 192.168.201.153@tcp/0@lo 00000100:00100000:3.0:1787338760.822730:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787338760.822734:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90bbc4096a00 x1874160212069888/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787338760.822752:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf3e93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d79243c8-b367-45ff-8d76-fbaa4be8becb:3316:1874160212069632:0@lo:400:kworker.0 00000100:00100000:1.0:1787338760.822804:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf3e93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3313:1874160212069760:0@lo:38:kworker.0 00000100:00100000:1.0:1787338760.828423:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338760.828508:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc4096a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3313:1874160212069888:0@lo:38:kworker.0 00000100:00100000:1.0:1787338760.828541:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338760.828657:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212069760 00000100:00100000:2.0:1787338760.828665:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212069760 00000100:00100000:2.0:1787338760.828703:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212069888 00000100:00100000:2.0:1787338760.828706:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212069888 00000100:00100000:2.0:1787338760.828723:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1787338760.828731:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf4705880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3313:x1874160212069760:12345-0@lo:38:kworker.0 00010000:02000000:2.0:1787338760.828749:0:5840:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1787338760.828899:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1787338760.828905:0:7647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf4706300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3313:x1874160212069888:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1787338760.828914:0:7647:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1787338760.828963:0:7647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf4706300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3313:x1874160212069888:12345-0@lo:38:kworker.0 Request processed in 56us (420us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787338760.828971:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00080000:0.0:1787338760.829013:0:3313:0:(import.c:65:import_set_state_nolock()) ffff90bbf41a4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787338760.829018:0:3313:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787338760.829022:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc4096a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3313:1874160212069888:0@lo:38:kworker.0 00000100:00100000:3.0:1787338760.835301:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338760.835566:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212069632 00000100:00100000:0.0:1787338760.835576:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212069632 00000100:00100000:0.0:1787338760.835648:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1787338760.835658:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4012850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+14:3316:x1874160212069632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787338760.835765:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4012850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d79243c8-b367-45ff-8d76-fbaa4be8becb+14:3316:x1874160212069632:12345-0@lo:400:kworker.0 Request processed in 109us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338760.835772:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:1.0:1787338760.836009:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf3e93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d79243c8-b367-45ff-8d76-fbaa4be8becb:3316:1874160212069632:0@lo:400:kworker.0 00000100:00100000:2.0:1787338760.840039:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf4705880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3313:x1874160212069760:12345-0@lo:38:kworker.0 Request processed in 11298us (11613us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787338760.840068:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00080000:1.0:1787338760.840151:0:3313:0:(import.c:65:import_set_state_nolock()) ffff90bbffa95800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787338760.840219:0:3313:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787338760.840224:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf3e93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3313:1874160212069760:0@lo:38:kworker.0 00010000:00010000:1.0:1787338760.950408:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1787338761.526024:0:12982:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff90bbc2d37000 - data ffff90bbf797c510/ffff90bbee149400 00000020:01000000:2.0:1787338761.526164:0:12982:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff90bbde914780 - data ffff90bbf173fe58/ffff90bbfc6f3800 00000001:00000004:2.0:1787338761.533696:0:12982:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:2.0:1787338761.678093:0:12982:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787338761.678102:0:12982:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:2.0:1787338761.678368:0:12982:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787338761.678372:0:12982:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1787338761.679458:0:7054:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1787338761.679464:0:7054:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:0.0:1787338761.679474:0:7054:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1787338761.680349:0:12982:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787338761.680354:0:12982:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:2.0:1787338761.680371:0:12982:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787338761.680373:0:12982:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1787338761.680763:0:7951:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1787338761.680768:0:7951:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:1.0:1787338761.680776:0:7951:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1787338761.753317:0:12982:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x83671231080c115a 00000020:00000080:1.0:1787338761.753334:0:12982:0:(genops.c:885:class_export_put()) final put ffff90bbee492800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787338761.753956:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90bbee492800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787338761.755536:0:12982:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x83671231080c116f 00000020:00000080:1.0:1787338761.755547:0:12982:0:(genops.c:885:class_export_put()) final put ffff90bbee493800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1787338761.755617:0:12982:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1787338761.755623:0:12982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787338761.755632:0:12982:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787338761.755635:0:12982:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff90bbee598000) has no exports 00000004:01000000:1.0:1787338761.755801:0:12982:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1787338761.755833:0:12982:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x83671231080c13ad 00000020:00000080:1.0:1787338761.755839:0:12982:0:(genops.c:885:class_export_put()) final put ffff90bac1f19800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787338761.757478:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90bbee493800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1787338761.757794:0:12982:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1787338761.757803:0:12982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787338761.757825:0:12982:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787338761.757830:0:12982:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff90bbfc2499b8) has no exports 00000020:00000080:1.0:1787338761.757840:0:12982:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x83671231080c13a6 00000020:00000080:1.0:1787338761.757860:0:12982:0:(genops.c:885:class_export_put()) final put ffff90bac1f1a800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787338761.757945:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90bac1f19800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1787338761.757952:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90bac1f1a800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1787338761.759076:0:12982:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1787338761.759082:0:12982:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787338761.759087:0:12982:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:1.0:1787338761.759093:0:12982:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787338761.759095:0:12982:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787338761.759135:0:12982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787338761.759145:0:12982:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787338761.759152:0:12982:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x83671231080c12c6 00000020:00000080:1.0:1787338761.759160:0:12982:0:(genops.c:885:class_export_put()) final put ffff90bbfdb70800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1787338761.759165:0:12982:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1787338761.759171:0:12982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787338761.759174:0:12982:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787338761.759177:0:12982:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff90bbee0acd28) has no exports 00000020:00000080:1.0:1787338761.759183:0:12982:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x83671231080c12bf 00000020:00000080:1.0:1787338761.759186:0:12982:0:(genops.c:885:class_export_put()) final put ffff90bbc40f0000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787338761.759526:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90bac1f18000 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1787338761.759534:0:37:0:(genops.c:885:class_export_put()) final put ffff90bbf41a3000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787338761.759536:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90bbf41a3000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1787338761.759542:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787338761.759618:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90bbfdb70800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1787338761.759623:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90bbc40f0000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1787338761.760230:0:12982:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1787338761.760234:0:12982:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1787338761.760237:0:12982:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:1.0:1787338761.760241:0:12982:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787338761.760243:0:12982:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787338761.760278:0:12982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787338761.760285:0:12982:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787338761.760310:0:12982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787338761.760313:0:12982:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787338761.760317:0:12982:0:(genops.c:885:class_export_put()) final put ffff90bbde243000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787338761.760319:0:12982:0:(genops.c:844:class_export_destroy()) destroying export ffff90bbde243000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1787338761.760325:0:12982:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787338761.761233:0:12982:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x83671231080c1176 00000020:00000080:1.0:1787338761.761243:0:12982:0:(genops.c:885:class_export_put()) final put ffff90bbee497800/lustre-MDD0000_UUID 00000020:01000000:1.0:1787338761.761248:0:12982:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1787338761.761263:0:12982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787338761.761268:0:12982:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787338761.761272:0:12982:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff90bbee5999b8) has no exports 00000020:00000080:1.0:1787338761.761292:0:12982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787338761.761297:0:12982:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1787338761.761301:0:12982:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x83671231080c117d 00000020:00000080:1.0:1787338761.761305:0:12982:0:(genops.c:885:class_export_put()) final put ffff90bbee494000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1787338761.761313:0:12982:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90bbd0622000 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1787338761.761316:0:12982:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90bbd0622000 3 00000020:01000004:1.0:1787338761.761319:0:12982:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff90bbd0622000 from lustre-MDT0000 00000020:00000080:1.0:1787338761.761336:0:12982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787338761.761340:0:12982:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1787338761.761342:0:12982:0:(genops.c:885:class_export_put()) final put ffff90bbee496800/lustre-MDT0000_UUID 00000020:00000080:1.0:1787338761.761344:0:12982:0:(genops.c:844:class_export_destroy()) destroying export ffff90bbee496800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1787338761.761351:0:12982:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1787338761.761458:0:12982:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:1.0:1787338761.761462:0:12982:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1787338761.761466:0:12982:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1787338761.761469:0:12982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787338761.761472:0:12982:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787338761.761479:0:12982:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff90bbc9186000 d79243c8-b367-45ff-8d76-fbaa4be8becb 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787338761.761485:0:12982:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff90bbd1733370) has exports, disconnecting them 00000020:00080000:1.0:1787338761.761489:0:12982:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff90bbc9186000), last request at 1787338523 00000020:00000080:1.0:1787338761.761564:0:12982:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x83671231080c111b 00000020:00010000:1.0:1787338761.761569:0:12982:0:(genops.c:1921:obd_stale_export_put()) Put export ffff90bbc9186000: total 2 00000100:00080000:1.0:1787338761.761573:0:12982:0:(import.c:65:import_set_state_nolock()) ffff90bbc9187000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1787338761.761588:0:12982:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff90bbc9186000): rc 0 00000020:00080000:1.0:1787338761.761592:0:12982:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff90bbd1733370) has no exports 00000020:00010000:1.0:1787338761.761605:0:5827:0:(genops.c:1907:obd_stale_export_get()) Get export ffff90bbc9186000: total 2 00010000:00010000:1.0:1787338761.761626:0:5827:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff90bbc9186000, canceled 0 locks, left on hash table 8. 00010000:00010000:1.0:1787338761.761653:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90bc021c8400/0x83671231080c1233 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x83671231080c122c expref: 9 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338761.761686:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90bc02044c00/0x83671231080c1432 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x83671231080c142b expref: 8 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1787338761.761891:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90bbc40f0800 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1787338761.761899:0:37:0:(genops.c:885:class_export_put()) final put ffff90bbfdb73800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787338761.761902:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90bbfdb73800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1787338761.761907:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787338761.761998:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90bbee497800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1787338761.762007:0:37:0:(genops.c:885:class_export_put()) final put ffff90bbee491800/lustre-MDD0000_UUID 00000020:00000080:2.0:1787338761.762010:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90bbee491800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1787338761.762013:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:2.0:1787338761.762189:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90bbee494000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:1.0:1787338761.762261:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90bc021c9a00/0x83671231080c14b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x83671231080c14a9 expref: 7 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338761.762274:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90bc021c8200/0x83671231080c1670 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x83671231080c1669 expref: 6 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338761.762283:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90bc021c8c00/0x83671231080c167e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x83671231080c1677 expref: 5 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338761.762296:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90bc02045600/0x83671231080c145c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x83671231080c1455 expref: 4 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338761.762307:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90bbf7ea4e00/0x83671231080c1440 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x83671231080c1439 expref: 3 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338761.762317:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90bc02045000/0x83671231080c146a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x83671231080c1463 expref: 2 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338761.762327:0:5827:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff90bbc9186000, canceled 8 locks, left on hash table 0. 00000020:00000080:1.0:1787338761.762342:0:5827:0:(genops.c:885:class_export_put()) final put ffff90bbc9186000/d79243c8-b367-45ff-8d76-fbaa4be8becb 00010000:00010000:1.0:1787338761.762362:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338761.762364:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338761.762366:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787338761.762668:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90bbc9186000/d79243c8-b367-45ff-8d76-fbaa4be8becb for MGS 00000020:00000080:2.0:1787338761.762716:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90bbc9187000 for MGS 00000100:00100000:0.0:1787338761.766058:0:5832:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff90bbd16a4c00:5832] 0 exiting: rc = 1 00000100:00100000:0.0:1787338761.766157:0:5833:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff90bbc96c7000:5833] 1 exiting: rc = 0 00000100:00100000:3.0:1787338761.766586:0:5834:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff90bbc96c7600:5834] 2 exiting: rc = 0 00000100:00100000:0.0:1787338761.773479:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.773491:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.773502:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.773509:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.773534:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.773539:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.773545:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.773550:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.773555:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.773561:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.773567:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.773572:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.773577:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.773582:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.773588:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.773593:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.773598:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.773603:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.773609:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.773614:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.773620:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.773625:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.773631:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.773637:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.773643:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.773648:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.773653:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.773659:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.773664:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.773670:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.773674:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.773679:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.773684:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.773688:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.773693:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.773698:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.773703:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.773708:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.773712:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.773726:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.773731:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.773736:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.773741:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.773745:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.773750:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.773755:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.773760:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.773764:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.773770:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.773775:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.773781:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.773786:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.773791:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.773796:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.773801:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.773816:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.773823:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.773828:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.773835:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.773840:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.773845:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.773851:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.773857:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.773862:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:0.0:1787338761.774309:0:12982:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1787338761.774313:0:12982:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:0.0:1787338761.781090:0:12982:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff90bbee202480 - data ffff90bbf7ac1af8/ffff90bbf4119800 00000020:01000000:0.0:1787338761.781225:0:12982:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff90bbc7c76000 - data ffff90bbf177aca8/ffff90bbd8495000 00000020:00000080:0.0:1787338761.781742:0:12982:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x83671231080c10ff 00000020:00000080:0.0:1787338761.781750:0:12982:0:(genops.c:885:class_export_put()) final put ffff90bbd8e5a000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787338761.781766:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90bbd8e5a000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:0.0:1787338761.781778:0:12982:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90bbd0622000 from MGS, refs=2 00000020:01000004:0.0:1787338761.781781:0:12982:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90bbd0622000 2 00000020:01000004:0.0:1787338761.781795:0:12982:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff90bbd0622000 from MGS 00000020:00000080:0.0:1787338761.781826:0:12982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787338761.781833:0:12982:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1787338761.781835:0:12982:0:(genops.c:885:class_export_put()) final put ffff90bbd8fdb800/MGS 00000020:00000080:0.0:1787338761.781837:0:12982:0:(genops.c:844:class_export_destroy()) destroying export ffff90bbd8fdb800/MGS for MGS 00000020:01000000:0.0:1787338761.781845:0:12982:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1787338761.781918:0:12982:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1787338761.781922:0:12982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787338761.781927:0:12982:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787338761.781933:0:12982:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff90bbee492000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787338761.781939:0:12982:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff90bbd17319b8) has exports, disconnecting them 00000020:00080000:0.0:1787338761.781944:0:12982:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff90bbee492000), last request at 1787338524 00000020:00000080:0.0:1787338761.781948:0:12982:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x83671231080c11ca 00000020:00080000:0.0:1787338761.781957:0:12982:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff90bbee492000): rc 0 00000020:00000080:0.0:1787338761.781961:0:12982:0:(genops.c:885:class_export_put()) final put ffff90bbee492000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1787338761.781982:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90bbee492000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1787338761.784184:0:12982:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1787338761.784194:0:12982:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787338761.784199:0:12982:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787338761.784218:0:12982:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787338761.784433:0:12982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787338761.784440:0:12982:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1787338761.784446:0:12982:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90bbd0622000 1 00000020:00000080:1.0:1787338761.784453:0:12982:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x83671231080c10f1 00000020:00000080:1.0:1787338761.784462:0:12982:0:(genops.c:885:class_export_put()) final put ffff90bbd8fdd800/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1787338761.784468:0:12982:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1787338761.784473:0:12982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787338761.784476:0:12982:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787338761.784479:0:12982:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff90bbde3ecd28) has no exports 00000020:00000080:0.0:1787338761.798561:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90bbef174800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1787338761.798577:0:36:0:(genops.c:885:class_export_put()) final put ffff90bbef170800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1787338761.798581:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90bbef170800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1787338761.798590:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1787338761.798656:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90bbd8fdd800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787338761.847132:0:12982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787338761.847146:0:12982:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1787338761.847152:0:12982:0:(genops.c:885:class_export_put()) final put ffff90bbc96ac000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787338761.847157:0:12982:0:(genops.c:844:class_export_destroy()) destroying export ffff90bbc96ac000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1787338761.847166:0:12982:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1787338761.847303:0:12982:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff90bbd0621000 00000020:01000000:2.0:1787338761.847325:0:12982:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1787338761.847329:0:12982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787338761.847333:0:12982:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787338761.847337:0:12982:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff90bbd1730000) has no exports 00000100:00100000:1.0:1787338761.847728:0:5839:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff90bbc7cd7800:5839] 0 exiting: rc = 1 00000100:00100000:1.0:1787338761.847841:0:5841:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff90bbc7cd7a00:5841] 2 exiting: rc = 0 00000100:00100000:1.0:1787338761.847926:0:7647:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff90bbfc28ac00:7647] 3 exiting: rc = 0 00000100:00100000:2.0:1787338761.848268:0:5840:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff90bbc7cd6e00:5840] 1 exiting: rc = 0 00000100:00100000:2.0:1787338761.848324:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.848331:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.848338:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.848343:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.848349:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.848354:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.848360:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.848365:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.848440:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.848449:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.848454:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.848459:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.848465:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.848471:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.848477:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.848552:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.848560:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.848566:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.848571:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.848576:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.848581:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.848586:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.848592:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.848597:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.848602:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.848607:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.848613:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.848619:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.848625:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.848630:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.848635:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.848640:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.848645:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.848651:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.848655:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.848662:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.848667:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.848673:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.848678:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.848683:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.848689:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.848693:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.848699:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.848705:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.848710:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.848716:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.848722:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.848727:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.848733:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.848737:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.848751:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.848757:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.848762:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.848768:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.848773:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.848778:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.848783:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.848788:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.848793:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.848798:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.848803:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.848822:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.848828:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.848833:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338761.853825:0:5843:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff90bbc841e600:5843] 1 exiting: rc = 0 00000100:00100000:3.0:1787338761.854146:0:5842:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff90bbc841f200:5842] 0 exiting: rc = 1 00000100:00100000:2.0:1787338761.854532:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.854541:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.854549:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.854555:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.854560:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.854566:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.854573:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.854578:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.854584:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.854589:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.854595:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.854601:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.854608:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.854614:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.854620:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.854626:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.854632:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.854637:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.854642:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.854647:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.854652:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.854668:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.854673:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.854678:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.854683:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.854689:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.854694:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.854699:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.854704:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.854709:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.854714:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.854719:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.854723:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.854729:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.854734:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.854739:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.854744:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.854750:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.854755:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.854760:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.854765:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.854771:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.854776:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.854781:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.854786:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.854792:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.854798:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.854803:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.854822:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.854828:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.854833:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.854838:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.854843:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.854848:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.854854:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.854860:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.854935:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.854941:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.854946:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.854951:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.854956:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.854962:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.854967:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.854972:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.855367:0:5845:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff90bbc841ea00:5845] 1 exiting: rc = 0 00000100:00100000:1.0:1787338761.855990:0:5844:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff90bbde673600:5844] 0 exiting: rc = 1 00000100:00100000:2.0:1787338761.856108:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.856115:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.856122:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.856127:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.856133:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.856139:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.856144:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.856149:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.856155:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.856172:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.856180:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.856186:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.856192:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.856200:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.856205:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.856211:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.856217:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.856223:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.856229:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.856234:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.856241:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.856262:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.856269:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.856275:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.856281:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.856286:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.856302:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.856308:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.856315:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.856321:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.856327:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.856333:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.856340:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.856359:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.856366:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.856440:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.856449:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.856456:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.856462:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.856468:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.856474:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.856480:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.856486:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.856548:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.856556:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.856577:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.856584:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.856590:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.856596:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.856602:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.856608:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.856614:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.856619:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.856624:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.856630:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.856636:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.856643:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.856664:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.856671:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.856678:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.856684:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.856699:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.856705:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.856711:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.864854:0:5846:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff90bbde672800:5846] 0 exiting: rc = 1 00000100:00100000:3.0:1787338761.865131:0:5847:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff90bbde673200:5847] 1 exiting: rc = 0 00000100:00100000:2.0:1787338761.865403:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.865411:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.865416:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.865421:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.865427:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.865431:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.865436:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.865441:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.865446:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.865451:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.865456:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.865462:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.865467:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.865472:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.865477:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.865481:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.865486:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.865491:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.865496:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.865500:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.865505:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.865509:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.865514:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.865518:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.865524:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.865529:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.865534:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.865539:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.865544:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.865548:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.865553:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.865570:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.865575:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.865580:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.865585:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.865589:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.865594:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.865598:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.865604:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.865608:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.865613:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.865617:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.865623:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.865628:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.865633:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.865637:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.865642:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.865647:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.865652:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.865657:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.865662:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.865667:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.865671:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.865676:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.865682:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.865687:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.865692:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.865696:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.865701:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.865706:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.865710:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.865715:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.865719:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.865724:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.866096:0:5849:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff90bbc7cd7c00:5849] 1 exiting: rc = 0 00000100:00100000:0.0:1787338761.866312:0:5848:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff90bbde673c00:5848] 0 exiting: rc = 1 00000100:00100000:2.0:1787338761.866869:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.866954:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.866960:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.866966:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.866971:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.866977:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.866983:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.866989:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.866995:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.867001:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.867007:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.867012:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.867018:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.867023:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.867028:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.867034:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.867039:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.867045:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.867050:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.867056:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.867062:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.867066:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.867070:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.867076:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.867082:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.867087:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.867092:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.867097:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.867102:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.867106:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.867111:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.867115:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.867119:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.867124:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.867129:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.867134:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.867146:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.867151:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.867157:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.867163:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.867168:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.867172:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.867176:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.867181:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.867186:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.867191:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.867196:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.867200:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.867205:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.867211:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.867216:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.867222:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.867227:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.867232:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.867237:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.867243:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.867247:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.867252:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.867257:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.867263:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.867268:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.867274:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.867279:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338761.867284:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787338761.867939:0:5850:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff90bbc7cd6200:5850] 0 exiting: rc = 1 00000100:00100000:0.0:1787338761.871547:0:5851:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff90bbc7cd7000:5851] 1 exiting: rc = 0 00000100:00100000:0.0:1787338761.880267:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.880278:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.880283:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.880288:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.880294:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.880299:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.880304:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.880321:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.880326:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.880330:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.880652:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.880658:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.880664:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.880670:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.880675:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.880680:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.880685:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.880690:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.880695:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.880700:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.880705:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.880709:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.880714:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.880719:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.880724:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.880729:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.880734:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.880739:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.880744:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.880748:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.880752:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.880757:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.880762:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.880767:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.880771:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.880775:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.880779:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.880784:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.880789:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.880793:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.880798:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.880815:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.880829:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.880834:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.880838:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.880843:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.880848:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.880853:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.880859:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.880864:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.880869:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.881014:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.881021:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.881027:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.881032:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.881037:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.881043:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.881047:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.881052:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.881057:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.881061:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.881066:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.881071:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.881076:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338761.881782:0:5852:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff90bbfad48600:5852] 0 exiting: rc = 1 00000100:00100000:2.0:1787338761.882060:0:5853:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff90bbfad49c00:5853] 1 exiting: rc = 0 00000100:00100000:3.0:1787338761.882327:0:5854:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff90bbfad48c00:5854] 2 exiting: rc = 0 00000100:00100000:0.0:1787338761.882789:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.882798:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.882803:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.882822:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.882828:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.882834:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.882839:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.882844:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.882850:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.882855:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.882861:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.882866:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.882985:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.883003:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.883009:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.883014:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.883020:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.883025:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.883031:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.883047:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.883054:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.883059:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.883064:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.883069:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.883075:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.883080:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.883086:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.883091:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.883097:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.883102:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.883108:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.883113:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.883118:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.883125:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.883130:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.883136:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.883141:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.883146:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.883151:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.883157:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.883162:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.883167:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.883173:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.883190:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.883196:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.883201:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.883207:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.883212:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.883222:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.883228:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.883234:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.883239:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.883244:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.883250:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.883254:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.883260:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.883265:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.883271:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.883278:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.883283:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.883289:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.883294:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.883299:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338761.883305:0:12982:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1787338761.887792:0:12982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787338761.887817:0:12982:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1787338761.887823:0:12982:0:(genops.c:885:class_export_put()) final put ffff90bbc2e80000/MDS_uuid 00000020:00000080:0.0:1787338761.887829:0:12982:0:(genops.c:844:class_export_destroy()) destroying export ffff90bbc2e80000/MDS_uuid for MDS 00000020:01000000:0.0:1787338761.887841:0:12982:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1787338761.888831:0:12982:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1787338761.980717:0:11676:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338763.001827:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338764.029112:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787338765.048177:0:11676:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787338765.390566:0:13133:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1787338765.405370:0:13133:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1787338765.405422:0:13133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbc0030600/0x83671231080c1455 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c145c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338765.405438:0:13133:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbc0030600/0x83671231080c1455 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x83671231080c145c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338765.405446:0:13133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbc0030600/0x83671231080c1455 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x83671231080c145c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338765.405473:0:13133:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.153@tcp lock: ffff90bbc0030600/0x83671231080c1455 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x83671231080c145c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338765.405498:0:13133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787338765.405504:0:13133:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1787338765.405528:0:13133:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787338765.405533:0:13133:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787338765.405539:0:13133:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787338765.405546:0:13133:0:(import.c:65:import_set_state_nolock()) ffff90bbffa95800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1787338765.405550:0:13133:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787338765.405552:0:13133:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787338765.405554:0:13133:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787338765.406457:0:13133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbc0030200/0x83671231080c1463 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c146a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338765.406470:0:13133:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbc0030200/0x83671231080c1463 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x83671231080c146a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338765.406477:0:13133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbc0030200/0x83671231080c1463 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x83671231080c146a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338765.406484:0:13133:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.153@tcp lock: ffff90bbc0030200/0x83671231080c1463 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x83671231080c146a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338765.406506:0:13133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787338765.406512:0:13133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbf40e3e00/0x83671231080c1677 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c167e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338765.406534:0:13133:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbf40e3e00/0x83671231080c1677 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x83671231080c167e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338765.406541:0:13133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbf40e3e00/0x83671231080c1677 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x83671231080c167e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338765.406548:0:13133:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.153@tcp lock: ffff90bbf40e3e00/0x83671231080c1677 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x83671231080c167e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338765.406561:0:13133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:0.0:1787338765.406564:0:13133:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1787338765.406582:0:13133:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1787338765.406586:0:13133:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00010000:00010000:0.0:1787338765.406600:0:11676:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787338765.406606:0:11676:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.153@tcp lock: ffff90bbc0030600/0x83671231080c1455 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x83671231080c145c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338765.406615:0:11676:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbc0030600 already unused, calling callback (ffffffffc1b2ec20) 10000000:00010000:0.0:1787338765.406619:0:11676:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.153@tcp lock: ffff90bbc0030600/0x83671231080c1455 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x83671231080c145c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338765.406629:0:11676:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.153@tcp lock: ffff90bbc0030600/0x83671231080c1455 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x83671231080c145c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787338765.406636:0:11676:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.153@tcp lock: ffff90bbc0030600/0x83671231080c1455 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x83671231080c145c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787338765.406642:0:11676:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787338765.406645:0:11676:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787338765.406652:0:11676:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1787338765.406683:0:11676:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.153@tcp lock: ffff90bbc0030600/0x83671231080c1455 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x83671231080c145c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338765.406690:0:11676:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787338765.406711:0:11676:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.153@tcp lock: ffff90bbc0030600/0x83671231080c1455 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x83671231080c145c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338765.406719:0:11676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.153@tcp lock: ffff90bbc0030600/0x83671231080c1455 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x83671231080c145c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338765.406732:0:11676:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787338765.406736:0:11676:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.153@tcp lock: ffff90bbc0030200/0x83671231080c1463 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x83671231080c146a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338765.406741:0:11676:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbc0030200 already unused, calling callback (ffffffffc1b2ec20) 10000000:00010000:0.0:1787338765.406758:0:11676:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.153@tcp lock: ffff90bbc0030200/0x83671231080c1463 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x83671231080c146a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338765.406765:0:11676:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.153@tcp lock: ffff90bbc0030200/0x83671231080c1463 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x83671231080c146a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787338765.406772:0:11676:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.153@tcp lock: ffff90bbc0030200/0x83671231080c1463 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x83671231080c146a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787338765.406778:0:11676:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787338765.406780:0:11676:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:0.0:1787338765.406781:0:11676:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:0.0:1787338765.406795:0:11676:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.153@tcp lock: ffff90bbc0030200/0x83671231080c1463 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x83671231080c146a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338765.406800:0:11676:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787338765.406812:0:11676:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.153@tcp lock: ffff90bbc0030200/0x83671231080c1463 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x83671231080c146a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338765.406819:0:11676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.153@tcp lock: ffff90bbc0030200/0x83671231080c1463 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x83671231080c146a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338765.406827:0:11676:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787338765.406830:0:11676:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.153@tcp lock: ffff90bbf40e3e00/0x83671231080c1677 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x83671231080c167e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338765.406836:0:11676:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e3e00 already unused, calling callback (ffffffffc1b2ec20) 10000000:00010000:0.0:1787338765.406839:0:11676:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.153@tcp lock: ffff90bbf40e3e00/0x83671231080c1677 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x83671231080c167e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338765.406846:0:11676:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.153@tcp lock: ffff90bbf40e3e00/0x83671231080c1677 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x83671231080c167e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787338765.406851:0:11676:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.153@tcp lock: ffff90bbf40e3e00/0x83671231080c1677 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x83671231080c167e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787338765.406856:0:11676:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1787338765.406858:0:11676:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1787338765.406859:0:11676:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1787338765.406870:0:11676:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.153@tcp lock: ffff90bbf40e3e00/0x83671231080c1677 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x83671231080c167e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338765.406904:0:11676:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787338765.406918:0:11676:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.153@tcp lock: ffff90bbf40e3e00/0x83671231080c1677 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x83671231080c167e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338765.406925:0:11676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.153@tcp lock: ffff90bbf40e3e00/0x83671231080c1677 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x83671231080c167e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338765.406945:0:11676:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787338765.406947:0:11676:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787338765.406949:0:11676:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787338765.406957:0:13133:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787338765.406963:0:13133:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787338765.406968:0:13133:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff90bbee59b370) has no exports 00000020:00080000:0.0:1787338765.406993:0:13133:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff90bbee59b370) has no exports 00010000:00010000:1.0:1787338765.409396:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787338765.409424:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc4096a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d79243c8-b367-45ff-8d76-fbaa4be8becb:3314:1874160212070016:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787338765.409502:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338765.409568:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787338765.409575:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc4097480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d79243c8-b367-45ff-8d76-fbaa4be8becb:3314:1874160212070144:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787338765.409598:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338765.409624:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc4095180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d79243c8-b367-45ff-8d76-fbaa4be8becb:3316:1874160212070272:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787338765.409643:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338765.410923:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212070016 00000100:00100000:1.0:1787338765.410934:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212070016 00000100:00100000:1.0:1787338765.410974:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212070144 00000100:00100000:1.0:1787338765.410991:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212070144 00000100:00100000:1.0:1787338765.411012:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212070272 00000100:00100000:1.0:1787338765.411016:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212070272 00000100:00100000:1.0:1787338765.411031:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787338765.411039:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf4704e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3314:x1874160212070016:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1787338765.411046:0:5825:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787338765 with bad export cookie 9468556743367463195 00010000:00010000:2.0:1787338765.411819:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787338765.412244:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787338765.412254:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbde53e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3314:x1874160212070144:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1787338765.412261:0:5823:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787338765 with bad export cookie 9468556743367463195 00000100:00100000:3.0:1787338765.412364:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbde53e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3314:x1874160212070144:12345-0@lo:103:ldlm_bl.0 Request processed in 110us (2764us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787338765.412371:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787338765.412395:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787338765.412399:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf4704a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3316:x1874160212070272:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1787338765.412403:0:5823:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787338765 with bad export cookie 9468556743367463195 00000100:00100000:3.0:1787338765.412436:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf4704a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3316:x1874160212070272:12345-0@lo:103:ldlm_bl.0 Request processed in 35us (2792us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787338765.412442:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1787338765.412780:0:3314:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.153@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787338765.412786:0:3314:0:(import.c:65:import_set_state_nolock()) ffff90bbc9180800 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1787338765.412791:0:3314:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.201.153@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000020:01000000:0.0:1787338765.417940:0:13133:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff90bbc2d370c0 - data ffff90bbf797cd80/ffff90bbc90bbc00 00000020:01000000:0.0:1787338765.418096:0:13133:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff90bbffe96e40 - data ffff90bbe68f96c0/ffff90bbffd7ec00 00000100:00080000:3.0:1787338765.419512:0:3316:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.153@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00100000:1.0:1787338765.424944:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf4704e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3314:x1874160212070016:12345-0@lo:103:ldlm_bl.0 Request processed in 13899us (15436us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787338765.424958:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:2.0:1787338765.441984:0:3314:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.201.153@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1787338765.442009:0:3314:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1787338765.442019:0:3314:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff90bbc4096a00 x1874160212070016/t0(0) o103->MGC192.168.201.153@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787338781 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787338765.442035:0:3314:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff90bbc4097480 x1874160212070144/t0(0) o103->MGC192.168.201.153@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787338781 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787338765.442045:0:3314:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff90bbc4095180 x1874160212070272/t0(0) o103->MGC192.168.201.153@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787338781 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1787338765.442054:0:3314:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1787338765.442057:0:3314:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1787338765.442058:0:3314:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1787338765.442364:0:3316:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff90bbc9180800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:3.0:1787338765.442389:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc4095180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d79243c8-b367-45ff-8d76-fbaa4be8becb:3316:1874160212070272:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1787338765.442823:0:3314:0:(import.c:65:import_set_state_nolock()) ffff90bbc9180800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787338765.442829:0:3314:0:(import.c:510:import_select_connection()) MGC192.168.201.153@tcp: connect to NID 0@lo last attempt 176 00000100:00080000:2.0:1787338765.442839:0:3314:0:(import.c:624:import_select_connection()) MGC192.168.201.153@tcp: import ffff90bbc9180800 using connection 192.168.201.153@tcp/0@lo 00000100:00100000:2.0:1787338765.442869:0:3314:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90bbfc01d880 x1874160212070400/t0(0) o250->MGC192.168.201.153@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787338765.443089:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc4096a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d79243c8-b367-45ff-8d76-fbaa4be8becb:3314:1874160212070016:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787338765.443104:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc4097480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d79243c8-b367-45ff-8d76-fbaa4be8becb:3314:1874160212070144:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787338765.443160:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc01d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d79243c8-b367-45ff-8d76-fbaa4be8becb:3313:1874160212070400:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:1.0:1787338765.443207:0:3313:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874160212070400 offset 0 length 520: 4 00100000:10000000:3.0:1787338765.458455:0:13133:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1787338765.492120:0:13133:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x83671231080c124f 00000020:00000080:3.0:1787338765.492131:0:13133:0:(genops.c:885:class_export_put()) final put ffff90bbfdb51000/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1787338765.492152:0:13133:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90bbc9632800 from lustre-OST0000, refs=2 00000020:01000004:3.0:1787338765.492155:0:13133:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90bbc9632800 2 00000020:01000004:3.0:1787338765.492159:0:13133:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff90bbc9632800 from lustre-OST0000 00000020:00000080:3.0:1787338765.492180:0:13133:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787338765.492189:0:13133:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1787338765.492216:0:13133:0:(genops.c:885:class_export_put()) final put ffff90bbfdb52000/lustre-OST0000_UUID 00000020:00000080:3.0:1787338765.492219:0:13133:0:(genops.c:844:class_export_destroy()) destroying export ffff90bbfdb52000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1787338765.492227:0:13133:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1787338765.492271:0:13133:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1787338765.492276:0:13133:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1787338765.492279:0:13133:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787338765.492284:0:13133:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787338765.492292:0:13133:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff90bbffa94800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787338765.492298:0:13133:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff90bbffd84d28) has exports, disconnecting them 00000020:00080000:3.0:1787338765.492303:0:13133:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff90bbffa94800), last request at 1787338542 00000020:00000080:3.0:1787338765.492308:0:13133:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x83671231080c1279 00000020:00080000:3.0:1787338765.492318:0:13133:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff90bbffa94800): rc 0 00000020:00000080:3.0:1787338765.492323:0:13133:0:(genops.c:885:class_export_put()) final put ffff90bbffa94800/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1787338765.493356:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90bbfdb51000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1787338765.493373:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90bbffa94800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1787338765.501026:0:13133:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1787338765.501037:0:13133:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787338765.501042:0:13133:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787338765.501050:0:13133:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787338765.501270:0:13133:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787338765.501280:0:13133:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:0.0:1787338765.501287:0:13133:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90bbc9632800 1 00000020:00000080:0.0:1787338765.501295:0:13133:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x83671231080c1209 00000020:00000080:0.0:1787338765.501304:0:13133:0:(genops.c:885:class_export_put()) final put ffff90bbc7cc0800/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1787338765.501310:0:13133:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1787338765.501318:0:13133:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787338765.501322:0:13133:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787338765.501325:0:13133:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff90bbde3eb370) has no exports 00000020:00000080:1.0:1787338765.503376:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90bbffa95800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1787338765.503389:0:37:0:(genops.c:885:class_export_put()) final put ffff90bbffa93800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1787338765.503393:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90bbffa93800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1787338765.503400:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1787338765.504233:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90bbc7cc0800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1787338765.527906:0:13133:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787338765.527924:0:13133:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1787338765.527930:0:13133:0:(genops.c:885:class_export_put()) final put ffff90bbc9633000/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1787338765.527935:0:13133:0:(genops.c:844:class_export_destroy()) destroying export ffff90bbc9633000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1787338765.527946:0:13133:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1787338765.528207:0:13133:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff90bbc9633800 00000020:02000400:0.0:1787338765.528248:0:13133:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00000100:00080000:3.0:1787338765.946070:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787338765.946079:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787338765.946083:0:36:0:(import.c:65:import_set_state_nolock()) ffff90bbf41a4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787338765.946091:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 413 00000100:00080000:3.0:1787338765.946097:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787338765.946105:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff90bbf41a4000 using connection 192.168.201.153@tcp/0@lo 00000100:00100000:3.0:1787338765.946141:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90bbedcb7b80 x1874160212070528/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787338765.947451:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbedcb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3313:1874160212070528:0@lo:38:kworker.0 00000400:00000100:1.0:1787338765.947505:0:3313:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874160212070528 offset 0 length 520: 4 00010000:00010000:0.0:1787338766.071064:0:11676:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787338767.095053:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338768.118065:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787338768.552050:0:13286:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1787338768.566228:0:13286:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1787338768.567118:0:13286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbf7ea5e00/0x83671231080c142b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c1432 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338768.567134:0:13286:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbf7ea5e00/0x83671231080c142b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x83671231080c1432 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338768.567162:0:13286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbf7ea5e00/0x83671231080c142b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x83671231080c1432 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338768.567169:0:13286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.153@tcp lock: ffff90bbf7ea5e00/0x83671231080c142b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x83671231080c1432 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338768.567192:0:13286:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787338768.567198:0:13286:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1787338768.567220:0:13286:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787338768.567231:0:13286:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff90bbedcb7b80 x1874160212070528/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787338785 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1787338768.567247:0:11676:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787338768.567255:0:11676:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.153@tcp lock: ffff90bbf7ea5e00/0x83671231080c142b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x83671231080c1432 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338768.567263:0:11676:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea5e00 already unused, calling callback (ffffffffc1b2ec20) 10000000:00010000:0.0:1787338768.567267:0:11676:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.153@tcp lock: ffff90bbf7ea5e00/0x83671231080c142b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x83671231080c1432 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338768.567276:0:11676:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.153@tcp lock: ffff90bbf7ea5e00/0x83671231080c142b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x83671231080c1432 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787338768.567283:0:11676:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.153@tcp lock: ffff90bbf7ea5e00/0x83671231080c142b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x83671231080c1432 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787338768.567288:0:11676:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787338768.567291:0:11676:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787338768.567293:0:11676:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1787338768.567315:0:11676:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff90bbc9180800 00010000:00010000:0.0:1787338768.567319:0:11676:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.153@tcp lock: ffff90bbf7ea5e00/0x83671231080c142b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x83671231080c1432 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338768.567325:0:11676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.153@tcp lock: ffff90bbf7ea5e00/0x83671231080c142b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x83671231080c1432 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338768.567335:0:11676:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787338768.567337:0:11676:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787338768.567339:0:11676:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787338768.567350:0:13286:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787338768.567357:0:13286:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787338768.567363:0:13286:0:(import.c:65:import_set_state_nolock()) ffff90bbf41a4000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1787338768.567369:0:13286:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787338768.567374:0:13286:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff90bbedcb7b80 x1874160212070528/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787338785 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787338768.574175:0:13286:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787338768.574233:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbedcb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3313:1874160212070528:0@lo:38:kworker.0 00000100:00100000:3.0:1787338768.579144:0:13286:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1787338768.581602:0:13286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbf40e3a00/0x83671231080c1439 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c1440 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338768.581619:0:13286:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbf40e3a00/0x83671231080c1439 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x83671231080c1440 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338768.581627:0:13286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbf40e3a00/0x83671231080c1439 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x83671231080c1440 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338768.581652:0:13286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.153@tcp lock: ffff90bbf40e3a00/0x83671231080c1439 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x83671231080c1440 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338768.581679:0:13286:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787338768.581686:0:13286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbf40e3000/0x83671231080c1669 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c1670 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338768.581701:0:13286:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbf40e3000/0x83671231080c1669 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x83671231080c1670 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338768.581707:0:13286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbf40e3000/0x83671231080c1669 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x83671231080c1670 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338768.581712:0:13286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.153@tcp lock: ffff90bbf40e3000/0x83671231080c1669 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x83671231080c1670 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338768.581722:0:13286:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1787338768.581726:0:13286:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1787338768.581749:0:13286:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1787338768.581753:0:13286:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1787338768.581757:0:13286:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787338768.581762:0:13286:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787338768.581766:0:13286:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff90bbfc248000) has no exports 00000020:00080000:3.0:1787338768.581787:0:13286:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff90bbfc248000) has no exports 00010000:00010000:1.0:1787338768.583275:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787338768.583286:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.153@tcp lock: ffff90bbf40e3a00/0x83671231080c1439 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x83671231080c1440 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338768.583313:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e3a00 already unused, calling callback (ffffffffc1b2ec20) 10000000:00010000:1.0:1787338768.583317:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.153@tcp lock: ffff90bbf40e3a00/0x83671231080c1439 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x83671231080c1440 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338768.583326:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.153@tcp lock: ffff90bbf40e3a00/0x83671231080c1439 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x83671231080c1440 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787338768.583333:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.153@tcp lock: ffff90bbf40e3a00/0x83671231080c1439 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x83671231080c1440 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787338768.583337:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787338768.583339:0:5827:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:1.0:1787338768.583341:0:5827:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:1.0:1787338768.583357:0:5827:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff90bbc9180800 00010000:00010000:1.0:1787338768.583361:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.153@tcp lock: ffff90bbf40e3a00/0x83671231080c1439 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x83671231080c1440 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338768.583367:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.153@tcp lock: ffff90bbf40e3a00/0x83671231080c1439 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x83671231080c1440 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338768.583382:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787338768.583386:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.153@tcp lock: ffff90bbf40e3000/0x83671231080c1669 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x83671231080c1670 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338768.583391:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e3000 already unused, calling callback (ffffffffc1b2ec20) 10000000:00010000:1.0:1787338768.583394:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.153@tcp lock: ffff90bbf40e3000/0x83671231080c1669 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x83671231080c1670 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338768.583401:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.153@tcp lock: ffff90bbf40e3000/0x83671231080c1669 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x83671231080c1670 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787338768.583411:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.153@tcp lock: ffff90bbf40e3000/0x83671231080c1669 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x83671231080c1670 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787338768.583416:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1787338768.583418:0:5827:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1787338768.583419:0:5827:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1787338768.583424:0:5827:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff90bbc9180800 00010000:00010000:1.0:1787338768.583426:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.153@tcp lock: ffff90bbf40e3000/0x83671231080c1669 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x83671231080c1670 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338768.583432:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.153@tcp lock: ffff90bbf40e3000/0x83671231080c1669 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x83671231080c1670 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338768.583443:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338768.583444:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338768.583446:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338768.583454:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1787338768.587004:0:13286:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff90bbc2d37480 - data ffff90bbe6be0a20/ffff90bbc90ba000 00000020:01000000:3.0:1787338768.587645:0:13286:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff90bbedc1eb40 - data ffff90bbe6be8ca8/ffff90bbffd06400 00100000:10000000:3.0:1787338768.604712:0:13286:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1787338768.636698:0:13286:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x83671231080c131a 00000020:00000080:0.0:1787338768.636711:0:13286:0:(genops.c:885:class_export_put()) final put ffff90bbfdb72000/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1787338768.636731:0:13286:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90bbff941800 from lustre-OST0001, refs=2 00000020:01000004:0.0:1787338768.636746:0:13286:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90bbff941800 2 00000020:01000004:0.0:1787338768.636749:0:13286:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff90bbff941800 from lustre-OST0001 00000020:00000080:0.0:1787338768.636789:0:13286:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787338768.636799:0:13286:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1787338768.636802:0:13286:0:(genops.c:885:class_export_put()) final put ffff90bbc40f5800/lustre-OST0001_UUID 00000020:00000080:0.0:1787338768.636806:0:13286:0:(genops.c:844:class_export_destroy()) destroying export ffff90bbc40f5800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1787338768.636813:0:13286:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1787338768.636943:0:13286:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import d79243c8-b367-45ff-8d76-fbaa4be8becb->MGS 00010000:00010000:0.0:1787338768.636960:0:13286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.153@tcp lock: ffff90bc02045400/0x83671231080c122c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x83671231080c1233 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787338768.636973:0:13286:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.153@tcp lock: ffff90bc02045400/0x83671231080c122c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x83671231080c1233 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787338768.636980:0:13286:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1787338768.636983:0:13286:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1787338768.636986:0:13286:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1787338768.637001:0:13286:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff90bbc9180800 00010000:00010000:0.0:1787338768.637005:0:13286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.153@tcp lock: ffff90bc02045400/0x83671231080c122c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x83671231080c1233 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338768.637030:0:13286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.153@tcp lock: ffff90bbc0030c00/0x83671231080c14a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x83671231080c14b0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787338768.637037:0:13286:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.153@tcp lock: ffff90bbc0030c00/0x83671231080c14a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x83671231080c14b0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787338768.637043:0:13286:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787338768.637045:0:13286:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1787338768.637046:0:13286:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1787338768.637053:0:13286:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff90bbc9180800 00010000:00010000:0.0:1787338768.637056:0:13286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.153@tcp lock: ffff90bbc0030c00/0x83671231080c14a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x83671231080c14b0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787338768.637076:0:13286:0:(import.c:65:import_set_state_nolock()) ffff90bbc9180800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1787338768.637080:0:13286:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1787338768.637082:0:13286:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1787338768.637083:0:13286:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1787338768.637088:0:13286:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1787338768.637099:0:13286:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff90bbfc01d880 x1874160212070400/t0(0) o250->MGC192.168.201.153@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1787338775 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1787338768.637116:0:13286:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1787338768.637118:0:13286:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00000020:00000080:1.0:1787338768.637231:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90bbfdb72000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:2.0:1787338768.637404:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc01d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d79243c8-b367-45ff-8d76-fbaa4be8becb:3313:1874160212070400:0@lo:250:ptlrpcd_00_00.0 10000000:01000000:0.0:1787338768.637614:0:13286:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1787338768.637621:0:13286:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x83671231080c110d 00000020:00000080:0.0:1787338768.637626:0:13286:0:(genops.c:885:class_export_put()) final put ffff90bbc2e86000/d79243c8-b367-45ff-8d76-fbaa4be8becb 00000020:01000000:0.0:1787338768.637640:0:13286:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.201.153@tcp (flags='') 00000020:00000080:0.0:1787338768.637645:0:13286:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787338768.637650:0:13286:0:(obd_config.c:956:class_cleanup()) MGC192.168.201.153@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787338768.637653:0:13286:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff90bbde3e99b8) has no exports 00000020:00000080:1.0:1787338768.637701:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90bbc2e86000/d79243c8-b367-45ff-8d76-fbaa4be8becb for MGC192.168.201.153@tcp 10000000:01000000:2.0:1787338768.637738:0:5836:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:0.0:1787338768.637807:0:13286:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.201.153@tcp: client import never connected 00000100:00080000:0.0:1787338768.637809:0:13286:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1787338768.637812:0:13286:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1787338768.637814:0:13286:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1787338768.637816:0:13286:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1787338768.637851:0:13286:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787338768.637856:0:13286:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.201.153@tcp (uuid d79243c8-b367-45ff-8d76-fbaa4be8becb) 00000020:01000000:0.0:1787338768.637860:0:13286:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1787338768.637863:0:13286:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787338768.637866:0:13286:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787338768.637870:0:13286:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff90bbfc2b9800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787338768.637897:0:13286:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff90bbfc24cd28) has exports, disconnecting them 00000020:00080000:0.0:1787338768.637901:0:13286:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff90bbfc2b9800), last request at 1787338564 00000020:00000080:0.0:1787338768.637905:0:13286:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x83671231080c1344 00000020:00080000:0.0:1787338768.637927:0:13286:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff90bbfc2b9800): rc 0 00000020:00000080:0.0:1787338768.637931:0:13286:0:(genops.c:885:class_export_put()) final put ffff90bbfc2b9800/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1787338768.638606:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90bbc9180800 for MGC192.168.201.153@tcp 00000020:00000080:1.0:1787338768.638614:0:37:0:(genops.c:885:class_export_put()) final put ffff90bbc9186800/d79243c8-b367-45ff-8d76-fbaa4be8becb 00000020:00000080:1.0:1787338768.638616:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90bbc9186800/d79243c8-b367-45ff-8d76-fbaa4be8becb for MGC192.168.201.153@tcp 00000020:01000000:1.0:1787338768.638621:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.201.153@tcp (d79243c8-b367-45ff-8d76-fbaa4be8becb) 00000020:00000080:1.0:1787338768.638893:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90bbfc2b9800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1787338768.640971:0:13286:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1787338768.640979:0:13286:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787338768.640982:0:13286:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787338768.640989:0:13286:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787338768.641242:0:11676:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00000020:00000080:1.0:1787338768.643810:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90bbf41a4000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:1.0:1787338768.643836:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1787338768.644093:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:0.0:1787338768.644283:0:11176:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff90bbde49c600:11176] 2 exiting: rc = 0 00000100:00100000:1.0:1787338768.644424:0:5822:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff90bbde5da200:5822] 1 exiting: rc = 0 00000100:00100000:1.0:1787338768.644503:0:5821:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff90bbc810f600:5821] 0 exiting: rc = 1 00000100:00100000:0.0:1787338768.644581:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.644903:0:5823:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff90bbde5da000:5823] 0 exiting: rc = 1 00000100:00100000:1.0:1787338768.644963:0:5825:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff90bbde5daa00:5825] 2 exiting: rc = 0 00000100:00100000:3.0:1787338768.646482:0:12896:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_004: service thread [ffff90bbeb11d800:12896] 4 exiting: rc = 0 00000100:00100000:3.0:1787338768.646587:0:5824:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff90bbde5db600:5824] 1 exiting: rc = 0 00000100:00100000:3.0:1787338768.646673:0:6704:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff90bbedd60c00:6704] 3 exiting: rc = 0 00000100:00100000:0.0:1787338768.647198:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.647207:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.647214:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.647221:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.647228:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.647234:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.647240:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.647246:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.647252:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.647328:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.647335:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.647340:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.647347:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.647353:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.647366:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.647374:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.647381:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.647388:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.647394:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.647399:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.647405:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.647410:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.647415:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.647421:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.647426:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.647441:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.647446:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.647452:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.647457:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.647461:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.647466:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.647471:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.647476:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.647481:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.647486:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.647491:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.647497:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.647502:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.647508:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.647513:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.647518:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.647523:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.647529:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.647533:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.647538:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.647543:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.647549:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.647554:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.647560:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.647565:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.647571:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.647576:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.647581:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.647585:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.647590:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.647596:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.647601:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.647619:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.647627:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.647632:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.647644:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.647649:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.647656:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.647662:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1787338768.652401:0:13286:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787338768.652413:0:13286:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:0.0:1787338768.652419:0:13286:0:(genops.c:885:class_export_put()) final put ffff90bbf41a5800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:0.0:1787338768.652424:0:13286:0:(genops.c:844:class_export_destroy()) destroying export ffff90bbf41a5800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:0.0:1787338768.652431:0:13286:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:0.0:1787338768.652477:0:13286:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90bbff941800 1 00000020:00000080:0.0:1787338768.652483:0:13286:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x83671231080c12e9 00000020:00000080:0.0:1787338768.652489:0:13286:0:(genops.c:885:class_export_put()) final put ffff90bbff944000/lustre-OST0001-osd_UUID 00000020:01000000:0.0:1787338768.652506:0:13286:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:0.0:1787338768.652511:0:13286:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787338768.652516:0:13286:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787338768.652519:0:13286:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff90bbde3e8000) has no exports 00000020:00000080:1.0:1787338768.652673:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90bbff944000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1787338768.677967:0:13286:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787338768.677985:0:13286:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1787338768.677990:0:13286:0:(genops.c:885:class_export_put()) final put ffff90bbff946800/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1787338768.677995:0:13286:0:(genops.c:844:class_export_destroy()) destroying export ffff90bbff946800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1787338768.678005:0:13286:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1787338768.678632:0:13286:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff90bbff940800 00000020:01000000:1.0:1787338768.678652:0:13286:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1787338768.678657:0:13286:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787338768.678661:0:13286:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787338768.678666:0:13286:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff90bbee0a8000) has no exports 00000020:00000080:1.0:1787338768.678696:0:13286:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787338768.678704:0:13286:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1787338768.678706:0:13286:0:(genops.c:885:class_export_put()) final put ffff90bbc7cc6800/OSS_uuid 00000020:00000080:1.0:1787338768.678708:0:13286:0:(genops.c:844:class_export_destroy()) destroying export ffff90bbc7cc6800/OSS_uuid for OSS 00000020:01000000:1.0:1787338768.678714:0:13286:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:1.0:1787338768.678804:0:5835:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1787338768.678980:0:6689:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff90bbc95e5c00:6689] 0 exiting: rc = 1 00000100:00100000:1.0:1787338768.679088:0:6690:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff90bbc95e4c00:6690] 1 exiting: rc = 0 00000100:00100000:0.0:1787338768.680259:0:6691:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff90bbc95e4200:6691] 2 exiting: rc = 0 00000100:00100000:0.0:1787338768.680331:0:10743:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff90bbffd36400:10743] 3 exiting: rc = 0 00000100:00100000:1.0:1787338768.680537:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.680544:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.680551:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.680557:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.680565:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.680570:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.680576:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.680581:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.680587:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.680595:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.680601:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.680622:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.680627:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.680632:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.680637:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.680642:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.680646:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.680652:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.680658:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.680664:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.680670:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.680676:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.680681:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.680697:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.680705:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.680712:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.680717:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.680724:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.680730:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.680735:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.680812:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.680819:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.680823:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.680828:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.680834:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.680838:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.680842:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.680848:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.680857:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.680863:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.680868:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.680891:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.680897:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.680902:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.680907:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.680912:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.680924:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.680929:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.680934:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.680940:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.680945:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.680950:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.680955:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.680961:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.680967:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.680975:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.680981:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.680986:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.680991:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.680997:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.681002:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.681007:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.681077:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.681096:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.683786:0:6693:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff90bbee09f400:6693] 1 exiting: rc = 0 00000100:00100000:2.0:1787338768.684018:0:6692:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff90bbee09fa00:6692] 0 exiting: rc = 1 00000100:00100000:1.0:1787338768.684133:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.684142:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.684148:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.684153:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.684158:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.684163:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.684168:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.684656:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.684662:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.684667:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.684673:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.684677:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.684682:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.684696:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.684702:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.684708:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.684713:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.684731:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.684736:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.685103:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.685111:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.685115:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.685120:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.685125:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.685130:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.685136:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.685141:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.685146:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.685151:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.685160:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.685165:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.685171:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.685175:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.685180:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.685185:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.685189:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.685194:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.685198:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.685203:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.685208:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.685214:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.685219:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.685224:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.685230:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.685239:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.685244:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.685249:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.685429:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.685434:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.685439:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.685541:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.685549:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.685561:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.685567:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.685573:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.685578:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.685582:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.685587:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.685592:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.685596:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.685602:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.685607:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.685612:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.685618:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.689230:0:6694:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff90bbee09e400:6694] 0 exiting: rc = 1 00000100:00100000:2.0:1787338768.689513:0:6695:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff90bbedd60e00:6695] 1 exiting: rc = 0 00000100:00100000:3.0:1787338768.690028:0:6696:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff90bbedd61e00:6696] 2 exiting: rc = 0 00000100:00100000:1.0:1787338768.690116:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.690127:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.690134:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.690140:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.690145:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.690151:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.690157:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.690163:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.690169:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.690175:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.690180:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.690185:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.690190:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.690196:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.690202:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.690208:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.690214:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.690219:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.690226:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.690232:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.690237:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.690244:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.690251:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.690294:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.690300:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.690306:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.690311:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.690316:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.690321:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.690327:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.690332:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.690338:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.690344:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.690349:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.690355:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.690361:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.690371:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.690376:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.690382:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.690388:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.690393:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.690398:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.690405:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.690410:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.690415:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.690421:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.690427:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.690547:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.690554:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.690560:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.690566:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.690572:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.690579:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.690585:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.690591:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.690597:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.690603:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.690618:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.690631:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.690636:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.690642:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.690648:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.690654:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.690660:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787338768.695752:0:6697:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff90bbedd61000:6697] 0 exiting: rc = 1 00000100:00100000:0.0:1787338768.695906:0:6698:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff90bbedd61400:6698] 1 exiting: rc = 0 00000100:00100000:1.0:1787338768.695952:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.695960:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.695966:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.695971:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.695977:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.695983:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.695996:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.696003:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.696008:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.696137:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.696144:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.696149:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.696154:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.696161:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.696166:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.696238:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.696246:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.696310:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.696317:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.696322:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.696328:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.696332:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.696336:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.696339:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.696343:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.696346:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.696349:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.696352:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.696354:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.696367:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.696370:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.696374:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.696377:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.696380:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.696383:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.696386:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.696388:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.696391:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.696394:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.696398:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.696401:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.696404:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.696407:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.696411:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.696414:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.696417:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.696420:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.696423:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.696425:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.696428:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.696431:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.696435:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.696437:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.696440:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.696492:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.696497:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.696500:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.696503:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.696506:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.696509:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.696512:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.696515:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.696518:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338768.696521:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787338768.698376:0:6699:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff90bbd0c3fe00:6699] 0 exiting: rc = 1 00000100:00100000:2.0:1787338768.704828:0:6700:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff90bbd0c3e200:6700] 1 exiting: rc = 0 00000100:00100000:0.0:1787338768.705136:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.705145:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.705167:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.705176:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.705183:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.705189:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.705195:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.705202:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.705208:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.705214:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.705221:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.705250:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.705257:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.705262:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.705268:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.705273:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.705279:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.705285:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.705292:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.705299:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.705304:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.705310:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.705316:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.705336:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.705343:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.705349:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.705355:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.705361:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.705366:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.705372:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.705377:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.705384:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.705390:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.705824:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.705833:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.705852:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.705859:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.705865:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.705871:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.705946:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.705952:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.705957:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.705963:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.705970:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.705975:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.705981:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.705995:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.706014:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.706022:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.706027:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.706033:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.706041:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.706047:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.706053:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.706059:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.706067:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.706073:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.706080:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.706088:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.706108:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.706115:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.706121:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.706127:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338768.706141:0:13286:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1787338768.716301:0:13286:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1787338785.921848:0:13902:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg153-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1787338794.881640:0:14363:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787338794.881645:0:14363:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1787338794.881767:0:14363:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff90bbc8428000 00000020:01000004:2.0:1787338794.881791:0:14363:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1787338794.881806:0:14363:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1787338794.881830:0:14363:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff90bbee0acd28) 00000020:00000080:2.0:1787338794.881843:0:14363:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787338794.900265:0:14363:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1787338794.902520:0:14363:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:3.0:1787338794.903095:0:14363:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1787338794.903161:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 431: rc = 0 00100000:10000000:3.0:1787338794.903263:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 431: rc = 0 00100000:10000000:3.0:1787338794.903372:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 431: rc = 0 00100000:10000000:3.0:1787338794.903446:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 431: rc = 0 00100000:10000000:3.0:1787338794.903520:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 431: rc = 0 00100000:10000000:3.0:1787338794.903593:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 431: rc = 0 00100000:10000000:3.0:1787338794.903981:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 40: rc = 0 00100000:10000000:3.0:1787338794.905052:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 577: rc = 0 00100000:10000000:3.0:1787338794.905147:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 577: rc = 0 00100000:10000000:3.0:1787338794.905664:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 191: rc = 0 00100000:10000000:3.0:1787338794.906227:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 191: rc = 0 00100000:10000000:3.0:1787338794.906482:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 191: rc = 0 00100000:10000000:3.0:1787338794.907133:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 191: rc = 0 00100000:10000000:3.0:1787338794.907404:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 191: rc = 0 00100000:10000000:3.0:1787338794.907654:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 191: rc = 0 00100000:10000000:3.0:1787338794.908096:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 191: rc = 0 00100000:10000000:3.0:1787338794.908342:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 191: rc = 0 00100000:10000000:3.0:1787338794.908591:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 191: rc = 0 00100000:10000000:3.0:1787338794.909116:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 191: rc = 0 00100000:10000000:3.0:1787338794.909381:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 191: rc = 0 00100000:10000000:3.0:1787338794.909646:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 191: rc = 0 00100000:10000000:3.0:1787338794.910330:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 207: rc = 0 00100000:10000000:3.0:1787338794.910576:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 207: rc = 0 00100000:10000000:3.0:1787338794.911024:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 207: rc = 0 00100000:10000000:3.0:1787338794.911294:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 207: rc = 0 00100000:10000000:3.0:1787338794.911530:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 207: rc = 0 00100000:10000000:3.0:1787338794.912512:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 207: rc = 0 00100000:10000000:3.0:1787338794.913211:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 207: rc = 0 00100000:10000000:3.0:1787338794.913500:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 207: rc = 0 00100000:10000000:3.0:1787338794.914024:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 207: rc = 0 00100000:10000000:3.0:1787338794.914303:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 207: rc = 0 00100000:10000000:3.0:1787338794.914552:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 207: rc = 0 00100000:10000000:3.0:1787338794.915038:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 207: rc = 0 00100000:10000000:3.0:1787338794.915283:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 207: rc = 0 00100000:10000000:3.0:1787338794.915545:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 207: rc = 0 00100000:10000000:3.0:1787338794.915973:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 207: rc = 0 00100000:10000000:3.0:1787338794.916260:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 207: rc = 0 00100000:10000000:3.0:1787338794.916505:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 207: rc = 0 00100000:10000000:3.0:1787338794.916983:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 207: rc = 0 00100000:10000000:3.0:1787338794.917260:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 207: rc = 0 00100000:10000000:3.0:1787338794.917527:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 207: rc = 0 00100000:10000000:3.0:1787338794.917985:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 207: rc = 0 00100000:10000000:3.0:1787338794.918226:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 207: rc = 0 00100000:10000000:3.0:1787338794.918473:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 207: rc = 0 00100000:10000000:3.0:1787338794.918939:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 207: rc = 0 00100000:10000000:3.0:1787338794.919187:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 207: rc = 0 00100000:10000000:3.0:1787338794.919446:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 207: rc = 0 00100000:10000000:3.0:1787338794.919747:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 207: rc = 0 00100000:10000000:3.0:1787338794.920044:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 207: rc = 0 00100000:10000000:3.0:1787338794.920311:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 207: rc = 0 00100000:10000000:3.0:1787338794.920549:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 207: rc = 0 00100000:10000000:3.0:1787338794.921044:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 207: rc = 0 00100000:10000000:3.0:1787338794.921304:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 207: rc = 0 00100000:10000000:3.0:1787338794.921656:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 583: rc = 0 00100000:10000000:3.0:1787338794.922571:0:14363:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:3.0:1787338794.922791:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 436: rc = 0 00100000:10000000:3.0:1787338794.923114:0:14363:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:3.0:1787338794.923173:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 436: rc = 0 00100000:10000000:3.0:1787338794.923365:0:14363:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:3.0:1787338794.923418:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 436: rc = 0 00100000:10000000:3.0:1787338794.924020:0:14363:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:3.0:1787338794.924093:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 578: rc = 0 00100000:10000000:3.0:1787338794.924294:0:14363:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:3.0:1787338794.924361:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 578: rc = 0 00100000:10000000:3.0:1787338794.924561:0:14363:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:3.0:1787338794.924628:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 578: rc = 0 00000020:00000080:3.0:1787338794.925113:0:14363:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1787338794.925123:0:14363:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787338794.925135:0:14363:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x83671231080c240e 00000020:01000004:3.0:1787338794.925145:0:14363:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1787338794.925151:0:14363:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1787338794.925157:0:14363:0:(tgt_mount.c:101:server_register_mount()) register mount ffff90bbc8428000 from MGS 00000020:01000004:3.0:1787338794.925161:0:14363:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1787338794.925172:0:14363:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff90bbfc24b370) 00000020:00000080:3.0:1787338794.925192:0:14363:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1787338794.925269:0:14363:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90bbc8428000 from MGS, refs=2 00080000:01000000:3.0:1787338794.925275:0:14363:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787338794.925280:0:14363:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x83671231080c241c 00000100:00100000:3.0:1787338794.925375:0:14363:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1787338794.925746:0:14363:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1787338794.925752:0:14363:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1787338794.926382:0:14363:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1787338794.926389:0:14363:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1787338794.927237:0:14363:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787338794.927414:0:14363:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1787338794.927421:0:14363:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1787338794.928157:0:14363:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1787338794.928164:0:14363:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1787338794.928472:0:14363:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1787338794.928477:0:14363:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1787338794.929251:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338794.929254:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338794.929256:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338794.929507:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338794.929510:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338794.929512:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338794.930279:0:14363:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1787338794.937930:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1787338794.943543:0:14363:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1787338794.943566:0:14363:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787338794.943569:0:14363:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1787338794.945150:0:14372:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1787338794.945377:0:14363:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1787338794.945479:0:14363:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787338794.946060:0:14363:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1787338794.946405:0:14363:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787338794.946597:0:14363:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1787338794.946603:0:14363:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1787338794.953806:0:14363:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1787338794.953833:0:14363:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1787338794.956241:0:14363:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1787338794.956254:0:14363:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1787338794.957098:0:14363:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1787338794.957125:0:14363:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.153@tcp' 00000020:01000004:2.0:1787338794.957127:0:14363:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1787338794.957162:0:14363:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.153@tcp (typ=mgc) 00000020:00000080:2.0:1787338794.957177:0:14363:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.153@tcp (ffff90bbee0a99b8) 00000020:00000080:2.0:1787338794.957195:0:14363:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1787338794.957285:0:14363:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90bbc842d800@MGC192.168.201.153@tcp: add connection 192.168.201.153@tcp at head 00010000:00010000:2.0:1787338794.957452:0:14363:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.153@tcp-0 is initialized 00000040:01000000:2.0:1787338794.957458:0:14363:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.153@tcp ctxt 1 is initialized 00000100:00080000:1.0:1787338794.964597:0:14377:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1787338794.967811:0:14378:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1787338794.968109:0:14363:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.153@tcp (uuid 2c0e6575-df80-419a-8cc7-cbad06c93254) 00000020:00000080:3.0:1787338794.968140:0:14363:0:(genops.c:1385:class_connect()) connect: client 2c0e6575-df80-419a-8cc7-cbad06c93254, cookie 0x83671231080c242a 00000100:00080000:3.0:1787338794.968153:0:14363:0:(import.c:510:import_select_connection()) MGC192.168.201.153@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787338794.968160:0:14363:0:(import.c:624:import_select_connection()) MGC192.168.201.153@tcp: import ffff90bbc842d800 using connection 192.168.201.153@tcp/0@lo 00000100:00100000:3.0:1787338794.968192:0:14363:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90bbedcb4700 x1874160212070656/t0(0) o250->MGC192.168.201.153@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787338794.968224:0:14363:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 2c0e6575-df80-419a-8cc7-cbad06c93254->MGS 00000020:01000004:3.0:1787338794.968265:0:14363:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1787338794.968271:0:14363:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1787338794.968296:0:14363:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff90bbfc24cd28) 00000020:00000080:3.0:1787338794.968310:0:14363:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1787338794.971343:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbedcb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2c0e6575-df80-419a-8cc7-cbad06c93254:3313:1874160212070656:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1787338794.971436:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338794.982784:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212070656 00000100:00100000:0.0:1787338794.982807:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212070656 00000100:00100000:0.0:1787338794.982870:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787338794.982907:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbff826450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3313:x1874160212070656:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1787338794.982941:0:14373:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 2c0e6575-df80-419a-8cc7-cbad06c93254@0@lo t0 exp 0000000000000000 cur 447 last 0 00000020:00000080:0.0:1787338794.982975:0:14373:0:(genops.c:1385:class_connect()) connect: client 2c0e6575-df80-419a-8cc7-cbad06c93254, cookie 0x83671231080c2438 00000100:00080000:0.0:1787338794.983131:0:14373:0:(import.c:65:import_set_state_nolock()) ffff90bac27d5800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787338794.983246:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbff826450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c0e6575-df80-419a-8cc7-cbad06c93254+5:3313:x1874160212070656:12345-0@lo:250:mount.lustre.0 Request processed in 340us (11808us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338794.983254:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787338794.986768:0:14363:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787338794.987078:0:14363:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1787338794.987086:0:14363:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1787338794.987529:0:3313:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.201.153@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1787338794.987541:0:3313:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.153@tcp: connect to target with instance 0 00000100:00080000:2.0:1787338794.987551:0:3313:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.201.153@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1787338794.987557:0:3313:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1787338794.987561:0:3313:0:(import.c:65:import_set_state_nolock()) ffff90bbc842d800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1787338794.987565:0:3313:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1787338794.987583:0:3313:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1787338794.987592:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbedcb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2c0e6575-df80-419a-8cc7-cbad06c93254:3313:1874160212070656:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1787338794.995497:0:14363:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1787338794.995512:0:14363:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1787338794.995868:0:14363:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1787338794.995970:0:14363:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1787338795.002026:0:14363:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787338795.002276:0:14363:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1787338795.002283:0:14363:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1787338795.007307:0:14363:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1787338795.007325:0:14363:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1787338795.056607:0:14363:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787338795.056868:0:14363:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1787338795.057205:0:14363:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1787338795.061562:0:14363:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1787338795.061582:0:14363:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1787338795.062281:0:14363:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787338795.062491:0:14363:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787338795.062497:0:14363:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1787338795.063171:0:14363:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787338795.063179:0:14363:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1787338795.063665:0:14363:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787338795.063834:0:14363:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787338795.063840:0:14363:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1787338795.064453:0:14363:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787338795.064461:0:14363:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1787338795.065094:0:14363:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787338795.065272:0:14363:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787338795.065278:0:14363:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1787338795.070931:0:14363:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787338795.070956:0:14363:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1787338795.110867:0:14363:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787338795.111126:0:14363:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787338795.111133:0:14363:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1787338795.112572:0:14363:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1787338795.112584:0:14363:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1787338795.113450:0:14363:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1787338795.113460:0:14363:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1787338795.114260:0:14363:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1787338795.114291:0:14363:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1787338795.114298:0:14363:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.153@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1787338795.114450:0:14363:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.153@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787338795.114491:0:14363:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.153@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1787338795.114496:0:14363:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787338795.114497:0:14363:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787338795.114499:0:14363:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787338795.114500:0:14363:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787338795.114502:0:14363:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787338795.114503:0:14363:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787338795.114505:0:14363:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787338795.114507:0:14363:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787338795.114509:0:14363:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787338795.114515:0:14363:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787338795.114518:0:14363:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1787338795.114520:0:14363:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787338795.114521:0:14363:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787338795.114522:0:14363:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787338795.114523:0:14363:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787338795.114523:0:14363:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787338795.114524:0:14363:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787338795.114525:0:14363:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787338795.114526:0:14363:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787338795.114527:0:14363:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787338795.114528:0:14363:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787338795.114560:0:14363:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787338795.114582:0:14363:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc01d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c0e6575-df80-419a-8cc7-cbad06c93254:14363:1874160212070784:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787338795.114743:0:14363:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338795.114847:0:14363:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc818c9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787338795.115513:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212070784 00000100:00100000:1.0:1787338795.115523:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212070784 00000100:00100000:1.0:1787338795.115578:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787338795.115589:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbff824050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c0e6575-df80-419a-8cc7-cbad06c93254+5:14363:x1874160212070784:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787338795.115651:0:14376:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787338795.115655:0:14376:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1787338795.115658:0:14376:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:2.0:1787338795.116180:0:14397:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1787338795.116596:0:14376:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:2.0:1787338795.119818:0:14398:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1787338795.119829:0:14398:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1787338795.119831:0:14398:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1787338795.119868:0:14398:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:1.0:1787338795.123430:0:14376:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787338795.123443:0:14376:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1787338795.139836:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbff824050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c0e6575-df80-419a-8cc7-cbad06c93254+5:14363:x1874160212070784:12345-0@lo:253:mount.lustre.0 Request processed in 24231us (25144us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338795.139856:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787338795.140171:0:14363:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc01d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c0e6575-df80-419a-8cc7-cbad06c93254:14363:1874160212070784:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787338795.140191:0:14363:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787338795.140195:0:14363:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787338795.140197:0:14363:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787338795.140199:0:14363:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787338795.140200:0:14363:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787338795.140201:0:14363:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787338795.140202:0:14363:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787338795.140203:0:14363:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787338795.140205:0:14363:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787338795.140207:0:14363:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787338795.140208:0:14363:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787338795.140240:0:14363:0:(tgt_mount.c:101:server_register_mount()) register mount ffff90bbc8428000 from lustre-MDT0000 10000000:01000000:2.0:1787338795.140267:0:14363:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1787338795.140270:0:14363:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1787338795.140286:0:14363:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff90bbee0a99b8 10000000:01000000:2.0:1787338795.140290:0:14363:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787338795.140298:0:14363:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff90bbee0a99b8 from 1 10000000:01000000:2.0:1787338795.140300:0:14363:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787338795.140349:0:14363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbf3c52600/0x83671231080c243f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338795.140360:0:14363:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.153@tcp lock: ffff90bbf3c52600/0x83671231080c243f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338795.140369:0:14363:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.153@tcp lock: ffff90bbf3c52600/0x83671231080c243f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338795.140388:0:14363:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc01d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c0e6575-df80-419a-8cc7-cbad06c93254:14363:1874160212070912:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787338795.140428:0:14363:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338795.140457:0:14363:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc818ccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787338795.140576:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212070912 00000100:00100000:1.0:1787338795.140583:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212070912 00000100:00100000:1.0:1787338795.140629:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787338795.140639:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbff824450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c0e6575-df80-419a-8cc7-cbad06c93254+5:14363:x1874160212070912:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787338795.140653:0:14375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787338795.140668:0:14375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90bbfbe9c000/0x83671231080c2446 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x83671231080c243f expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338795.140712:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bbfbe9c000/0x83671231080c2446 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x83671231080c243f expref: 6 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338795.140723:0:14375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90bbfbe9c000/0x83671231080c2446 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c243f expref: 6 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338795.140733:0:14375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbfbe9c000, rc 0) 00000100:00100000:1.0:1787338795.140771:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbff824450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c0e6575-df80-419a-8cc7-cbad06c93254+6:14363:x1874160212070912:12345-0@lo:101:mount.lustre.0 Request processed in 134us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338795.140778:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787338795.141096:0:14363:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc01d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c0e6575-df80-419a-8cc7-cbad06c93254:14363:1874160212070912:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787338795.141111:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.153@tcp lock: ffff90bbf3c52600/0x83671231080c243f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c2446 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338795.141121:0:14363:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.153@tcp lock: ffff90bbf3c52600/0x83671231080c243f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x83671231080c2446 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338795.141181:0:14363:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc01d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c0e6575-df80-419a-8cc7-cbad06c93254:14363:1874160212071040:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787338795.141209:0:14363:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338795.141241:0:14363:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc818ccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787338795.141355:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212071040 00000100:00100000:1.0:1787338795.141360:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212071040 00000100:00100000:1.0:1787338795.141394:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787338795.141402:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbff825850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c0e6575-df80-419a-8cc7-cbad06c93254+6:14363:x1874160212071040:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787338795.141810:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbff825850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c0e6575-df80-419a-8cc7-cbad06c93254+6:14363:x1874160212071040:12345-0@lo:501:mount.lustre.0 Request processed in 407us (599us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787338795.141819:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787338795.146544:0:14363:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc01d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c0e6575-df80-419a-8cc7-cbad06c93254:14363:1874160212071040:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1787338795.146601:0:14363:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.153@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787338795.146617:0:14363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbf3c52600/0x83671231080c243f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c2446 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338795.146629:0:14363:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.153@tcp lock: ffff90bbf3c52600/0x83671231080c243f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c2446 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787338795.146639:0:14363:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff90bbc8428000 10000000:01000000:3.0:1787338795.146648:0:14363:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787338795.146653:0:14363:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff90bbc8428000 10000000:01000000:3.0:1787338795.146656:0:14363:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1787338795.146659:0:14363:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff90bbc8428000 from 1 10000000:01000000:3.0:1787338795.146662:0:14363:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1787338795.146709:0:14363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbf7ea5200/0x83671231080c244d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338795.146718:0:14363:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.153@tcp lock: ffff90bbf7ea5200/0x83671231080c244d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338795.146729:0:14363:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.153@tcp lock: ffff90bbf7ea5200/0x83671231080c244d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338795.146766:0:14363:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbedcb5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c0e6575-df80-419a-8cc7-cbad06c93254:14363:1874160212071168:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787338795.147094:0:14363:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338795.147191:0:14363:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbf43d8cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787338795.158559:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212071168 00000100:00100000:0.0:1787338795.158577:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212071168 00000100:00100000:0.0:1787338795.158643:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787338795.158655:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbff827050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c0e6575-df80-419a-8cc7-cbad06c93254+6:14363:x1874160212071168:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787338795.158672:0:14373:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787338795.158707:0:14373:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90bbffef4800/0x83671231080c2454 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x83671231080c244d expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338795.158734:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bbffef4800/0x83671231080c2454 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x83671231080c244d expref: 7 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338795.158745:0:14373:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90bbffef4800/0x83671231080c2454 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c244d expref: 7 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338795.158755:0:14373:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbffef4800, rc 0) 00000100:00100000:0.0:1787338795.158858:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbff827050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c0e6575-df80-419a-8cc7-cbad06c93254+7:14363:x1874160212071168:12345-0@lo:101:mount.lustre.0 Request processed in 205us (11765us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338795.158866:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787338795.160352:0:14363:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbedcb5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c0e6575-df80-419a-8cc7-cbad06c93254:14363:1874160212071168:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787338795.160382:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.153@tcp lock: ffff90bbf7ea5200/0x83671231080c244d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c2454 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338795.160394:0:14363:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.153@tcp lock: ffff90bbf7ea5200/0x83671231080c244d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x83671231080c2454 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787338795.160414:0:14363:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.153@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1787338795.160432:0:14363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbf7ea5200/0x83671231080c244d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c2454 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338795.160440:0:14363:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.153@tcp lock: ffff90bbf7ea5200/0x83671231080c244d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c2454 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787338795.160447:0:14363:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787338795.160454:0:14363:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787338795.160459:0:14363:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff90bbc8428000 10000000:01000000:3.0:1787338795.160464:0:14363:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1787338795.160468:0:14363:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1787338795.160470:0:14363:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787338795.160498:0:14363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbf7ea5000/0x83671231080c245b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338795.160506:0:14363:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.153@tcp lock: ffff90bbf7ea5000/0x83671231080c245b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338795.160530:0:14363:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.153@tcp lock: ffff90bbf7ea5000/0x83671231080c245b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338795.160549:0:14363:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbedcb5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c0e6575-df80-419a-8cc7-cbad06c93254:14363:1874160212071296:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787338795.160605:0:14363:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338795.160654:0:14363:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbf43d8cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787338795.160981:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212071296 00000100:00100000:2.0:1787338795.160988:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212071296 00000100:00100000:2.0:1787338795.161045:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787338795.161064:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbff827450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c0e6575-df80-419a-8cc7-cbad06c93254+7:14363:x1874160212071296:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787338795.161076:0:14375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787338795.161089:0:14375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90bbf3c53a00/0x83671231080c2462 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x83671231080c245b expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338795.161110:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bbf3c53a00/0x83671231080c2462 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x83671231080c245b expref: 8 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338795.161120:0:14375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90bbf3c53a00/0x83671231080c2462 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c245b expref: 8 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338795.161128:0:14375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf3c53a00, rc 0) 00000100:00100000:2.0:1787338795.161185:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbff827450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c0e6575-df80-419a-8cc7-cbad06c93254+8:14363:x1874160212071296:12345-0@lo:101:mount.lustre.0 Request processed in 123us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338795.161192:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787338795.162287:0:14363:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbedcb5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c0e6575-df80-419a-8cc7-cbad06c93254:14363:1874160212071296:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787338795.162312:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.153@tcp lock: ffff90bbf7ea5000/0x83671231080c245b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c2462 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338795.162324:0:14363:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.153@tcp lock: ffff90bbf7ea5000/0x83671231080c245b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x83671231080c2462 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338795.162423:0:14363:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbedcb5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c0e6575-df80-419a-8cc7-cbad06c93254:14363:1874160212071424:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787338795.162465:0:14363:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338795.162504:0:14363:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbf43d8cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787338795.162814:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212071424 00000100:00100000:2.0:1787338795.162820:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212071424 00000100:00100000:2.0:1787338795.162864:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787338795.162923:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc67c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c0e6575-df80-419a-8cc7-cbad06c93254+8:14363:x1874160212071424:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787338795.163380:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc67c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c0e6575-df80-419a-8cc7-cbad06c93254+9:14363:x1874160212071424:12345-0@lo:501:mount.lustre.0 Request processed in 505us (913us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338795.163388:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787338795.163700:0:14363:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbedcb5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c0e6575-df80-419a-8cc7-cbad06c93254:14363:1874160212071424:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787338795.163744:0:14363:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc4095880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c0e6575-df80-419a-8cc7-cbad06c93254:14363:1874160212071552:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787338795.163785:0:14363:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338795.163824:0:14363:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbd16a23c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787338795.163969:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212071552 00000100:00100000:2.0:1787338795.163974:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212071552 00000100:00100000:2.0:1787338795.164000:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787338795.164007:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc67c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c0e6575-df80-419a-8cc7-cbad06c93254+9:14363:x1874160212071552:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787338795.164402:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc67c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c0e6575-df80-419a-8cc7-cbad06c93254+9:14363:x1874160212071552:12345-0@lo:503:mount.lustre.0 Request processed in 394us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338795.164419:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787338795.164835:0:14363:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc4095880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c0e6575-df80-419a-8cc7-cbad06c93254:14363:1874160212071552:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787338795.166037:0:14399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc01e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c0e6575-df80-419a-8cc7-cbad06c93254:14399:1874160212071680:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787338795.166103:0:14399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338795.166251:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212071680 00000100:00100000:3.0:1787338795.166258:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212071680 00000100:00100000:3.0:1787338795.166302:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787338795.166311:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc67c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c0e6575-df80-419a-8cc7-cbad06c93254+9:14399:x1874160212071680:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787338795.166629:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc67c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c0e6575-df80-419a-8cc7-cbad06c93254+9:14399:x1874160212071680:12345-0@lo:502:llog_process_th.0 Request processed in 318us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338795.166637:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787338795.166978:0:14399:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc6171180 going to sleep for 11 seconds 00000100:00100000:2.0:1787338795.167002:0:14399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc01e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c0e6575-df80-419a-8cc7-cbad06c93254:14399:1874160212071680:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787338795.167033:0:14399:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787338795.167045:0:14399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787338795.167048:0:14399:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1787338795.167053:0:14399:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1787338795.167057:0:14399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787338795.167071:0:14399:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff90bbee0ab370) 00000020:00000080:2.0:1787338795.167089:0:14399:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1787338795.167095:0:14399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1787338795.167773:0:14399:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:2.0:1787338795.167783:0:14399:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x83671231080c2470 00000020:00000080:2.0:1787338795.168102:0:14399:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1787338795.168110:0:14399:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787338795.168114:0:14399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787338795.168116:0:14399:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1787338795.168119:0:14399:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787338795.168123:0:14399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787338795.168125:0:14399:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1787338795.168128:0:14399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787338795.168138:0:14399:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff90bbee0a8000) 00000020:00000080:2.0:1787338795.168755:0:14399:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1787338795.168763:0:14399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1787338795.168766:0:14399:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1787338795.168768:0:14399:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1787338795.168775:0:14399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787338795.168942:0:14399:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90bbc8428000 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1787338795.168958:0:14399:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff90bbd1730000) 00000020:00000080:2.0:1787338795.168966:0:14399:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1787338795.169012:0:14399:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1787338795.169018:0:14399:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x83671231080c2485 00000020:00000080:2.0:1787338795.169122:0:14399:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1787338795.169129:0:14399:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1787338795.169133:0:14399:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x83671231080c248c 00080000:01000000:2.0:1787338795.169138:0:14399:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:2.0:1787338795.169747:0:14399:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x83671231080c2493 00010000:00010000:3.0:1787338795.267467:0:14399:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1787338795.269211:0:14399:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:3.0:1787338795.269470:0:14399:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1787338795.270372:0:14399:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff90bbfc248000) 00000020:00000080:3.0:1787338795.270394:0:14399:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1787338795.270471:0:14399:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:3.0:1787338795.270479:0:14399:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x83671231080c24a1 00000020:00000080:0.0:1787338795.273520:0:14399:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1787338795.281691:0:14399:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x83671231080c24a8 00000020:00000080:1.0:1787338795.282357:0:14399:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1787338795.282369:0:14399:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787338795.282377:0:14399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787338795.282379:0:14399:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1787338795.282383:0:14399:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787338795.282390:0:14399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787338795.282391:0:14399:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1787338795.282396:0:14399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1787338795.282439:0:14399:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1787338795.282452:0:14399:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787338795.282456:0:14399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787338795.282466:0:14399:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1787338795.282469:0:14399:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787338795.282471:0:14399:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #10 00000020:01000000:1.0:1787338795.282474:0:14399:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787338795.282476:0:14399:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787338795.282477:0:14399:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787338795.282480:0:14399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787338795.282481:0:14399:0:(obd_config.c:1563:class_process_config()) marker 10 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787338795.282484:0:14399:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787338795.282486:0:14399:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1787338795.282490:0:14399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787338795.282491:0:14399:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1787338795.282494:0:14399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787338795.282500:0:14399:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.153@tcp to nid 0x20000c0a8c999 (192.168.201.153@tcp) 00000020:01000000:1.0:1787338795.282525:0:14399:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1787338795.282528:0:14399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787338795.282541:0:14399:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff90bbffd84d28) 00000020:00000080:1.0:1787338795.282556:0:14399:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1787338795.282561:0:14399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787338795.282624:0:14399:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1787338795.282629:0:14399:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:1.0:1787338795.282636:0:14399:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x83671231080c24b6 00010000:00080000:1.0:1787338795.282665:0:14399:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90bbc93ac800@lustre-OST0000-osc-MDT0000: add connection 192.168.201.153@tcp at head 00010000:00010000:1.0:1787338795.283029:0:14399:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:1.0:1787338795.284787:0:14399:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1787338795.285002:0:14399:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1787338795.286275:0:14399:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787338795.286354:0:14399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1787338795.286423:0:14399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:0.0:1787338795.295042:0:14403:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787338795.295051:0:14403:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1787338795.297673:0:14399:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787338795.297689:0:14399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787338795.297752:0:14399:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1787338795.297785:0:14399:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x83671231080c24bd 00000100:00080000:0.0:1787338795.297796:0:14399:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787338795.297802:0:14399:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff90bbc93ac800 using connection 192.168.201.153@tcp/0@lo 00000100:00100000:0.0:1787338795.297838:0:14399:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90bbc4095880 x1874160212071808/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787338795.297868:0:14399:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1787338795.297955:0:14399:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787338795.297959:0:14399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787338795.297961:0:14399:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1787338795.297965:0:14399:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787338795.297967:0:14399:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:0.0:1787338795.297969:0:14399:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787338795.297971:0:14399:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787338795.297972:0:14399:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787338795.297974:0:14399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787338795.297976:0:14399:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787338795.297978:0:14399:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787338795.297983:0:14399:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1787338795.297987:0:14399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787338795.297988:0:14399:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1787338795.297991:0:14399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787338795.297995:0:14399:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.153@tcp to nid 0x20000c0a8c999 (192.168.201.153@tcp) 00000020:01000000:0.0:1787338795.298018:0:14399:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1787338795.298021:0:14399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787338795.298033:0:14399:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff90bbde3eb370) 00000020:00000080:0.0:1787338795.298053:0:14399:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1787338795.298058:0:14399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787338795.298126:0:14399:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1787338795.298132:0:14399:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:0.0:1787338795.298143:0:14399:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x83671231080c24cb 00010000:00080000:0.0:1787338795.298174:0:14399:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90bbf40f3800@lustre-OST0001-osc-MDT0000: add connection 192.168.201.153@tcp at head 00010000:00010000:0.0:1787338795.298378:0:14399:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:0.0:1787338795.298572:0:14399:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1787338795.298596:0:14399:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1787338795.299147:0:14399:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787338795.299220:0:14399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1787338795.299308:0:14399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000100:00100000:2.0:1787338795.299535:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc4095880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1874160212071808:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1787338795.299592:0:3313:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874160212071808 offset 0 length 520: 4 00000040:00080000:1.0:1787338795.301099:0:14405:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787338795.301105:0:14405:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1787338795.303930:0:14399:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787338795.303947:0:14399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787338795.303988:0:14399:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1787338795.304010:0:14399:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x83671231080c24d2 00000100:00080000:2.0:1787338795.304020:0:14399:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787338795.304026:0:14399:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff90bbf40f3800 using connection 192.168.201.153@tcp/0@lo 00000100:00100000:2.0:1787338795.304062:0:14399:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90bbfc01e680 x1874160212071936/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787338795.304092:0:14399:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1787338795.304175:0:14399:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787338795.304179:0:14399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787338795.304181:0:14399:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1787338795.304184:0:14399:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787338795.304189:0:14399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787338795.304190:0:14399:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787338795.304194:0:14399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787338795.304196:0:14399:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787338795.304198:0:14399:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787338795.304200:0:14399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787338795.304215:0:14399:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787338795.304219:0:14399:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787338795.304231:0:14399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787338795.304233:0:14399:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787338795.304238:0:14399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1787338795.304272:0:14399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc01c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c0e6575-df80-419a-8cc7-cbad06c93254:14399:1874160212072064:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787338795.304352:0:14399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338795.304393:0:14399:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc6171540 going to sleep for 11 seconds 00000100:00100000:1.0:1787338795.304468:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc01e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1874160212071936:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1787338795.304517:0:3313:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874160212071936 offset 0 length 520: 4 00000100:00100000:3.0:1787338795.304802:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212072064 00000100:00100000:3.0:1787338795.304811:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212072064 00000100:00100000:3.0:1787338795.304856:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787338795.304866:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc67c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c0e6575-df80-419a-8cc7-cbad06c93254+9:14399:x1874160212072064:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787338795.305741:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc67c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c0e6575-df80-419a-8cc7-cbad06c93254+9:14399:x1874160212072064:12345-0@lo:502:llog_process_th.0 Request processed in 874us (1386us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338795.305751:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787338795.306079:0:14399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc01c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c0e6575-df80-419a-8cc7-cbad06c93254:14399:1874160212072064:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787338795.306114:0:14399:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787338795.306121:0:14399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787338795.306123:0:14399:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787338795.306127:0:14399:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1787338795.306281:0:14363:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:0.0:1787338795.306306:0:14363:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.153@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787338795.306330:0:14363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbf7ea5000/0x83671231080c245b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c2462 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338795.306343:0:14363:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.153@tcp lock: ffff90bbf7ea5000/0x83671231080c245b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c2462 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787338795.306353:0:14363:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90bbc8428000 from 1 10000000:01000000:0.0:1787338795.306356:0:14363:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787338795.306393:0:14363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbffef5a00/0x83671231080c24d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338795.306401:0:14363:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.153@tcp lock: ffff90bbffef5a00/0x83671231080c24d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338795.306412:0:14363:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.153@tcp lock: ffff90bbffef5a00/0x83671231080c24d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338795.306429:0:14363:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc4096680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c0e6575-df80-419a-8cc7-cbad06c93254:14363:1874160212072192:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787338795.306470:0:14363:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338795.306496:0:14363:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbf42dd9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787338795.306555:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212072192 00000100:00100000:3.0:1787338795.306562:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212072192 00000100:00100000:3.0:1787338795.306596:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787338795.306605:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc67c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c0e6575-df80-419a-8cc7-cbad06c93254+9:14363:x1874160212072192:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787338795.306615:0:14376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787338795.306630:0:14376:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90bbf7ea4400/0x83671231080c24e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x83671231080c24d9 expref: -99 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338795.306652:0:14376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bbf7ea4400/0x83671231080c24e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x83671231080c24d9 expref: 10 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338795.306663:0:14376:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90bbf7ea4400/0x83671231080c24e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c24d9 expref: 10 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338795.306672:0:14376:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf7ea4400, rc 0) 00000100:00100000:3.0:1787338795.306699:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc67c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c0e6575-df80-419a-8cc7-cbad06c93254+10:14363:x1874160212072192:12345-0@lo:101:mount.lustre.0 Request processed in 96us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338795.306705:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787338795.306832:0:14363:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc4096680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c0e6575-df80-419a-8cc7-cbad06c93254:14363:1874160212072192:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787338795.306844:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.153@tcp lock: ffff90bbffef5a00/0x83671231080c24d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c24e0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338795.306854:0:14363:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.153@tcp lock: ffff90bbffef5a00/0x83671231080c24d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x83671231080c24e0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338795.309702:0:14363:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc4096680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c0e6575-df80-419a-8cc7-cbad06c93254:14363:1874160212072320:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1787338795.309794:0:14363:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338795.309841:0:14363:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbf42dd9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787338795.310027:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212072320 00000100:00100000:3.0:1787338795.310034:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212072320 00000100:00100000:3.0:1787338795.310105:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787338795.310117:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc67c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c0e6575-df80-419a-8cc7-cbad06c93254+10:14363:x1874160212072320:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1787338795.310137:0:14373:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1787338795.310144:0:14373:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1787338795.310241:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc67c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c0e6575-df80-419a-8cc7-cbad06c93254+10:14363:x1874160212072320:12345-0@lo:256:mount.lustre.0 Request processed in 126us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338795.310249:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787338795.310354:0:14363:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc4096680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c0e6575-df80-419a-8cc7-cbad06c93254:14363:1874160212072320:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1787338795.310987:0:14363:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.153@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787338795.311014:0:14363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbffef5a00/0x83671231080c24d9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c24e0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338795.311025:0:14363:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.153@tcp lock: ffff90bbffef5a00/0x83671231080c24d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c24e0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787338795.311034:0:14363:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90bbc8428000 from 1 10000000:01000000:2.0:1787338795.311036:0:14363:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787338795.311069:0:14363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbf3c52200/0x83671231080c24e7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338795.311078:0:14363:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.153@tcp lock: ffff90bbf3c52200/0x83671231080c24e7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338795.311087:0:14363:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.153@tcp lock: ffff90bbf3c52200/0x83671231080c24e7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338795.311151:0:14363:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc01c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c0e6575-df80-419a-8cc7-cbad06c93254:14363:1874160212072448:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787338795.311195:0:14363:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338795.311232:0:14363:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc6171540 going to sleep for 11 seconds 00000100:00100000:0.0:1787338795.311515:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212072448 00000100:00100000:0.0:1787338795.311521:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212072448 00000100:00100000:0.0:1787338795.311567:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787338795.311577:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc67c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c0e6575-df80-419a-8cc7-cbad06c93254+10:14363:x1874160212072448:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787338795.311588:0:14376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787338795.311603:0:14376:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90bbffef4a00/0x83671231080c24ee lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x83671231080c24e7 expref: -99 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338795.311627:0:14376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bbffef4a00/0x83671231080c24ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x83671231080c24e7 expref: 11 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338795.311638:0:14376:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90bbffef4a00/0x83671231080c24ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c24e7 expref: 11 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338795.311646:0:14376:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbffef4a00, rc 0) 00000100:00100000:0.0:1787338795.311691:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc67c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c0e6575-df80-419a-8cc7-cbad06c93254+11:14363:x1874160212072448:12345-0@lo:101:mount.lustre.0 Request processed in 116us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338795.311707:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787338795.311856:0:14363:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc01c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c0e6575-df80-419a-8cc7-cbad06c93254:14363:1874160212072448:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787338795.312015:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.153@tcp lock: ffff90bbf3c52200/0x83671231080c24e7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c24ee expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338795.312026:0:14363:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.153@tcp lock: ffff90bbf3c52200/0x83671231080c24e7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x83671231080c24ee expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338795.312086:0:14363:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc01c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c0e6575-df80-419a-8cc7-cbad06c93254:14363:1874160212072576:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787338795.312115:0:14363:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338795.312134:0:14363:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc6171540 going to sleep for 11 seconds 00000100:00100000:0.0:1787338795.312218:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212072576 00000100:00100000:0.0:1787338795.312232:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212072576 00000100:00100000:0.0:1787338795.312268:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787338795.312275:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc67c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c0e6575-df80-419a-8cc7-cbad06c93254+11:14363:x1874160212072576:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787338795.312768:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc67c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c0e6575-df80-419a-8cc7-cbad06c93254+11:14363:x1874160212072576:12345-0@lo:501:mount.lustre.0 Request processed in 491us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338795.312776:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787338795.313042:0:14363:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc01c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c0e6575-df80-419a-8cc7-cbad06c93254:14363:1874160212072576:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787338795.313080:0:14363:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbedcb7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c0e6575-df80-419a-8cc7-cbad06c93254:14363:1874160212072704:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787338795.313119:0:14363:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338795.313187:0:14363:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbf43d80c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787338795.313237:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212072704 00000100:00100000:0.0:1787338795.313242:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212072704 00000100:00100000:0.0:1787338795.313304:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787338795.313313:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc67c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c0e6575-df80-419a-8cc7-cbad06c93254+11:14363:x1874160212072704:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787338795.313501:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc67c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c0e6575-df80-419a-8cc7-cbad06c93254+11:14363:x1874160212072704:12345-0@lo:503:mount.lustre.0 Request processed in 188us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338795.313508:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787338795.313576:0:14363:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbedcb7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c0e6575-df80-419a-8cc7-cbad06c93254:14363:1874160212072704:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787338795.314097:0:14407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf4706d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c0e6575-df80-419a-8cc7-cbad06c93254:14407:1874160212072832:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787338795.314139:0:14407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338795.314201:0:14407:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbfffc1840 going to sleep for 11 seconds 00000100:00100000:0.0:1787338795.314238:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212072832 00000100:00100000:0.0:1787338795.314243:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212072832 00000100:00100000:0.0:1787338795.314305:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787338795.314313:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc67c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c0e6575-df80-419a-8cc7-cbad06c93254+11:14407:x1874160212072832:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787338795.314535:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc67c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c0e6575-df80-419a-8cc7-cbad06c93254+11:14407:x1874160212072832:12345-0@lo:502:llog_process_th.0 Request processed in 223us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338795.314543:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787338795.314611:0:14407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf4706d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c0e6575-df80-419a-8cc7-cbad06c93254:14407:1874160212072832:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787338795.314631:0:14407:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787338795.314640:0:14407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787338795.314642:0:14407:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787338795.314650:0:14407:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90bbc8428000 00000020:00000080:1.0:1787338795.314652:0:14407:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787338795.314659:0:14407:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787338795.314661:0:14407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787338795.314663:0:14407:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1787338795.314665:0:14407:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787338795.314667:0:14407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787338795.314668:0:14407:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787338795.314671:0:14407:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90bbc8428000 00000020:00000080:1.0:1787338795.314673:0:14407:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787338795.314816:0:14407:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787338795.314820:0:14407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787338795.314821:0:14407:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1787338795.314824:0:14407:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787338795.314827:0:14407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787338795.314828:0:14407:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787338795.314832:0:14407:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90bbc8428000 00000020:00000080:1.0:1787338795.314833:0:14407:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787338795.317974:0:14407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf4706d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c0e6575-df80-419a-8cc7-cbad06c93254:14407:1874160212072960:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787338795.318051:0:14407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338795.318086:0:14407:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbfffc1840 going to sleep for 11 seconds 00000100:00100000:0.0:1787338795.318188:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212072960 00000100:00100000:0.0:1787338795.318195:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212072960 00000100:00100000:0.0:1787338795.318260:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787338795.318271:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc67c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c0e6575-df80-419a-8cc7-cbad06c93254+11:14407:x1874160212072960:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787338795.318496:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc67c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c0e6575-df80-419a-8cc7-cbad06c93254+11:14407:x1874160212072960:12345-0@lo:502:llog_process_th.0 Request processed in 226us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338795.318504:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787338795.318555:0:14407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf4706d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c0e6575-df80-419a-8cc7-cbad06c93254:14407:1874160212072960:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787338795.318582:0:14407:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787338795.318589:0:14407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787338795.318592:0:14407:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1787338795.318596:0:14407:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1787338795.322030:0:14363:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1787338795.322061:0:14363:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787338795.322090:0:14363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbf3c52200/0x83671231080c24e7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c24ee expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338795.322103:0:14363:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.153@tcp lock: ffff90bbf3c52200/0x83671231080c24e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c24ee expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787338795.322151:0:14363:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787338795.322154:0:14363:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff90bbc8428000 10000000:01000000:2.0:1787338795.322157:0:14363:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff90bbc8428000 10000000:01000000:2.0:1787338795.322162:0:14363:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787338795.322168:0:14363:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90bbc8428000 from 1 10000000:01000000:2.0:1787338795.322171:0:14363:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787338795.322213:0:14363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbf3c52c00/0x83671231080c24f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338795.322231:0:14363:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.153@tcp lock: ffff90bbf3c52c00/0x83671231080c24f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338795.322244:0:14363:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.153@tcp lock: ffff90bbf3c52c00/0x83671231080c24f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338795.322269:0:14363:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc01d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c0e6575-df80-419a-8cc7-cbad06c93254:14363:1874160212073088:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787338795.322338:0:14363:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338795.322383:0:14363:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbd8e9a840 going to sleep for 11 seconds 00000100:00100000:2.0:1787338795.322407:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212073088 00000100:00100000:2.0:1787338795.322413:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212073088 00000100:00100000:2.0:1787338795.322454:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787338795.322463:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc67c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c0e6575-df80-419a-8cc7-cbad06c93254+11:14363:x1874160212073088:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787338795.322475:0:14376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787338795.322488:0:14376:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90bbf3c53600/0x83671231080c24fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x83671231080c24f5 expref: -99 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338795.322524:0:14376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bbf3c53600/0x83671231080c24fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x83671231080c24f5 expref: 12 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338795.322534:0:14376:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90bbf3c53600/0x83671231080c24fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c24f5 expref: 12 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338795.322543:0:14376:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf3c53600, rc 0) 00000100:00100000:2.0:1787338795.322581:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc67c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c0e6575-df80-419a-8cc7-cbad06c93254+12:14363:x1874160212073088:12345-0@lo:101:mount.lustre.0 Request processed in 118us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338795.322588:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787338795.322644:0:14363:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc01d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c0e6575-df80-419a-8cc7-cbad06c93254:14363:1874160212073088:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787338795.322659:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.153@tcp lock: ffff90bbf3c52c00/0x83671231080c24f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c24fc expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338795.322669:0:14363:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.153@tcp lock: ffff90bbf3c52c00/0x83671231080c24f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x83671231080c24fc expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338795.322716:0:14363:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc01d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c0e6575-df80-419a-8cc7-cbad06c93254:14363:1874160212073216:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787338795.322965:0:14363:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338795.330070:0:14363:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbd8e9a840 going to sleep for 11 seconds 00000100:00100000:1.0:1787338795.331434:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212073216 00000100:00100000:1.0:1787338795.331445:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212073216 00000100:00100000:1.0:1787338795.333018:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787338795.333038:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc67c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c0e6575-df80-419a-8cc7-cbad06c93254+12:14363:x1874160212073216:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787338795.333368:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc67c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c0e6575-df80-419a-8cc7-cbad06c93254+12:14363:x1874160212073216:12345-0@lo:501:mount.lustre.0 Request processed in 338us (10401us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338795.333377:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787338795.342430:0:14363:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc01d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c0e6575-df80-419a-8cc7-cbad06c93254:14363:1874160212073216:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787338795.342660:0:14363:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc01d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c0e6575-df80-419a-8cc7-cbad06c93254:14363:1874160212073344:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787338795.342729:0:14363:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338795.342771:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212073344 00000100:00100000:2.0:1787338795.342777:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212073344 00000100:00100000:2.0:1787338795.342819:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787338795.342828:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc67c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c0e6575-df80-419a-8cc7-cbad06c93254+12:14363:x1874160212073344:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787338795.343636:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc67c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c0e6575-df80-419a-8cc7-cbad06c93254+12:14363:x1874160212073344:12345-0@lo:503:mount.lustre.0 Request processed in 804us (902us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338795.343646:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787338795.343702:0:14363:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbd8e9a840 going to sleep for 11 seconds 00000100:00100000:2.0:1787338795.343720:0:14363:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc01d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c0e6575-df80-419a-8cc7-cbad06c93254:14363:1874160212073344:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787338795.345837:0:14413:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc01d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c0e6575-df80-419a-8cc7-cbad06c93254:14413:1874160212073472:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787338795.345934:0:14413:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338795.345972:0:14413:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbd8e9a840 going to sleep for 11 seconds 00000100:00100000:0.0:1787338795.347050:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212073472 00000100:00100000:0.0:1787338795.347061:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212073472 00000100:00100000:2.0:1787338795.347173:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787338795.347187:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc67c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c0e6575-df80-419a-8cc7-cbad06c93254+12:14413:x1874160212073472:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787338795.347467:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc67c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c0e6575-df80-419a-8cc7-cbad06c93254+12:14413:x1874160212073472:12345-0@lo:502:llog_process_th.0 Request processed in 283us (1532us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338795.347475:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787338795.347612:0:14413:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc01d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c0e6575-df80-419a-8cc7-cbad06c93254:14413:1874160212073472:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1787338795.347686:0:14413:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1787338795.347700:0:14413:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff90bbfc2499b8) 00000020:00000080:3.0:1787338795.347719:0:14413:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:3.0:1787338795.347801:0:14413:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90bbc8428000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1787338795.347805:0:14413:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90bbc8428000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1787338795.347808:0:14413:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90bbc8428000 4 00010000:00080000:3.0:1787338795.347840:0:14413:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90bbc5197800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.153@tcp at head 00010000:00010000:3.0:1787338795.354311:0:14413:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:3.0:1787338795.354515:0:14413:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1787338795.354554:0:14413:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787338795.354568:0:14413:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x83671231080c250a 00000100:00080000:3.0:1787338795.354579:0:14413:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787338795.354591:0:14413:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff90bbc5197800 using connection 192.168.201.153@tcp/0@lo 00000100:00100000:3.0:1787338795.354628:0:14413:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90bbedcb7800 x1874160212073600/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787338795.354685:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbedcb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874160212073600:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787338795.354775:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338795.354857:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212073600 00000100:00100000:3.0:1787338795.354865:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212073600 00000100:00100000:3.0:1787338795.354915:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787338795.354922:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbedcb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3313:x1874160212073600:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787338795.354971:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbedcb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3313:x1874160212073600:12345-0@lo:38:llog_process_th.0 Request processed in 48us (196us total) trans 0 rc -11/-11 00000100:00100000:3.0:1787338795.354978:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787338795.355016:0:3313:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787338795.355024:0:3313:0:(import.c:65:import_set_state_nolock()) ffff90bbc5197800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787338795.355041:0:3313:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787338795.355045:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbedcb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874160212073600:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1787338795.355063:0:14413:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787338795.364071:0:14413:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc01f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c0e6575-df80-419a-8cc7-cbad06c93254:14413:1874160212073728:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787338795.364159:0:14413:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338795.364196:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212073728 00000100:00100000:2.0:1787338795.364204:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212073728 00000100:00100000:2.0:1787338795.364260:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787338795.364269:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfb90f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c0e6575-df80-419a-8cc7-cbad06c93254+12:14413:x1874160212073728:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787338795.364515:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfb90f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c0e6575-df80-419a-8cc7-cbad06c93254+12:14413:x1874160212073728:12345-0@lo:502:llog_process_th.0 Request processed in 246us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338795.364524:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787338795.364639:0:14413:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbd07dde40 going to sleep for 11 seconds 00000100:00100000:2.0:1787338795.364661:0:14413:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc01f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c0e6575-df80-419a-8cc7-cbad06c93254:14413:1874160212073728:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1787338795.364688:0:14413:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1787338795.365118:0:14363:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1787338795.365134:0:14363:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787338795.365349:0:14363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbf3c52c00/0x83671231080c24f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c24fc expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338795.365361:0:14363:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.153@tcp lock: ffff90bbf3c52c00/0x83671231080c24f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c24fc expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787338795.365404:0:14363:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787338795.365406:0:14363:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787338795.365407:0:14363:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787338795.365408:0:14363:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787338795.365409:0:14363:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787338795.365411:0:14363:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787338795.365412:0:14363:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787338795.365413:0:14363:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787338795.365415:0:14363:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787338795.365417:0:14363:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787338795.365420:0:14363:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1787338795.365423:0:14363:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787338795.365424:0:14363:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787338795.365426:0:14363:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787338795.365430:0:14363:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787338795.365431:0:14363:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787338795.365432:0:14363:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787338795.365433:0:14363:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787338795.365434:0:14363:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787338795.365435:0:14363:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787338795.365435:0:14363:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787338795.365451:0:14363:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1787338795.365463:0:14363:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc4094700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c0e6575-df80-419a-8cc7-cbad06c93254:14363:1874160212073856:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787338795.365502:0:14363:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338795.365526:0:14363:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbf42dd9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787338795.365541:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212073856 00000100:00100000:0.0:1787338795.365547:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212073856 00000100:00100000:0.0:1787338795.365616:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787338795.365624:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfb90c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c0e6575-df80-419a-8cc7-cbad06c93254+12:14363:x1874160212073856:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787338795.365655:0:14375:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787338795.365668:0:14375:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787338795.408773:0:14375:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787338795.408949:0:14375:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1787338795.409637:0:14397:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787338795.409642:0:14397:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787338795.409666:0:14397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90bbf3c53c00/0x83671231080c2511 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338795.409686:0:14397:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90bbf7ea4400/0x83671231080c24e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c24d9 expref: 12 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338795.409694:0:14397:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90bbf3c53c00/0x83671231080c2511 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338795.409751:0:14397:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90bbf7ea4400/0x83671231080c24e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x83671231080c24d9 expref: 12 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338795.409778:0:14397:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90bbf7ea4400/0x83671231080c24e0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x83671231080c24d9 expref: 12 pid: 14376 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338795.409923:0:14397:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc01f480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14397:1874160212073984:0@lo:104: 00000100:00100000:2.0:1787338795.409986:0:14397:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338795.410018:0:14397:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbd07dd6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787338795.410101:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212073984 00000100:00100000:1.0:1787338795.410108:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212073984 00000100:00100000:1.0:1787338795.410155:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787338795.410164:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc01df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2c0e6575-df80-419a-8cc7-cbad06c93254+3:14397:x1874160212073984:12345-0@lo:104: 00010000:00010000:1.0:1787338795.410176:0:14364:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.153@tcp lock: ffff90bbffef5a00/0x83671231080c24d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x83671231080c24e0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338795.410246:0:14364:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787338795.410252:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc01df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2c0e6575-df80-419a-8cc7-cbad06c93254+3:14397:x1874160212073984:12345-0@lo:104: Request processed in 90us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338795.410260:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1787338795.410281:0:14370:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787338795.410286:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.153@tcp lock: ffff90bbffef5a00/0x83671231080c24d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x83671231080c24e0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338795.410294:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbffef5a00 already unused, calling callback (ffffffffc1b2ec20) 10000000:00010000:1.0:1787338795.410298:0:14370:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.153@tcp lock: ffff90bbffef5a00/0x83671231080c24d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x83671231080c24e0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338795.410307:0:14370:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.153@tcp lock: ffff90bbffef5a00/0x83671231080c24d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x83671231080c24e0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787338795.410325:0:14370:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.153@tcp lock: ffff90bbffef5a00/0x83671231080c24d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x83671231080c24e0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787338795.410330:0:14370:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787338795.410361:0:14370:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.153@tcp lock: ffff90bbffef5a00/0x83671231080c24d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c24e0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338795.410367:0:14370:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787338795.410386:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.153@tcp lock: ffff90bbffef5a00/0x83671231080c24d9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c24e0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338795.410392:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.153@tcp lock: ffff90bbffef5a00/0x83671231080c24d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c24e0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338795.410411:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338795.410412:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338795.410414:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787338795.410437:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787338795.410447:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf4705500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c0e6575-df80-419a-8cc7-cbad06c93254:3316:1874160212074112:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787338795.410476:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338795.410517:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212074112 00000100:00100000:1.0:1787338795.410521:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212074112 00010000:00010000:1.0:1787338795.410538:0:14366:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90bbf7ea4400/0x83671231080c24e0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x83671231080c24d9 expref: 13 pid: 14376 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338795.410561:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787338795.410567:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf4705180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c0e6575-df80-419a-8cc7-cbad06c93254+13:3316:x1874160212074112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787338795.410579:0:14366:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787338795.410589:0:14366:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90bbf7ea4400/0x83671231080c24e0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x83671231080c24d9 expref: 13 pid: 14376 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338795.410599:0:14366:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90bbf7ea4400/0x83671231080c24e0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x83671231080c24d9 expref: 13 pid: 14376 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338795.410614:0:14366:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90bbf3c53c00/0x83671231080c2511 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338795.410622:0:14366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bbf3c53c00/0x83671231080c2511 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787338795.410634:0:14366:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000992278s 00010000:00010000:1.0:1787338795.410638:0:14366:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90bbf3c53c00/0x83671231080c2511 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338795.410645:0:14366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90bbf3c53c00/0x83671231080c2511 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338795.410653:0:14366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90bbf3c53c00/0x83671231080c2511 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338795.410659:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90bbf3c53c00/0x83671231080c2511 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338795.410664:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf3c53c00 already unused, calling callback (ffffffffc1546230) 00010000:00010000:1.0:1787338795.410667:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90bbf3c53c00/0x83671231080c2511 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338795.410674:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90bbf3c53c00/0x83671231080c2511 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338795.410681:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90bbf3c53c00/0x83671231080c2511 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338795.410697:0:14366:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787338795.410722:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf4705180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c0e6575-df80-419a-8cc7-cbad06c93254+13:3316:x1874160212074112:12345-0@lo:103:ldlm_bl.0 Request processed in 155us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338795.410728:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787338795.410777:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf4705500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c0e6575-df80-419a-8cc7-cbad06c93254:3316:1874160212074112:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787338795.410912:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90bbf7ea4400/0x83671231080c24e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x83671231080c24d9 expref: 12 pid: 14376 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338795.410922:0:14397:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc01f480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14397:1874160212073984:0@lo:104: 00010000:00010000:3.0:1787338795.410937:0:14397:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90bbf3c53c00/0x83671231080c2511 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338795.410945:0:14397:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90bbf3c53c00/0x83671231080c2511 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338795.410962:0:14397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90bbf3c53c00/0x83671231080c2511 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338795.410968:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90bbf3c53c00/0x83671231080c2511 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338795.416542:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfb90c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c0e6575-df80-419a-8cc7-cbad06c93254+11:14363:x1874160212073856:12345-0@lo:253:mount.lustre.0 Request processed in 50908us (51028us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338795.416559:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787338795.416645:0:14363:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc4094700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c0e6575-df80-419a-8cc7-cbad06c93254:14363:1874160212073856:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787338795.416662:0:14363:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1787338795.416666:0:14363:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787338795.416668:0:14363:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787338795.416669:0:14363:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787338795.416670:0:14363:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787338795.416672:0:14363:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787338795.416673:0:14363:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787338795.416675:0:14363:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787338795.416676:0:14363:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787338795.416678:0:14363:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787338795.416679:0:14363:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787338795.416695:0:14363:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1787338795.423341:0:14363:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1787338795.423510:0:14363:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1787338795.424032:0:14363:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1787338795.424195:0:14363:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1787338795.424448:0:14363:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1787338795.424584:0:14363:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1787338795.425627:0:14363:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1787338795.426000:0:14363:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1787338795.426287:0:14363:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1787338795.426514:0:14363:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1787338795.427010:0:14363:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1787338795.427200:0:14363:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:0.0:1787338795.454590:0:14363:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:0.0:1787338795.455133:0:14363:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1787338795.455345:0:14418:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:2.0:1787338795.455350:0:14418:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:0.0:1787338795.455553:0:14419:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:0.0:1787338795.455626:0:14419:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787338795.459278:0:14419:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1787338795.459351:0:14419:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1787338795.459355:0:14419:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:2.0:1787338795.460749:0:14363:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1787338795.461049:0:14363:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1787338795.461550:0:14363:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1787338795.461557:0:14363:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1787338795.461679:0:14363:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787338795.463502:0:14363:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1787338795.464304:0:14363:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1787338795.464351:0:14363:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:2.0:1787338795.469542:0:14363:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:3.0:1787338795.479517:0:14363:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1787338795.506449:0:14363:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1787338795.506487:0:14363:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa35141c53988 00100000:10000000:3.0:1787338795.506495:0:14363:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1787338795.507109:0:14363:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787338795.507124:0:14363:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.153@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787338795.507136:0:14363:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1787338795.507151:0:14363:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:2.0:1787338795.963243:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787338796.410384:0:14412:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:1.0:1787338796.726015:0:14378:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787338796.726023:0:14378:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90bbc8428000 from 6 10000000:01000000:1.0:1787338796.726029:0:14378:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787338796.726082:0:14378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9d400/0x83671231080c2518 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338796.726095:0:14378:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9d400/0x83671231080c2518 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338796.726124:0:14378:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9d400/0x83671231080c2518 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338796.726149:0:14378:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf4705500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c0e6575-df80-419a-8cc7-cbad06c93254:14378:1874160212074240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787338796.726236:0:14378:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338796.726292:0:14378:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc6748780 going to sleep for 11 seconds 00000100:00100000:3.0:1787338796.726441:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212074240 00000100:00100000:3.0:1787338796.726449:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212074240 00000100:00100000:3.0:1787338796.726497:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787338796.726506:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfb90c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c0e6575-df80-419a-8cc7-cbad06c93254+11:14378:x1874160212074240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787338796.726518:0:14373:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787338796.726531:0:14373:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90bbf7ea4400/0x83671231080c251f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x83671231080c2518 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338796.726561:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bbf7ea4400/0x83671231080c251f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x83671231080c2518 expref: 12 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338796.726571:0:14373:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90bbf7ea4400/0x83671231080c251f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c2518 expref: 12 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338796.726580:0:14373:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf7ea4400, rc 0) 00000100:00100000:3.0:1787338796.726667:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfb90c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c0e6575-df80-419a-8cc7-cbad06c93254+12:14378:x1874160212074240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 161us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338796.726674:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787338796.727125:0:14378:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf4705500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c0e6575-df80-419a-8cc7-cbad06c93254:14378:1874160212074240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787338796.727142:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9d400/0x83671231080c2518 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c251f expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338796.727152:0:14378:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9d400/0x83671231080c2518 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x83671231080c251f expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338796.727224:0:14378:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf4705500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c0e6575-df80-419a-8cc7-cbad06c93254:14378:1874160212074368:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787338796.727253:0:14378:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338796.727273:0:14378:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc6748780 going to sleep for 11 seconds 00000100:00100000:2.0:1787338796.727356:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212074368 00000100:00100000:2.0:1787338796.727376:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212074368 00000100:00100000:2.0:1787338796.727406:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787338796.727414:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfb90fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c0e6575-df80-419a-8cc7-cbad06c93254+12:14378:x1874160212074368:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787338796.727428:0:14375:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787338796.727442:0:14375:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787338796.727445:0:14375:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1787338796.727517:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfb90fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c0e6575-df80-419a-8cc7-cbad06c93254+12:14378:x1874160212074368:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 104us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338796.727525:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787338796.727707:0:14378:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf4705500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c0e6575-df80-419a-8cc7-cbad06c93254:14378:1874160212074368:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787338796.727744:0:14378:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.153@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787338796.727751:0:14378:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9d400/0x83671231080c2518 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c251f expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338796.727759:0:14378:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9d400/0x83671231080c2518 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c251f expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338796.991271:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787338797.434716:0:14412:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787338798.008369:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338799.030583:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787338800.055996:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787338800.064802:0:14662:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg153-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:3.0:1787338800.769820:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787338800.769827:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787338800.769829:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787338800.769833:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787338800.769835:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1787338800.769839:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787338800.769855:0:37:0:(import.c:65:import_set_state_nolock()) ffff90bbc5197800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787338800.769867:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff90bbc5197800 using connection 192.168.201.153@tcp/0@lo 00000100:00100000:3.0:1787338800.769910:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90bbedcb4a80 x1874160212074624/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787338800.769948:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbedcb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874160212074624:0@lo:38:kworker.0 00000100:00100000:3.0:1787338800.770009:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338800.770084:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212074624 00000100:00100000:3.0:1787338800.770091:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212074624 00000100:00100000:3.0:1787338800.770120:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787338800.770138:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbedcb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3313:x1874160212074624:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1787338800.770163:0:14383:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 453 last 0 00000020:00000080:3.0:1787338800.770195:0:14383:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x83671231080c2526 00000004:00100000:3.0:1787338800.770209:0:14383:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787338800.770331:0:14383:0:(import.c:65:import_set_state_nolock()) ffff90bbf41a1800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787338800.770376:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbedcb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874160212074624:12345-0@lo:38:kworker.0 Request processed in 249us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338800.770383:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787338800.770424:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff90bbedcb4a80 x1874160212074624/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787338810 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787338800.770458:0:3313:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1787338800.770465:0:3313:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1787338800.770469:0:3313:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787338800.770472:0:3313:0:(import.c:65:import_set_state_nolock()) ffff90bbc5197800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787338800.770477:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbedcb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874160212074624:0@lo:38:kworker.0 00000100:00100000:2.0:1787338800.770894:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbedcb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c0e6575-df80-419a-8cc7-cbad06c93254:3314:1874160212074496:0@lo:400:kworker.0 00000100:00100000:2.0:1787338800.770923:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338800.770964:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212074496 00000100:00100000:2.0:1787338800.770967:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212074496 00000100:00100000:2.0:1787338800.770988:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787338800.770992:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfb90f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c0e6575-df80-419a-8cc7-cbad06c93254+12:3314:x1874160212074496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787338800.771017:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfb90f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c0e6575-df80-419a-8cc7-cbad06c93254+12:3314:x1874160212074496:12345-0@lo:400:kworker.0 Request processed in 25us (94us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338800.771021:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787338800.771046:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbedcb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c0e6575-df80-419a-8cc7-cbad06c93254:3314:1874160212074496:0@lo:400:kworker.0 00010000:00010000:1.0:1787338801.080175:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338802.102636:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787338802.879355:0:14813:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe1f4221b0 20000000:00000080:0.0:1787338802.879615:0:14813:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff90bbeff18400 uarg=0000000000000000 20000000:01000000:0.0:1787338802.879650:0:14813:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1787338802.879727:0:14813:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1787338802.879734:0:14813:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1787338802.881539:0:14814:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:0.0:1787338802.881784:0:14813:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1787338802.888250:0:14813:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787338802.888282:0:14813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90bbffef5a00/0x83671231080c252d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338802.888303:0:14813:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90bbffef4a00/0x83671231080c24ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c24e7 expref: 11 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338802.888312:0:14813:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90bbffef5a00/0x83671231080c252d lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338802.888357:0:14813:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90bbffef4a00/0x83671231080c24ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x83671231080c24e7 expref: 11 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338802.888443:0:14813:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90bbffef4a00/0x83671231080c24ee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x83671231080c24e7 expref: 11 pid: 14376 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338802.888458:0:14813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc4094700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14813:1874160212074752:0@lo:104: 00000100:00100000:0.0:1787338802.888526:0:14813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338802.888666:0:14813:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc674c0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787338802.888808:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212074752 00000100:00100000:2.0:1787338802.888815:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212074752 00000100:00100000:2.0:1787338802.889234:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787338802.889247:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4096300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2c0e6575-df80-419a-8cc7-cbad06c93254+3:14813:x1874160212074752:12345-0@lo:104: 00010000:00010000:2.0:1787338802.889261:0:14365:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.153@tcp lock: ffff90bbf3c52200/0x83671231080c24e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x83671231080c24ee expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338802.889416:0:14813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc4094700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14813:1874160212074752:0@lo:104: 00010000:00010000:0.0:1787338802.889441:0:14813:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90bbffef5a00/0x83671231080c252d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338802.889579:0:14365:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787338802.889586:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4096300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2c0e6575-df80-419a-8cc7-cbad06c93254+3:14813:x1874160212074752:12345-0@lo:104: Request processed in 342us (1060us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338802.889594:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1787338802.889651:0:14370:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787338802.889720:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.153@tcp lock: ffff90bbf3c52200/0x83671231080c24e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x83671231080c24ee expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338802.889728:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf3c52200 already unused, calling callback (ffffffffc1b2ec20) 10000000:00010000:1.0:1787338802.889733:0:14370:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.153@tcp lock: ffff90bbf3c52200/0x83671231080c24e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x83671231080c24ee expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338802.889741:0:14370:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.153@tcp lock: ffff90bbf3c52200/0x83671231080c24e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x83671231080c24ee expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787338802.889747:0:14370:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.153@tcp lock: ffff90bbf3c52200/0x83671231080c24e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x83671231080c24ee expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787338802.889752:0:14370:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787338802.889792:0:14370:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.153@tcp lock: ffff90bbf3c52200/0x83671231080c24e7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c24ee expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338802.889799:0:14370:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1787338802.889855:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf4705500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c0e6575-df80-419a-8cc7-cbad06c93254:3315:1874160212074880:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787338802.889925:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787338802.890156:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.153@tcp lock: ffff90bbf3c52200/0x83671231080c24e7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c24ee expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338802.890165:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.153@tcp lock: ffff90bbf3c52200/0x83671231080c24e7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c24ee expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338802.890181:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338802.890183:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338802.890192:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787338802.890304:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212074880 00000100:00100000:0.0:1787338802.890311:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212074880 00010000:00010000:0.0:1787338802.890336:0:14366:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90bbffef4a00/0x83671231080c24ee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x83671231080c24e7 expref: 12 pid: 14376 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338802.890456:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787338802.890464:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4094700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c0e6575-df80-419a-8cc7-cbad06c93254+12:3315:x1874160212074880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787338802.890477:0:14366:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787338802.890482:0:14366:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90bbffef4a00/0x83671231080c24ee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x83671231080c24e7 expref: 12 pid: 14376 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338802.890493:0:14366:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90bbffef4a00/0x83671231080c24ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x83671231080c24e7 expref: 12 pid: 14376 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338802.890507:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90bbffef4a00/0x83671231080c24ee lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x83671231080c24e7 expref: 12 pid: 14376 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338802.890520:0:14366:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90bbffef5a00/0x83671231080c252d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338802.890528:0:14366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bbffef5a00/0x83671231080c252d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338802.890542:0:14366:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90bbffef5a00/0x83671231080c252d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338802.890559:0:14366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90bbffef5a00/0x83671231080c252d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338802.890566:0:14366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90bbffef5a00/0x83671231080c252d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338802.890573:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90bbffef5a00/0x83671231080c252d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338802.890580:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbffef5a00 already unused, calling callback (ffffffffc1546230) 00010000:00010000:0.0:1787338802.890585:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90bbffef5a00/0x83671231080c252d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338802.890592:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90bbffef5a00/0x83671231080c252d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338802.890616:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90bbffef5a00/0x83671231080c252d lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338802.890626:0:14366:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787338802.890778:0:14813:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90bbffef5a00/0x83671231080c252d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338802.890787:0:14813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90bbffef5a00/0x83671231080c252d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338802.890794:0:14813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90bbffef5a00/0x83671231080c252d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338802.892079:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4094700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c0e6575-df80-419a-8cc7-cbad06c93254+11:3315:x1874160212074880:12345-0@lo:103:ldlm_bl.0 Request processed in 1611us (2148us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338802.892100:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787338802.893778:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf4705500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c0e6575-df80-419a-8cc7-cbad06c93254:3315:1874160212074880:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787338803.126120:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338804.152271:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787338804.662173:0:14378:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787338804.662181:0:14378:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90bbc8428000 from 10 10000000:01000000:2.0:1787338804.662186:0:14378:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787338804.662232:0:14378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbf3c52400/0x83671231080c2534 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338804.662244:0:14378:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.153@tcp lock: ffff90bbf3c52400/0x83671231080c2534 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338804.662257:0:14378:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.153@tcp lock: ffff90bbf3c52400/0x83671231080c2534 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338804.662283:0:14378:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc01f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c0e6575-df80-419a-8cc7-cbad06c93254:14378:1874160212075008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787338804.662352:0:14378:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338804.662404:0:14378:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbde5dde40 going to sleep for 11 seconds 00000100:00100000:2.0:1787338804.662426:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212075008 00000100:00100000:2.0:1787338804.662446:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212075008 00000100:00100000:2.0:1787338804.662505:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787338804.662514:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfb90e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c0e6575-df80-419a-8cc7-cbad06c93254+11:14378:x1874160212075008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787338804.662526:0:14373:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787338804.662538:0:14373:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90bbf3c53800/0x83671231080c253b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x83671231080c2534 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338804.662560:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bbf3c53800/0x83671231080c253b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x83671231080c2534 expref: 12 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338804.662569:0:14373:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90bbf3c53800/0x83671231080c253b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c2534 expref: 12 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338804.662578:0:14373:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf3c53800, rc 0) 00000100:00100000:2.0:1787338804.662613:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfb90e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c0e6575-df80-419a-8cc7-cbad06c93254+12:14378:x1874160212075008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 100us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338804.662619:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787338804.662677:0:14378:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc01f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c0e6575-df80-419a-8cc7-cbad06c93254:14378:1874160212075008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787338804.662691:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.153@tcp lock: ffff90bbf3c52400/0x83671231080c2534 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c253b expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338804.662699:0:14378:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.153@tcp lock: ffff90bbf3c52400/0x83671231080c2534 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x83671231080c253b expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338804.662749:0:14378:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc01f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c0e6575-df80-419a-8cc7-cbad06c93254:14378:1874160212075136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787338804.662773:0:14378:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338804.662786:0:14378:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbde5dde40 going to sleep for 11 seconds 00000100:00100000:2.0:1787338804.662798:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212075136 00000100:00100000:2.0:1787338804.662807:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212075136 00000100:00100000:2.0:1787338804.662830:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787338804.662836:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfb90f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c0e6575-df80-419a-8cc7-cbad06c93254+12:14378:x1874160212075136:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787338804.663120:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfb90f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c0e6575-df80-419a-8cc7-cbad06c93254+12:14378:x1874160212075136:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 283us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338804.663127:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787338804.663157:0:14378:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc01f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c0e6575-df80-419a-8cc7-cbad06c93254:14378:1874160212075136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787338804.663181:0:14378:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc01f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c0e6575-df80-419a-8cc7-cbad06c93254:14378:1874160212075264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787338804.663216:0:14378:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338804.663229:0:14378:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbde5dde40 going to sleep for 11 seconds 00000100:00100000:2.0:1787338804.663241:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212075264 00000100:00100000:2.0:1787338804.663245:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212075264 00000100:00100000:2.0:1787338804.663264:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787338804.663270:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfb90dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c0e6575-df80-419a-8cc7-cbad06c93254+12:14378:x1874160212075264:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787338804.663400:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfb90dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c0e6575-df80-419a-8cc7-cbad06c93254+12:14378:x1874160212075264:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 129us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338804.663406:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787338804.663443:0:14378:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc01f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c0e6575-df80-419a-8cc7-cbad06c93254:14378:1874160212075264:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787338804.664092:0:14880:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1787338804.664148:0:14378:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1787338804.664165:0:14378:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787338804.664175:0:14378:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbf3c52400/0x83671231080c2534 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c253b expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338804.664184:0:14378:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.153@tcp lock: ffff90bbf3c52400/0x83671231080c2534 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c253b expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338805.179611:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787338805.879802:0:3313:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787338795/real 1787338795] req@ffff90bbfc01e680 x1874160212071936/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787338805 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787338805.879834:0:3313:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90bbfc01e680 x1874160212071936/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787338805 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787338805.879844:0:3313:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787338795/real 1787338795] req@ffff90bbc4095880 x1874160212071808/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787338805 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787338805.879855:0:3313:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90bbc4095880 x1874160212071808/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787338805 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787338805.879896:0:3313:0:(import.c:65:import_set_state_nolock()) ffff90bbf40f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1787338805.882376:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf4704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c0e6575-df80-419a-8cc7-cbad06c93254:3316:1874160212075392:0@lo:400:kworker.0 00000100:00100000:0.0:1787338805.882453:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787338805.882825:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787338805.882830:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787338805.882833:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787338805.882836:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787338805.882839:0:37:0:(import.c:65:import_set_state_nolock()) ffff90bbf40f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787338805.882845:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 448 00000100:00080000:1.0:1787338805.882849:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787338805.882855:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff90bbf40f3800 using connection 192.168.201.153@tcp/0@lo 00000100:00100000:1.0:1787338805.882894:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90bbf4705f80 x1874160212075520/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787338805.882959:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212075392 00000100:00100000:2.0:1787338805.882966:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212075392 00000100:00100000:2.0:1787338805.883057:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787338805.883066:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfb90d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c0e6575-df80-419a-8cc7-cbad06c93254+12:3316:x1874160212075392:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787338805.883161:0:3313:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787338805.883167:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc01e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1874160212071936:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1787338805.883298:0:3313:0:(import.c:65:import_set_state_nolock()) ffff90bbc93ac800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787338805.883309:0:3313:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787338805.883313:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc4095880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1874160212071808:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1787338805.883336:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf4705f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1874160212075520:0@lo:8:kworker.0 00000400:00000100:3.0:1787338805.883376:0:3313:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874160212075520 offset 0 length 520: 4 00000100:00100000:1.0:1787338805.883848:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf4707100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874160212075648:0@lo:400:kworker.0 00000100:00100000:1.0:1787338805.883925:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787338805.883958:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787338805.883962:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1787338805.883964:0:37:0:(import.c:65:import_set_state_nolock()) ffff90bbc93ac800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787338805.883968:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 448 00000100:00080000:1.0:1787338805.883971:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787338805.883974:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff90bbc93ac800 using connection 192.168.201.153@tcp/0@lo 00000100:00100000:1.0:1787338805.883991:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90bbf4704380 x1874160212075776/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787338805.884197:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212075648 00000100:00100000:3.0:1787338805.884204:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212075648 00000100:00100000:3.0:1787338805.884244:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787338805.884252:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf4707800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874160212075648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787338805.884300:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf4707800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874160212075648:12345-0@lo:400:kworker.0 Request processed in 49us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338805.884308:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787338805.884344:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff90bbf4707100 x1874160212075648/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787338821 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787338805.884357:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf4707100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874160212075648:0@lo:400:kworker.0 00000100:00100000:3.0:1787338805.884377:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf4704380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1874160212075776:0@lo:8:kworker.0 00000400:00000100:3.0:1787338805.884401:0:3313:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874160212075776 offset 0 length 520: 4 00000100:00100000:2.0:1787338805.884553:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfb90d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c0e6575-df80-419a-8cc7-cbad06c93254+12:3316:x1874160212075392:12345-0@lo:400:kworker.0 Request processed in 1487us (2098us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338805.884561:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787338805.886127:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf4704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c0e6575-df80-419a-8cc7-cbad06c93254:3316:1874160212075392:0@lo:400:kworker.0 00010000:00010000:1.0:1787338806.200277:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787338807.222318:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787338807.679032:0:14412:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:0.0:1787338808.188451:0:15062:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787338808.188455:0:15062:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1787338808.188568:0:15062:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff90bbc2e86800 00000020:01000004:0.0:1787338808.188598:0:15062:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1787338808.188610:0:15062:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1787338808.188623:0:15062:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff90bbde3e8000) 00000020:00000080:0.0:1787338808.188638:0:15062:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1787338808.213416:0:15062:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1787338808.214710:0:15062:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1787338808.216941:0:15062:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1787338808.217176:0:15062:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:0.0:1787338808.217387:0:15062:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1787338808.218561:0:15062:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 579: rc = 0 00100000:10000000:0.0:1787338808.220038:0:15062:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 579: rc = 0 00100000:10000000:0.0:1787338808.220140:0:15062:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 579: rc = 0 00100000:10000000:0.0:1787338808.220671:0:15062:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 720: rc = 0 00100000:10000000:0.0:1787338808.220973:0:15062:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 720: rc = 0 00100000:10000000:0.0:1787338808.221242:0:15062:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 720: rc = 0 00100000:10000000:3.0:1787338808.222924:0:15062:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 720: rc = 0 00100000:10000000:3.0:1787338808.223242:0:15062:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 720: rc = 0 00100000:10000000:3.0:1787338808.223512:0:15062:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 720: rc = 0 00000020:00000080:3.0:1787338808.224135:0:15062:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1787338808.224147:0:15062:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787338808.224158:0:15062:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x83671231080c2549 00000020:01000004:3.0:1787338808.224166:0:15062:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1787338808.224186:0:15062:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.153@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787338808.224190:0:15062:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.153@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787338808.224195:0:15062:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1787338808.224200:0:15062:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1787338808.224218:0:15062:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff90bbef8a8000) 00000020:00000080:3.0:1787338808.224229:0:15062:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:3.0:1787338808.225343:0:15062:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787338808.225520:0:15062:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1787338808.225526:0:15062:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1787338808.235191:0:15062:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1787338808.235205:0:15062:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1787338808.236817:0:15062:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1787338808.236828:0:15062:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1787338808.242989:0:15062:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787338808.249054:0:15062:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1787338808.249066:0:15062:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00010000:00010000:0.0:1787338808.250784:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787338808.251681:0:15062:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1787338808.251693:0:15062:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1787338808.281024:0:15062:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787338808.281256:0:15062:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1787338808.281263:0:15062:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1787338808.283073:0:15062:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1787338808.283086:0:15062:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1787338808.284174:0:15062:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1787338808.284186:0:15062:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1787338808.300551:0:15062:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787338808.300781:0:15062:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1787338808.300788:0:15062:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1787338808.306646:0:15062:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1787338808.306661:0:15062:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1787338808.373529:0:15062:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787338808.373813:0:15062:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1787338808.373820:0:15062:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1787338808.381967:0:15062:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1787338808.381988:0:15062:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1787338808.390746:0:15062:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1787338808.390773:0:15062:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1787338808.390779:0:15062:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.153@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1787338808.431337:0:15062:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.153@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787338808.431387:0:15062:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.153@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1787338808.431392:0:15062:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787338808.431394:0:15062:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787338808.431395:0:15062:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787338808.431397:0:15062:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787338808.431398:0:15062:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787338808.431399:0:15062:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787338808.431400:0:15062:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787338808.431402:0:15062:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787338808.431403:0:15062:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787338808.431407:0:15062:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1787338808.431409:0:15062:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787338808.431410:0:15062:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787338808.431411:0:15062:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787338808.431418:0:15062:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787338808.431419:0:15062:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787338808.431419:0:15062:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787338808.431421:0:15062:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787338808.431422:0:15062:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787338808.431423:0:15062:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787338808.431463:0:15062:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1787338808.431483:0:15062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc4095500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c0e6575-df80-419a-8cc7-cbad06c93254:15062:1874160212075904:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787338808.436263:0:15062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338808.436346:0:15062:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc674c780 going to sleep for 11 seconds 00000100:00100000:2.0:1787338808.438698:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212075904 00000100:00100000:2.0:1787338808.438715:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212075904 00000100:00100000:2.0:1787338808.438803:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787338808.438814:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfb90e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c0e6575-df80-419a-8cc7-cbad06c93254+12:15062:x1874160212075904:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787338808.438849:0:14375:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1787338808.438853:0:14375:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1787338808.438857:0:14375:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1787338808.457025:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfb90e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c0e6575-df80-419a-8cc7-cbad06c93254+12:15062:x1874160212075904:12345-0@lo:253:mount.lustre.0 Request processed in 18202us (20759us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338808.457042:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787338808.465638:0:15062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc4095500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c0e6575-df80-419a-8cc7-cbad06c93254:15062:1874160212075904:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787338808.465662:0:15062:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787338808.465666:0:15062:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787338808.465668:0:15062:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787338808.465669:0:15062:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787338808.465671:0:15062:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787338808.465672:0:15062:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787338808.465673:0:15062:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787338808.465675:0:15062:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787338808.465694:0:15062:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787338808.465696:0:15062:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787338808.465722:0:15062:0:(tgt_mount.c:101:server_register_mount()) register mount ffff90bbc2e86800 from lustre-OST0000 10000000:01000000:2.0:1787338808.465751:0:15062:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1787338808.465754:0:15062:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787338808.465760:0:15062:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff90bbee0a99b8 local copy 00010000:00010000:2.0:1787338808.465771:0:15062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbf3c52600/0x83671231080c243f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c2446 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338808.466044:0:15062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc01f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c0e6575-df80-419a-8cc7-cbad06c93254:15062:1874160212076032:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787338808.466106:0:15062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338808.466146:0:15062:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbd07dd000 going to sleep for 11 seconds 00000100:00100000:0.0:1787338808.466297:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212076032 00000100:00100000:0.0:1787338808.466304:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212076032 00000100:00100000:0.0:1787338808.466362:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787338808.466372:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfb90d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c0e6575-df80-419a-8cc7-cbad06c93254+12:15062:x1874160212076032:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787338808.466858:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfb90d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c0e6575-df80-419a-8cc7-cbad06c93254+12:15062:x1874160212076032:12345-0@lo:501:mount.lustre.0 Request processed in 484us (748us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787338808.466867:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787338808.469379:0:15062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc01f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c0e6575-df80-419a-8cc7-cbad06c93254:15062:1874160212076032:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1787338808.469742:0:15062:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.153@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1787338808.470048:0:15062:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.153@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1787338808.470060:0:15062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbf3c52600/0x83671231080c243f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c2446 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338808.470072:0:15062:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.153@tcp lock: ffff90bbf3c52600/0x83671231080c243f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c2446 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787338808.470103:0:15062:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff90bbc2e86800 10000000:01000000:0.0:1787338808.470107:0:15062:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787338808.470119:0:15062:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff90bbee0a99b8 10000000:01000000:0.0:1787338808.470122:0:15062:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1787338808.470126:0:15062:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff90bbee0a99b8 from 1 10000000:01000000:0.0:1787338808.470129:0:15062:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1787338808.470178:0:15062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbffef5000/0x83671231080c2557 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338808.470187:0:15062:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.153@tcp lock: ffff90bbffef5000/0x83671231080c2557 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338808.470199:0:15062:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.153@tcp lock: ffff90bbffef5000/0x83671231080c2557 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338808.470220:0:15062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc4094e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c0e6575-df80-419a-8cc7-cbad06c93254:15062:1874160212076160:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787338808.470286:0:15062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338808.470337:0:15062:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc674c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787338808.470424:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212076160 00000100:00100000:2.0:1787338808.470431:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212076160 00000100:00100000:2.0:1787338808.470481:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787338808.470490:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfb90e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c0e6575-df80-419a-8cc7-cbad06c93254+12:15062:x1874160212076160:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787338808.470501:0:14375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787338808.470514:0:14375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90bbf3c53e00/0x83671231080c255e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x83671231080c2557 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338808.470535:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bbf3c53e00/0x83671231080c255e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x83671231080c2557 expref: 13 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338808.470545:0:14375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90bbf3c53e00/0x83671231080c255e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c2557 expref: 13 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338808.470554:0:14375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf3c53e00, rc 0) 00000100:00100000:2.0:1787338808.470592:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfb90e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c0e6575-df80-419a-8cc7-cbad06c93254+13:15062:x1874160212076160:12345-0@lo:101:mount.lustre.0 Request processed in 103us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338808.470599:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787338808.470903:0:15062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc4094e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c0e6575-df80-419a-8cc7-cbad06c93254:15062:1874160212076160:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787338808.470920:0:15062:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.153@tcp lock: ffff90bbffef5000/0x83671231080c2557 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c255e expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338808.470930:0:15062:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.153@tcp lock: ffff90bbffef5000/0x83671231080c2557 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x83671231080c255e expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787338808.470947:0:15062:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.153@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1787338808.470963:0:15062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbffef5000/0x83671231080c2557 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c255e expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338808.470971:0:15062:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.153@tcp lock: ffff90bbffef5000/0x83671231080c2557 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c255e expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787338808.470978:0:15062:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1787338808.470983:0:15062:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787338808.470988:0:15062:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1787338808.470990:0:15062:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1787338808.471018:0:15062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9d000/0x83671231080c2565 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338808.471035:0:15062:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9d000/0x83671231080c2565 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338808.471043:0:15062:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9d000/0x83671231080c2565 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338808.471057:0:15062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf4704e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c0e6575-df80-419a-8cc7-cbad06c93254:15062:1874160212076288:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787338808.471090:0:15062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338808.471125:0:15062:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc7c28cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787338808.471263:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212076288 00000100:00100000:3.0:1787338808.471268:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212076288 00000100:00100000:3.0:1787338808.471308:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787338808.471316:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfb90c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c0e6575-df80-419a-8cc7-cbad06c93254+13:15062:x1874160212076288:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787338808.471324:0:14376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787338808.471335:0:14376:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90bbf7ea4800/0x83671231080c256c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x83671231080c2565 expref: -99 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338808.471350:0:14376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bbf7ea4800/0x83671231080c256c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x83671231080c2565 expref: 14 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338808.471359:0:14376:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90bbf7ea4800/0x83671231080c256c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c2565 expref: 14 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338808.471376:0:14376:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf7ea4800, rc 0) 00000100:00100000:3.0:1787338808.471427:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfb90c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c0e6575-df80-419a-8cc7-cbad06c93254+14:15062:x1874160212076288:12345-0@lo:101:mount.lustre.0 Request processed in 112us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338808.471434:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787338808.471611:0:15062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf4704e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c0e6575-df80-419a-8cc7-cbad06c93254:15062:1874160212076288:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787338808.471623:0:15062:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9d000/0x83671231080c2565 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c256c expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338808.471630:0:15062:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9d000/0x83671231080c2565 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x83671231080c256c expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787338808.473628:0:15062:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1787338808.477581:0:15062:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787338808.477919:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1787338808.477978:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1787338808.478029:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1787338808.478083:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1787338808.478122:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1787338808.478156:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1787338808.478236:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1787338808.478246:0:15062:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1787338808.478363:0:15062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc4095c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c0e6575-df80-419a-8cc7-cbad06c93254:15062:1874160212076416:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787338808.479129:0:15062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338808.479376:0:15062:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc674c780 going to sleep for 11 seconds 00000100:00100000:2.0:1787338808.479535:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212076416 00000100:00100000:2.0:1787338808.479544:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212076416 00000100:00100000:2.0:1787338808.479605:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787338808.479618:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffd23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c0e6575-df80-419a-8cc7-cbad06c93254+14:15062:x1874160212076416:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787338808.480061:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffd23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c0e6575-df80-419a-8cc7-cbad06c93254+14:15062:x1874160212076416:12345-0@lo:501:mount.lustre.0 Request processed in 445us (936us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338808.480070:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787338808.480475:0:15062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc4095c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c0e6575-df80-419a-8cc7-cbad06c93254:15062:1874160212076416:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787338808.480524:0:15062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc4095c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c0e6575-df80-419a-8cc7-cbad06c93254:15062:1874160212076544:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787338808.480577:0:15062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338808.480612:0:15062:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc674c780 going to sleep for 11 seconds 00000100:00100000:3.0:1787338808.480674:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212076544 00000100:00100000:3.0:1787338808.480681:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212076544 00000100:00100000:3.0:1787338808.480720:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787338808.480728:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffd22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c0e6575-df80-419a-8cc7-cbad06c93254+14:15062:x1874160212076544:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787338808.482696:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffd22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c0e6575-df80-419a-8cc7-cbad06c93254+14:15062:x1874160212076544:12345-0@lo:503:mount.lustre.0 Request processed in 1957us (2108us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338808.482710:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787338808.482962:0:15062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc4095c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c0e6575-df80-419a-8cc7-cbad06c93254:15062:1874160212076544:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787338808.484322:0:15062:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787338808.484593:0:15062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc4095c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c0e6575-df80-419a-8cc7-cbad06c93254:15062:1874160212076672:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787338808.484675:0:15062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338808.484754:0:15062:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc674c780 going to sleep for 11 seconds 00000100:00100000:2.0:1787338808.484935:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212076672 00000100:00100000:2.0:1787338808.484945:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212076672 00000100:00100000:2.0:1787338808.485001:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787338808.485010:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffd20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c0e6575-df80-419a-8cc7-cbad06c93254+14:15062:x1874160212076672:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787338808.485486:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffd20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c0e6575-df80-419a-8cc7-cbad06c93254+14:15062:x1874160212076672:12345-0@lo:502:mount.lustre.0 Request processed in 475us (809us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338808.485494:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787338808.485585:0:15062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc4095c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c0e6575-df80-419a-8cc7-cbad06c93254:15062:1874160212076672:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787338808.485815:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1787338808.485860:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1787338808.485924:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1787338808.485965:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1787338808.486006:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1787338808.486038:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1787338808.486087:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1787338808.486130:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1787338808.486813:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:0.0:1787338808.486907:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:0.0:1787338808.486944:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:0.0:1787338808.486983:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:0.0:1787338808.487032:0:15062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc4095c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c0e6575-df80-419a-8cc7-cbad06c93254:15062:1874160212076800:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787338808.487141:0:15062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338808.487294:0:15062:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc674c780 going to sleep for 11 seconds 00000100:00100000:3.0:1787338808.487525:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212076800 00000100:00100000:3.0:1787338808.487532:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212076800 00000100:00100000:3.0:1787338808.487608:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787338808.487618:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffd22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c0e6575-df80-419a-8cc7-cbad06c93254+14:15062:x1874160212076800:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787338808.487797:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffd22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c0e6575-df80-419a-8cc7-cbad06c93254+14:15062:x1874160212076800:12345-0@lo:502:mount.lustre.0 Request processed in 180us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338808.487805:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787338808.487904:0:15062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc4095c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c0e6575-df80-419a-8cc7-cbad06c93254:15062:1874160212076800:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787338808.487976:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:1.0:1787338808.487986:0:15062:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:1.0:1787338808.490008:0:15076:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787338808.490019:0:15076:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1787338808.490027:0:15076:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787338808.490029:0:15076:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1787338808.490035:0:15076:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787338808.490051:0:15076:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff90bbffd819b8) 00000020:00000080:1.0:1787338808.490084:0:15076:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:1.0:1787338808.490105:0:15076:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787338808.490180:0:15076:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90bbc2e86800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1787338808.490189:0:15076:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787338808.490196:0:15076:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x83671231080c257a 00010000:00010000:1.0:1787338808.496083:0:15076:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:1.0:1787338808.496817:0:15076:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:1.0:1787338808.500345:0:15076:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1787338808.502275:0:15076:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1787338808.502287:0:15076:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787338808.502293:0:15076:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787338808.502295:0:15076:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1787338808.502298:0:15076:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787338808.502300:0:15076:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:1.0:1787338808.502302:0:15076:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787338808.502303:0:15076:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787338808.502304:0:15076:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787338808.502307:0:15076:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787338808.502308:0:15076:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787338808.502310:0:15076:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787338808.502313:0:15076:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787338808.502314:0:15076:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787338808.502316:0:15076:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787338808.502318:0:15076:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787338808.502320:0:15076:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787338808.502322:0:15076:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787338808.502323:0:15076:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787338808.502325:0:15076:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787338808.502327:0:15076:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787338808.502328:0:15076:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787338808.502331:0:15076:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1787338808.502397:0:15076:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787338808.502401:0:15076:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787338808.502402:0:15076:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787338808.502404:0:15076:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:2.0:1787338808.502619:0:15062:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1787338808.502646:0:15062:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.153@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1787338808.502671:0:15062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9d000/0x83671231080c2565 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c256c expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338808.502682:0:15062:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9d000/0x83671231080c2565 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c256c expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787338808.502690:0:15062:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90bbc2e86800 from 1 10000000:01000000:2.0:1787338808.502693:0:15062:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787338808.502728:0:15062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbf3c52000/0x83671231080c2581 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338808.502736:0:15062:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.153@tcp lock: ffff90bbf3c52000/0x83671231080c2581 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338808.502754:0:15062:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.153@tcp lock: ffff90bbf3c52000/0x83671231080c2581 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338808.502778:0:15062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc01e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c0e6575-df80-419a-8cc7-cbad06c93254:15062:1874160212076928:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787338808.502859:0:15062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338808.502931:0:15062:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbd07dd000 going to sleep for 11 seconds 00000100:00100000:1.0:1787338808.503068:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212076928 00000100:00100000:1.0:1787338808.503148:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212076928 00000100:00100000:1.0:1787338808.503224:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787338808.503235:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffd20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c0e6575-df80-419a-8cc7-cbad06c93254+14:15062:x1874160212076928:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787338808.503248:0:14375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787338808.503261:0:14375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90bbfbe9d600/0x83671231080c2588 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x83671231080c2581 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338808.503286:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bbfbe9d600/0x83671231080c2588 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x83671231080c2581 expref: 15 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338808.503296:0:14375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90bbfbe9d600/0x83671231080c2588 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c2581 expref: 15 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338808.503305:0:14375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbfbe9d600, rc 0) 00000100:00100000:1.0:1787338808.503358:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffd20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c0e6575-df80-419a-8cc7-cbad06c93254+15:15062:x1874160212076928:12345-0@lo:101:mount.lustre.0 Request processed in 125us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338808.503365:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787338808.503458:0:15062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc01e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c0e6575-df80-419a-8cc7-cbad06c93254:15062:1874160212076928:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787338808.503472:0:15062:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.153@tcp lock: ffff90bbf3c52000/0x83671231080c2581 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c2588 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338808.503481:0:15062:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.153@tcp lock: ffff90bbf3c52000/0x83671231080c2581 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x83671231080c2588 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787338808.504044:0:15062:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1787338808.504571:0:15062:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787338808.504897:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1787338808.504945:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1787338808.505022:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1787338808.505031:0:15062:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1787338808.505102:0:15062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc01e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c0e6575-df80-419a-8cc7-cbad06c93254:15062:1874160212077056:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787338808.505161:0:15062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338808.515806:0:15062:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbd07dd000 going to sleep for 11 seconds 00000100:00100000:0.0:1787338808.524786:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212077056 00000100:00100000:0.0:1787338808.524803:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212077056 00000100:00100000:0.0:1787338808.524864:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787338808.524901:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffd21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c0e6575-df80-419a-8cc7-cbad06c93254+15:15062:x1874160212077056:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787338808.525267:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffd21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c0e6575-df80-419a-8cc7-cbad06c93254+15:15062:x1874160212077056:12345-0@lo:501:mount.lustre.0 Request processed in 368us (20103us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338808.525281:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787338808.525395:0:15062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc01e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c0e6575-df80-419a-8cc7-cbad06c93254:15062:1874160212077056:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787338808.525449:0:15062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc01e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c0e6575-df80-419a-8cc7-cbad06c93254:15062:1874160212077184:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787338808.525495:0:15062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338808.525531:0:15062:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbd07dd000 going to sleep for 11 seconds 00000100:00100000:1.0:1787338808.525616:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212077184 00000100:00100000:1.0:1787338808.525621:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212077184 00000100:00100000:1.0:1787338808.525647:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787338808.525654:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffd21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c0e6575-df80-419a-8cc7-cbad06c93254+15:15062:x1874160212077184:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787338808.525810:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffd21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c0e6575-df80-419a-8cc7-cbad06c93254+15:15062:x1874160212077184:12345-0@lo:503:mount.lustre.0 Request processed in 155us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338808.525817:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787338808.526110:0:15062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc01e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c0e6575-df80-419a-8cc7-cbad06c93254:15062:1874160212077184:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787338808.526628:0:15062:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787338808.526699:0:15062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc01e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c0e6575-df80-419a-8cc7-cbad06c93254:15062:1874160212077312:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787338808.526748:0:15062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338808.526790:0:15062:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc34150c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787338808.526915:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212077312 00000100:00100000:0.0:1787338808.526921:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212077312 00000100:00100000:0.0:1787338808.526947:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787338808.526956:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffd23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c0e6575-df80-419a-8cc7-cbad06c93254+15:15062:x1874160212077312:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787338808.527131:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffd23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c0e6575-df80-419a-8cc7-cbad06c93254+15:15062:x1874160212077312:12345-0@lo:502:mount.lustre.0 Request processed in 175us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338808.527139:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787338808.527500:0:15062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc01e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c0e6575-df80-419a-8cc7-cbad06c93254:15062:1874160212077312:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787338808.527766:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1787338808.527817:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1787338808.527866:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1787338808.527937:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1787338808.527970:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1787338808.528027:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1787338808.528064:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1787338808.528115:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1787338808.528151:0:15062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc01e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c0e6575-df80-419a-8cc7-cbad06c93254:15062:1874160212077440:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787338808.528213:0:15062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338808.528254:0:15062:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbd07dd000 going to sleep for 11 seconds 00000100:00100000:0.0:1787338808.528323:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212077440 00000100:00100000:0.0:1787338808.528329:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212077440 00000100:00100000:0.0:1787338808.528369:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787338808.528379:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffd21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c0e6575-df80-419a-8cc7-cbad06c93254+15:15062:x1874160212077440:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787338808.528549:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffd21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c0e6575-df80-419a-8cc7-cbad06c93254+15:15062:x1874160212077440:12345-0@lo:502:mount.lustre.0 Request processed in 171us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338808.528557:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787338808.528708:0:15062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc01e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c0e6575-df80-419a-8cc7-cbad06c93254:15062:1874160212077440:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787338808.528803:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1787338808.528813:0:15062:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:2.0:1787338808.530749:0:15080:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787338808.530766:0:15080:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787338808.530769:0:15080:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787338808.530778:0:15080:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90bbc2e86800 00000020:00000080:2.0:1787338808.530781:0:15080:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787338808.530789:0:15080:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787338808.530792:0:15080:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787338808.530794:0:15080:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1787338808.530811:0:15080:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787338808.530815:0:15080:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787338808.530816:0:15080:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787338808.530820:0:15080:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90bbc2e86800 00000020:00000080:2.0:1787338808.530822:0:15080:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787338808.531143:0:15080:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787338808.531149:0:15080:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787338808.531151:0:15080:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1787338808.531174:0:15080:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787338808.531178:0:15080:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787338808.531180:0:15080:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787338808.531184:0:15080:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90bbc2e86800 00000020:00000080:2.0:1787338808.531186:0:15080:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787338808.533085:0:15080:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787338808.533096:0:15080:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787338808.533098:0:15080:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1787338808.533103:0:15080:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:1.0:1787338808.544811:0:15062:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1787338808.544858:0:15062:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787338808.544904:0:15062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbf3c52000/0x83671231080c2581 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c2588 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338808.544925:0:15062:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.153@tcp lock: ffff90bbf3c52000/0x83671231080c2581 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c2588 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787338808.544982:0:15062:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787338808.544986:0:15062:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff90bbc2e86800 10000000:01000000:1.0:1787338808.544989:0:15062:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff90bbc2e86800 10000000:01000000:1.0:1787338808.545002:0:15062:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787338808.545009:0:15062:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90bbc2e86800 from 1 10000000:01000000:1.0:1787338808.545011:0:15062:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787338808.545051:0:15062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9de00/0x83671231080c258f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338808.545060:0:15062:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9de00/0x83671231080c258f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338808.545070:0:15062:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9de00/0x83671231080c258f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338808.545094:0:15062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf4704e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c0e6575-df80-419a-8cc7-cbad06c93254:15062:1874160212077568:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787338808.545181:0:15062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338808.545235:0:15062:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc7c286c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787338808.545373:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212077568 00000100:00100000:0.0:1787338808.545380:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212077568 00000100:00100000:0.0:1787338808.545432:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787338808.545443:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffd22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c0e6575-df80-419a-8cc7-cbad06c93254+15:15062:x1874160212077568:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787338808.545456:0:14373:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787338808.545471:0:14373:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90bbffef4e00/0x83671231080c2596 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x83671231080c258f expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338808.545497:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bbffef4e00/0x83671231080c2596 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x83671231080c258f expref: 16 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338808.545506:0:14373:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90bbffef4e00/0x83671231080c2596 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c258f expref: 16 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338808.545522:0:14373:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbffef4e00, rc 0) 00000100:00100000:0.0:1787338808.545563:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffd22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c0e6575-df80-419a-8cc7-cbad06c93254+16:15062:x1874160212077568:12345-0@lo:101:mount.lustre.0 Request processed in 121us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338808.545569:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787338808.546178:0:15062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf4704e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c0e6575-df80-419a-8cc7-cbad06c93254:15062:1874160212077568:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787338808.546197:0:15062:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9de00/0x83671231080c258f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c2596 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338808.546207:0:15062:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9de00/0x83671231080c258f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x83671231080c2596 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787338808.546834:0:15062:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:1.0:1787338808.547214:0:15062:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787338808.547475:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1787338808.547519:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1787338808.547555:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1787338808.547601:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1787338808.547651:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1787338808.547701:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1787338808.547738:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1787338808.547772:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1787338808.547821:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1787338808.547858:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1787338808.547929:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1787338808.547978:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1787338808.548033:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1787338808.548067:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1787338808.548119:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1787338808.548156:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1787338808.548191:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1787338808.548240:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1787338808.548274:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1787338808.548306:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1787338808.548374:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1787338808.548413:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1787338808.548449:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1787338808.548498:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1787338808.548538:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1787338808.548572:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1787338808.548623:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1787338808.548660:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1787338808.548739:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1787338808.548756:0:15062:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:1.0:1787338808.548858:0:15062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf4704e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c0e6575-df80-419a-8cc7-cbad06c93254:15062:1874160212077696:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787338808.548955:0:15062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338808.551336:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212077696 00000100:00100000:3.0:1787338808.551350:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212077696 00000100:00100000:3.0:1787338808.551406:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787338808.551416:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffd20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c0e6575-df80-419a-8cc7-cbad06c93254+16:15062:x1874160212077696:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787338808.551764:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffd20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c0e6575-df80-419a-8cc7-cbad06c93254+16:15062:x1874160212077696:12345-0@lo:501:mount.lustre.0 Request processed in 349us (2808us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338808.551774:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787338808.565337:0:15062:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc7c286c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787338808.565378:0:15062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf4704e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c0e6575-df80-419a-8cc7-cbad06c93254:15062:1874160212077696:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787338808.565434:0:15062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf4704e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c0e6575-df80-419a-8cc7-cbad06c93254:15062:1874160212077824:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787338808.565505:0:15062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338808.565541:0:15062:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc7c286c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787338808.565597:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212077824 00000100:00100000:3.0:1787338808.565604:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212077824 00000100:00100000:3.0:1787338808.565659:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787338808.565670:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffd23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c0e6575-df80-419a-8cc7-cbad06c93254+16:15062:x1874160212077824:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787338808.565906:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffd23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c0e6575-df80-419a-8cc7-cbad06c93254+16:15062:x1874160212077824:12345-0@lo:503:mount.lustre.0 Request processed in 236us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338808.565914:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787338808.567393:0:15062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf4704e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c0e6575-df80-419a-8cc7-cbad06c93254:15062:1874160212077824:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787338808.570295:0:15062:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787338808.570391:0:15062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf4704e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c0e6575-df80-419a-8cc7-cbad06c93254:15062:1874160212077952:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787338808.570475:0:15062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338808.570528:0:15062:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc7c286c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787338808.570658:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212077952 00000100:00100000:3.0:1787338808.570667:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212077952 00000100:00100000:3.0:1787338808.570713:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787338808.570723:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffd20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c0e6575-df80-419a-8cc7-cbad06c93254+16:15062:x1874160212077952:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787338808.571029:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffd20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c0e6575-df80-419a-8cc7-cbad06c93254+16:15062:x1874160212077952:12345-0@lo:502:mount.lustre.0 Request processed in 306us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338808.571037:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787338808.574223:0:15062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf4704e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c0e6575-df80-419a-8cc7-cbad06c93254:15062:1874160212077952:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787338808.574581:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1787338808.574647:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1787338808.574683:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1787338808.574728:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1787338808.577203:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1787338808.577336:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1787338808.577377:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1787338808.577411:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1787338808.577461:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1787338808.577496:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1787338808.577526:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1787338808.577569:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1787338808.577603:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1787338808.577647:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1787338808.577697:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1787338808.577737:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1787338808.577774:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1787338808.577820:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1787338808.577856:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1787338808.577914:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1787338808.577984:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1787338808.578036:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1787338808.578071:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1787338808.578122:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1787338808.578158:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1787338808.578192:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1787338808.578267:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1787338808.578305:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1787338808.578336:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1787338808.578400:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1787338808.578443:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1787338808.578480:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1787338808.578516:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1787338808.578568:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1787338808.578607:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1787338808.578657:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1787338808.578711:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1787338808.578749:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1787338808.578802:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1787338808.578837:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1787338808.578917:0:15062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf4704e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c0e6575-df80-419a-8cc7-cbad06c93254:15062:1874160212078080:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787338808.587086:0:15062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338808.587166:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212078080 00000100:00100000:1.0:1787338808.587171:0:15062:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc7c286c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787338808.587176:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212078080 00000100:00100000:3.0:1787338808.587235:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787338808.587245:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffd21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c0e6575-df80-419a-8cc7-cbad06c93254+16:15062:x1874160212078080:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787338808.587531:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffd21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c0e6575-df80-419a-8cc7-cbad06c93254+16:15062:x1874160212078080:12345-0@lo:502:mount.lustre.0 Request processed in 287us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338808.587540:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787338808.587706:0:15062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf4704e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c0e6575-df80-419a-8cc7-cbad06c93254:15062:1874160212078080:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787338808.587825:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1787338808.587849:0:15062:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1787338808.590360:0:15085:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1787338808.590376:0:15085:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff90bbffd83370) 00000020:00000080:1.0:1787338808.590459:0:15085:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:1.0:1787338808.590545:0:15085:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90bbc2e86800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787338808.590550:0:15085:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90bbc2e86800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787338808.590552:0:15085:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90bbc2e86800 3 00010000:00080000:1.0:1787338808.590583:0:15085:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90bbc673e000@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.153@tcp at head 00010000:00010000:0.0:1787338808.592978:0:15085:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:0.0:1787338808.593185:0:15085:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1787338808.593223:0:15085:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787338808.593242:0:15085:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x83671231080c25a4 00000100:00080000:0.0:1787338808.593254:0:15085:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787338808.593260:0:15085:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff90bbc673e000 using connection 192.168.201.153@tcp/0@lo 00000100:00100000:0.0:1787338808.593295:0:15085:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90bbc4095f80 x1874160212078208/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787338808.593321:0:15085:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787338808.601054:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc4095f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3313:1874160212078208:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787338808.601142:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787338808.601222:0:13151:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787338808.601227:0:13151:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787338808.601230:0:13151:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787338808.601233:0:13151:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:0.0:1787338808.601702:0:15085:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:0.0:1787338808.601760:0:15062:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1787338808.601787:0:15062:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787338808.601803:0:15062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9de00/0x83671231080c258f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c2596 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338808.601816:0:15062:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9de00/0x83671231080c258f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c2596 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787338808.601863:0:15062:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787338808.601865:0:15062:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787338808.601866:0:15062:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787338808.601867:0:15062:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787338808.601868:0:15062:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787338808.601869:0:15062:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787338808.602029:0:15062:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787338808.602031:0:15062:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787338808.602033:0:15062:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787338808.602037:0:15062:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1787338808.602039:0:15062:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787338808.602041:0:15062:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787338808.602042:0:15062:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787338808.602043:0:15062:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787338808.602043:0:15062:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787338808.602044:0:15062:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787338808.602045:0:15062:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787338808.602046:0:15062:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787338808.602047:0:15062:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787338808.602066:0:15062:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1787338808.602204:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212078208 00000100:00100000:1.0:1787338808.602212:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212078208 00000100:00100000:1.0:1787338808.602246:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787338808.602254:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc01e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3313:x1874160212078208:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787338808.602254:0:15062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc4097b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c0e6575-df80-419a-8cc7-cbad06c93254:15062:1874160212078464:0@lo:253:mount.lustre.0 00010000:00080000:1.0:1787338808.602288:0:14381:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 461 last 0 00000100:00100000:0.0:1787338808.602318:0:15062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:1.0:1787338808.602321:0:14381:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x83671231080c25ab 00000004:00100000:1.0:1787338808.602338:0:14381:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:0.0:1787338808.602346:0:15062:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbd8ecf900 going to sleep for 11 seconds 00000100:00080000:1.0:1787338808.602373:0:14381:0:(import.c:65:import_set_state_nolock()) ffff90bbc6739800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787338808.602441:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc01e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874160212078208:12345-0@lo:38:llog_process_th.0 Request processed in 186us (1299us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338808.602449:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787338808.602489:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff90bbc4095f80 x1874160212078208/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787338818 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787338808.602499:0:3313:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787338808.602506:0:3313:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:1.0:1787338808.602512:0:3313:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787338808.602516:0:3313:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787338808.602518:0:3313:0:(import.c:65:import_set_state_nolock()) ffff90bbc673e000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787338808.602529:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc4095f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3313:1874160212078208:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787338808.602703:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc01ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874160212078336:0@lo:400:kworker.0 00000100:00100000:3.0:1787338808.602736:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338808.602790:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212078336 00000100:00100000:3.0:1787338808.602795:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212078336 00000100:00100000:3.0:1787338808.602834:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787338808.602842:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbedcb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874160212078336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787338808.603448:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbedcb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874160212078336:12345-0@lo:400:kworker.0 Request processed in 604us (709us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338808.603456:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787338808.603475:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff90bbfc01ea00 x1874160212078336/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787338824 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787338808.603479:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212078464 00000100:00100000:3.0:1787338808.603483:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212078464 00000100:00100000:1.0:1787338808.603486:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc01ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874160212078336:0@lo:400:kworker.0 00000100:00100000:3.0:1787338808.603516:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787338808.603523:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf3d77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c0e6575-df80-419a-8cc7-cbad06c93254+16:15062:x1874160212078464:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787338808.603555:0:14376:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1787338808.603568:0:14376:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1787338808.642765:0:14376:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787338808.642830:0:14376:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1787338808.644454:0:14397:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787338808.644464:0:14397:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787338808.644839:0:14397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90bbfbe9cc00/0x83671231080c25b2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338808.644859:0:14397:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90bbf7ea4400/0x83671231080c251f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c2518 expref: 16 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338808.644869:0:14397:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90bbfbe9cc00/0x83671231080c25b2 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338808.644935:0:14397:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90bbf7ea4400/0x83671231080c251f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x83671231080c2518 expref: 16 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338808.644949:0:14397:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90bbf7ea4400/0x83671231080c251f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x83671231080c2518 expref: 16 pid: 14373 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338808.644963:0:14397:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf4704e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14397:1874160212078592:0@lo:104: 00000100:00100000:2.0:1787338808.646093:0:14397:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338808.646164:0:14397:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc7c28cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787338808.646316:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212078592 00000100:00100000:3.0:1787338808.646329:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212078592 00000100:00100000:3.0:1787338808.646399:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787338808.646412:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc01d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2c0e6575-df80-419a-8cc7-cbad06c93254+3:14397:x1874160212078592:12345-0@lo:104: 00010000:00010000:3.0:1787338808.646431:0:14364:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9d400/0x83671231080c2518 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x83671231080c251f expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338808.646511:0:14364:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787338808.646518:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc01d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2c0e6575-df80-419a-8cc7-cbad06c93254+3:14397:x1874160212078592:12345-0@lo:104: Request processed in 110us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338808.646525:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1787338808.646548:0:14369:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787338808.646555:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9d400/0x83671231080c2518 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x83671231080c251f expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338808.646572:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbfbe9d400 already unused, calling callback (ffffffffc1b2ec20) 10000000:00010000:3.0:1787338808.646577:0:14369:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9d400/0x83671231080c2518 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x83671231080c251f expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338808.646602:0:14369:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9d400/0x83671231080c2518 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x83671231080c251f expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787338808.646610:0:14369:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9d400/0x83671231080c2518 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x83671231080c251f expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787338808.646617:0:14369:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787338808.646653:0:14369:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9d400/0x83671231080c2518 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c251f expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338808.646660:0:14369:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787338808.646683:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9d400/0x83671231080c2518 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c251f expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338808.646692:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9d400/0x83671231080c2518 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c251f expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338808.646708:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338808.646710:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338808.646712:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787338808.646733:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbedcb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c0e6575-df80-419a-8cc7-cbad06c93254:3315:1874160212078720:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787338808.646772:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338808.646969:0:14397:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf4704e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14397:1874160212078592:0@lo:104: 00010000:00010000:0.0:1787338808.647004:0:14397:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90bbfbe9cc00/0x83671231080c25b2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338808.647562:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212078720 00000100:00100000:1.0:1787338808.647572:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212078720 00010000:00010000:1.0:1787338808.647604:0:14368:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90bbf7ea4400/0x83671231080c251f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x83671231080c2518 expref: 17 pid: 14373 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338808.647640:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787338808.647649:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbedcb6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c0e6575-df80-419a-8cc7-cbad06c93254+17:3315:x1874160212078720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787338808.647662:0:14368:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787338808.647680:0:14368:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90bbf7ea4400/0x83671231080c251f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x83671231080c2518 expref: 17 pid: 14373 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338808.647693:0:14368:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90bbf7ea4400/0x83671231080c251f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x83671231080c2518 expref: 17 pid: 14373 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338808.647708:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90bbf7ea4400/0x83671231080c251f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x83671231080c2518 expref: 17 pid: 14373 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338808.647724:0:14368:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90bbfbe9cc00/0x83671231080c25b2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338808.647732:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bbfbe9cc00/0x83671231080c25b2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787338808.647749:0:14368:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003286042s 00010000:00010000:1.0:1787338808.647753:0:14368:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90bbfbe9cc00/0x83671231080c25b2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338808.647761:0:14368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90bbfbe9cc00/0x83671231080c25b2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338808.647768:0:14368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90bbfbe9cc00/0x83671231080c25b2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338808.647776:0:14368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90bbfbe9cc00/0x83671231080c25b2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338808.647782:0:14368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbfbe9cc00 already unused, calling callback (ffffffffc1546230) 00010000:00010000:1.0:1787338808.647787:0:14368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90bbfbe9cc00/0x83671231080c25b2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338808.647806:0:14368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90bbfbe9cc00/0x83671231080c25b2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338808.649440:0:14397:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90bbfbe9cc00/0x83671231080c25b2 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338808.649456:0:14397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90bbfbe9cc00/0x83671231080c25b2 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338808.649519:0:14368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90bbfbe9cc00/0x83671231080c25b2 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338808.649530:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90bbfbe9cc00/0x83671231080c25b2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338808.649549:0:14368:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787338808.650735:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbedcb6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c0e6575-df80-419a-8cc7-cbad06c93254+16:3315:x1874160212078720:12345-0@lo:103:ldlm_bl.0 Request processed in 3081us (3956us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338808.650758:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787338808.651573:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf3d77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c0e6575-df80-419a-8cc7-cbad06c93254+15:15062:x1874160212078464:12345-0@lo:253:mount.lustre.0 Request processed in 48046us (49250us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338808.651584:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787338808.651685:0:15062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc4097b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c0e6575-df80-419a-8cc7-cbad06c93254:15062:1874160212078464:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787338808.651715:0:15062:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1787338808.651718:0:15062:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787338808.651720:0:15062:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787338808.651721:0:15062:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787338808.651722:0:15062:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787338808.651724:0:15062:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787338808.651725:0:15062:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787338808.651726:0:15062:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787338808.651728:0:15062:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787338808.651729:0:15062:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787338808.651745:0:15062:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1787338808.655408:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbedcb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c0e6575-df80-419a-8cc7-cbad06c93254:3315:1874160212078720:0@lo:103:ldlm_bl.0 00080000:10000000:1.0:1787338808.656407:0:15062:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1787338808.656596:0:15062:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1787338808.656759:0:15062:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1787338808.656945:0:15062:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1787338808.657126:0:15062:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1787338808.657476:0:15062:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1787338808.658309:0:15062:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1787338808.741065:0:15062:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1787338808.741089:0:15062:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1787338808.741131:0:15062:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787338808.741194:0:15062:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.153@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787338808.741281:0:15062:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1787338808.741347:0:15062:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1787338809.270861:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787338809.910237:0:14378:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787338809.910247:0:14378:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90bbc8428000 from 7 10000000:01000000:0.0:1787338809.910252:0:14378:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787338809.910307:0:14378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbffef5400/0x83671231080c25b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338809.910320:0:14378:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.153@tcp lock: ffff90bbffef5400/0x83671231080c25b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338809.910331:0:14378:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.153@tcp lock: ffff90bbffef5400/0x83671231080c25b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338809.910359:0:14378:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc4097b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c0e6575-df80-419a-8cc7-cbad06c93254:14378:1874160212078848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787338809.910446:0:14378:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338809.910519:0:14378:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbfbcd8480 going to sleep for 11 seconds 00000100:00100000:3.0:1787338809.910827:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212078848 00000100:00100000:3.0:1787338809.910837:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212078848 00000100:00100000:3.0:1787338809.910928:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787338809.910939:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c0e6575-df80-419a-8cc7-cbad06c93254+15:14378:x1874160212078848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787338809.910954:0:14375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787338809.910988:0:14375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90bbf7ea4000/0x83671231080c25c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x83671231080c25b9 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338809.911012:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bbf7ea4000/0x83671231080c25c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x83671231080c25b9 expref: 16 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338809.911024:0:14375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90bbf7ea4000/0x83671231080c25c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c25b9 expref: 16 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338809.911036:0:14375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf7ea4000, rc 0) 00000100:00100000:3.0:1787338809.911088:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c0e6575-df80-419a-8cc7-cbad06c93254+16:14378:x1874160212078848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 151us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338809.911094:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787338809.911281:0:14378:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc4097b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c0e6575-df80-419a-8cc7-cbad06c93254:14378:1874160212078848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787338809.911296:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.153@tcp lock: ffff90bbffef5400/0x83671231080c25b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c25c0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338809.911306:0:14378:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.153@tcp lock: ffff90bbffef5400/0x83671231080c25b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x83671231080c25c0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338809.911374:0:14378:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf4705c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c0e6575-df80-419a-8cc7-cbad06c93254:14378:1874160212078976:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787338809.911408:0:14378:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338809.911439:0:14378:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbd1b79cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787338809.911615:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212078976 00000100:00100000:3.0:1787338809.911620:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212078976 00000100:00100000:3.0:1787338809.911658:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787338809.911666:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c0e6575-df80-419a-8cc7-cbad06c93254+16:14378:x1874160212078976:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1787338809.911679:0:14376:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787338809.911697:0:14376:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787338809.911700:0:14376:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1787338809.911778:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c0e6575-df80-419a-8cc7-cbad06c93254+16:14378:x1874160212078976:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 112us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338809.911785:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787338809.911816:0:14378:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf4705c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c0e6575-df80-419a-8cc7-cbad06c93254:14378:1874160212078976:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787338809.911905:0:14378:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.153@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787338809.911913:0:14378:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbffef5400/0x83671231080c25b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c25c0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338809.911921:0:14378:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.153@tcp lock: ffff90bbffef5400/0x83671231080c25b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c25c0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338810.304071:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787338811.319061:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787338812.343650:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787338813.373319:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787338814.070721:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787338814.070731:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787338814.070740:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787338814.070743:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787338814.070802:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc4094380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c0e6575-df80-419a-8cc7-cbad06c93254:3316:1874160212079104:0@lo:400:kworker.0 00000100:00100000:0.0:1787338814.070944:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338814.071003:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787338814.071010:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc4094a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874160212079232:0@lo:400:kworker.0 00000100:00100000:0.0:1787338814.071042:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338814.071079:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc4094000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1874160212079360:0@lo:400:kworker.0 00000100:00100000:0.0:1787338814.071106:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338814.071143:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212079104 00000100:00100000:0.0:1787338814.071152:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212079104 00000100:00100000:0.0:1787338814.071202:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787338814.071213:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c0e6575-df80-419a-8cc7-cbad06c93254+16:3316:x1874160212079104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787338814.071263:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c0e6575-df80-419a-8cc7-cbad06c93254+16:3316:x1874160212079104:12345-0@lo:400:kworker.0 Request processed in 52us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338814.071271:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787338814.071304:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212079232 00000100:00100000:0.0:1787338814.071307:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212079232 00000100:00100000:0.0:1787338814.071329:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212079360 00000100:00100000:0.0:1787338814.071332:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212079360 00000100:00100000:0.0:1787338814.071354:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787338814.071360:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4097100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874160212079232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787338814.071392:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4097100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874160212079232:12345-0@lo:400:kworker.0 Request processed in 31us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338814.071398:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787338814.071409:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787338814.071425:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4097800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874160212079360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787338814.071457:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4097800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874160212079360:12345-0@lo:400:kworker.0 Request processed in 33us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338814.071463:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787338814.071532:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90bbc4094000 x1874160212079360/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787338830 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787338814.071547:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc4094000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1874160212079360:0@lo:400:kworker.0 00010000:00080000:0.0:1787338814.071578:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90bbc4094a80 x1874160212079232/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787338830 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787338814.071586:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc4094a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874160212079232:0@lo:400:kworker.0 00000100:00100000:0.0:1787338814.071594:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc4094380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c0e6575-df80-419a-8cc7-cbad06c93254:3316:1874160212079104:0@lo:400:kworker.0 00000100:00080000:1.0:1787338814.073251:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787338814.390561:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787338815.355770:0:15429:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg153-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787338815.416653:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338816.441834:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787338817.462032:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787338817.911145:0:14412:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787338818.486053:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787338819.191223:0:13151:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787338819.191231:0:13151:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787338819.191235:0:13151:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787338819.191239:0:13151:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787338819.191307:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbedcb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c0e6575-df80-419a-8cc7-cbad06c93254:3315:1874160212079488:0@lo:400:kworker.0 00000100:00100000:3.0:1787338819.191415:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338819.191511:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbedcb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874160212079616:0@lo:400:kworker.0 00000100:00100000:3.0:1787338819.191559:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338819.191583:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787338819.191588:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbedcb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874160212079744:0@lo:400:kworker.0 00000100:00100000:3.0:1787338819.191615:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338819.191644:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212079488 00000100:00100000:3.0:1787338819.191651:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212079488 00000100:00100000:3.0:1787338819.191922:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787338819.191934:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c0e6575-df80-419a-8cc7-cbad06c93254+16:3315:x1874160212079488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787338819.191997:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c0e6575-df80-419a-8cc7-cbad06c93254+16:3315:x1874160212079488:12345-0@lo:400:kworker.0 Request processed in 66us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338819.192005:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787338819.192046:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212079616 00000100:00100000:3.0:1787338819.192051:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212079616 00000100:00100000:3.0:1787338819.192108:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212079744 00000100:00100000:3.0:1787338819.192111:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212079744 00000100:00100000:3.0:1787338819.192156:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787338819.192162:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbedcb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874160212079616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787338819.192195:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbedcb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874160212079616:12345-0@lo:400:kworker.0 Request processed in 33us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338819.192200:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787338819.192210:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787338819.192215:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbedcb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874160212079744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787338819.192236:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbedcb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874160212079744:12345-0@lo:400:kworker.0 Request processed in 21us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338819.192242:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1787338819.192264:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787338819.192291:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90bbedcb7100 x1874160212079744/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787338835 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787338819.192303:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbedcb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874160212079744:0@lo:400:kworker.0 00010000:00080000:3.0:1787338819.192312:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90bbedcb5c00 x1874160212079616/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787338835 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787338819.192319:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbedcb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874160212079616:0@lo:400:kworker.0 00000100:00100000:3.0:1787338819.192342:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbedcb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c0e6575-df80-419a-8cc7-cbad06c93254:3315:1874160212079488:0@lo:400:kworker.0 00010000:00010000:0.0:1787338819.510138:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338820.534960:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787338820.854021:0:3313:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787338805/real 1787338805] req@ffff90bbf4704380 x1874160212075776/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787338820 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787338820.854062:0:3313:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90bbf4704380 x1874160212075776/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787338820 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787338820.854072:0:3313:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787338805/real 1787338805] req@ffff90bbf4705f80 x1874160212075520/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787338820 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787338820.854084:0:3313:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90bbf4705f80 x1874160212075520/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787338820 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787338820.854105:0:3313:0:(import.c:65:import_set_state_nolock()) ffff90bbc93ac800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787338820.854142:0:3313:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787338820.854146:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf4704380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1874160212075776:0@lo:8:kworker.0 00000100:00080000:2.0:1787338820.854152:0:3313:0:(import.c:65:import_set_state_nolock()) ffff90bbf40f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787338820.854158:0:3313:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787338820.854161:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf4705f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1874160212075520:0@lo:8:kworker.0 00000100:00100000:1.0:1787338820.854382:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00080000:3.0:1787338820.854402:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787338820.854406:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787338820.854409:0:37:0:(import.c:65:import_set_state_nolock()) ffff90bbc93ac800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787338820.854414:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 458 00000100:00080000:3.0:1787338820.854419:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787338820.854439:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff90bbc93ac800 using connection 192.168.201.153@tcp/0@lo 00000100:00100000:0.0:1787338820.854727:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbedcb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c0e6575-df80-419a-8cc7-cbad06c93254:3315:1874160212079872:0@lo:400:kworker.0 00000100:00100000:0.0:1787338820.854812:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338820.854954:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212079872 00000100:00100000:2.0:1787338820.854963:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212079872 00000100:00100000:2.0:1787338820.855016:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787338820.855033:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c0e6575-df80-419a-8cc7-cbad06c93254+16:3315:x1874160212079872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787338820.855089:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90bbf4706680 x1874160212080000/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787338820.855091:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c0e6575-df80-419a-8cc7-cbad06c93254+16:3315:x1874160212079872:12345-0@lo:400:kworker.0 Request processed in 60us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338820.855098:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787338820.855149:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbedcb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c0e6575-df80-419a-8cc7-cbad06c93254:3315:1874160212079872:0@lo:400:kworker.0 00000100:00100000:3.0:1787338820.855211:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf4706680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1874160212080000:0@lo:8:kworker.0 00000100:00100000:3.0:1787338820.855243:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338820.855329:0:15063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212080000 00000100:00100000:0.0:1787338820.855334:0:15063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212080000 00000100:00100000:0.0:1787338820.855361:0:15063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787338820.855367:0:15063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbedcb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3313:x1874160212080000:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1787338820.855433:0:15063:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 473 last 0 00000020:00000080:0.0:1787338820.855467:0:15063:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x83671231080c25c7 00002000:00100000:0.0:1787338820.855485:0:15063:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff90bbef177800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211392c ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1787338820.855496:0:15063:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1787338820.855499:0:15063:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787338820.855935:0:15063:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787338820.855961:0:15063:0:(import.c:65:import_set_state_nolock()) ffff90bbef175800 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1787338820.856287:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787338820.856294:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787338820.856296:0:37:0:(import.c:65:import_set_state_nolock()) ffff90bbf40f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787338820.856301:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 458 00000100:00080000:1.0:1787338820.856305:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787338820.856310:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff90bbf40f3800 using connection 192.168.201.153@tcp/0@lo 00000100:00100000:1.0:1787338820.856333:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90bbf4707b80 x1874160212080128/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787338820.856586:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf4707b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1874160212080128:0@lo:8:kworker.0 00000100:00100000:3.0:1787338820.856618:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338820.856734:0:15066:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1787338820.856745:0:15066:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1787338820.857448:0:15066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212080128 00000100:00100000:2.0:1787338820.857456:0:15066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212080128 00000100:00100000:2.0:1787338820.857551:0:15650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787338820.857560:0:15650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbedcb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3313:x1874160212080128:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1787338820.857582:0:15650:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787338820.857639:0:15650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbedcb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3313:x1874160212080128:12345-0@lo:8:kworker.0 Request processed in 79us (1019us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787338820.857646:0:15650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787338820.858052:0:15063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbedcb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3313:x1874160212080000:12345-0@lo:8:kworker.0 Request processed in 2681us (2806us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338820.858058:0:15063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787338820.858271:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf4706a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874160212080256:0@lo:400:kworker.0 00000100:00100000:0.0:1787338820.858311:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338820.858408:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212080256 00000100:00100000:2.0:1787338820.858414:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212080256 00000100:00100000:2.0:1787338820.858456:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787338820.858463:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4094380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874160212080256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787338820.858506:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4094380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874160212080256:12345-0@lo:400:kworker.0 Request processed in 43us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338820.858512:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1787338820.858594:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90bbf4706a00 x1874160212080256/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787338836 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787338820.858612:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf4706a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874160212080256:0@lo:400:kworker.0 00000100:00100000:2.0:1787338820.859079:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf4707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874160212080384:0@lo:400:kworker.0 00000100:00100000:2.0:1787338820.859113:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338820.859179:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212080384 00000100:00100000:0.0:1787338820.859192:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212080384 00000100:00100000:0.0:1787338820.859222:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787338820.859230:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc01f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874160212080384:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1787338820.859452:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90bbf4706680 x1874160212080000/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787338840 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787338820.859462:0:3313:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787338820.859470:0:3313:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1787338820.859477:0:3313:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787338820.859481:0:3313:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1787338820.859484:0:3313:0:(import.c:65:import_set_state_nolock()) ffff90bbc93ac800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787338820.859535:0:3313:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787338820.859541:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf4706680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1874160212080000:0@lo:8:kworker.0 00000100:00100000:0.0:1787338820.859690:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc01f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874160212080384:12345-0@lo:400:kworker.0 Request processed in 460us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338820.859705:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000004:00080000:0.0:1787338820.859727:0:14403:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787338820.860289:0:14403:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 473701413929ns, next at 0ns, rc = 0 00000100:00080000:0.0:1787338820.860341:0:3313:0:(import.c:65:import_set_state_nolock()) ffff90bbf40f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787338820.860347:0:3313:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787338820.860351:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf4707b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1874160212080128:0@lo:8:kworker.0 00000004:00080000:1.0:1787338820.861304:0:14404:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:3.0:1787338820.861417:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf4704700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874160212080512:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787338820.861498:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338820.861591:0:14404:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf4706300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14404:1874160212080640:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1787338820.861622:0:14404:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338820.861645:0:14404:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbd0cd7480 going to sleep for 11 seconds 00000100:00100000:3.0:1787338820.861990:0:15066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212080640 00000100:00100000:3.0:1787338820.861997:0:15066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212080640 00000100:00100000:3.0:1787338820.862048:0:15066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787338820.862057:0:15066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf4705880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14404:x1874160212080640:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1787338820.863124:0:15067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212080512 00000100:00100000:0.0:1787338820.863137:0:15067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212080512 00000100:00100000:0.0:1787338820.863166:0:15067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787338820.863173:0:15067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbedcb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3317:x1874160212080512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787338820.863261:0:15067:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1787338820.863561:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787338820.863922:0:15067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbedcb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3317:x1874160212080512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 748us (2423us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338820.863931:0:15067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787338820.864027:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90bbf4704700 x1874160212080512/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787338836 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787338820.864048:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf4704700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874160212080512:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1787338820.865965:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90bbf4707480 x1874160212080384/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787338836 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787338820.865981:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf4707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874160212080384:0@lo:400:kworker.0 00002000:00080000:3.0:1787338820.867549:0:15066:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1787338820.867565:0:15066:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:3.0:1787338820.867572:0:15066:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00002000:00010000:3.0:1787338820.883329:0:15066:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787338820.884022:0:15066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f3186d5/0x83671231080c25ce lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.884055:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=473s v=(0 0) 00010000:00010000:3.0:1787338820.884059:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787338820.884066:0:15066:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f3186d5/0x83671231080c25ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.884085:0:15066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f3186d5/0x83671231080c25ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.884096:0:15066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f3186d5/0x83671231080c25ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.884104:0:15066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f3186d5/0x83671231080c25ce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.884632:0:15066:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787338820.884648:0:14370:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787338820.884654:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f3186d5/0x83671231080c25ce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.884663:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea5a00 already unused, calling callback (ffffffffc1546230) 00010000:00010000:3.0:1787338820.884667:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f3186d5/0x83671231080c25ce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.885610:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f3186d5/0x83671231080c25ce lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.885645:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f3186d5/0x83671231080c25ce lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.885651:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f3186d5/0x83671231080c25ce lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.885682:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338820.885684:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338820.885686:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787338820.886485:0:15066:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787338820.886492:0:15066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e1f24e3/0x83671231080c25d5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.886503:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=473s v=(0 0) 00010000:00010000:3.0:1787338820.886506:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787338820.886512:0:15066:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e1f24e3/0x83671231080c25d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.886521:0:15066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006e1f24e3/0x83671231080c25d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.886530:0:15066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e1f24e3/0x83671231080c25d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.886537:0:15066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006e1f24e3/0x83671231080c25d5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.886566:0:15066:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787338820.886902:0:14369:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787338820.886909:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006e1f24e3/0x83671231080c25d5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338820.886918:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea4400 already unused, calling callback (ffffffffc1546230) 00010000:00010000:2.0:1787338820.886922:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006e1f24e3/0x83671231080c25d5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338820.886930:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006e1f24e3/0x83671231080c25d5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338820.886946:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006e1f24e3/0x83671231080c25d5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338820.886953:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006e1f24e3/0x83671231080c25d5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338820.886969:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787338820.886970:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787338820.886972:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787338820.887283:0:15066:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787338820.887290:0:15066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4e7ed48/0x83671231080c25dc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.887298:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=473s v=(0 0) 00010000:00010000:3.0:1787338820.887301:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787338820.887306:0:15066:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a4e7ed48/0x83671231080c25dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.887315:0:15066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a4e7ed48/0x83671231080c25dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.887323:0:15066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4e7ed48/0x83671231080c25dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.887330:0:15066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a4e7ed48/0x83671231080c25dc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.887566:0:15066:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787338820.888114:0:15066:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787338820.888120:0:15066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000699ae558/0x83671231080c25e3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.888129:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=473s v=(0 0) 00010000:00010000:3.0:1787338820.888136:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787338820.888140:0:15066:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000699ae558/0x83671231080c25e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.888149:0:15066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000699ae558/0x83671231080c25e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.888156:0:15066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000699ae558/0x83671231080c25e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.888163:0:15066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000699ae558/0x83671231080c25e3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338820.893418:0:14370:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787338820.893438:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a4e7ed48/0x83671231080c25dc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338820.893453:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea5e00 already unused, calling callback (ffffffffc1546230) 00010000:00010000:2.0:1787338820.893458:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4e7ed48/0x83671231080c25dc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338820.893490:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4e7ed48/0x83671231080c25dc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338820.893512:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a4e7ed48/0x83671231080c25dc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338820.893519:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a4e7ed48/0x83671231080c25dc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338820.893543:0:14370:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787338820.893546:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000699ae558/0x83671231080c25e3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338820.893552:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea4e00 already unused, calling callback (ffffffffc1546230) 00010000:00010000:2.0:1787338820.893555:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000699ae558/0x83671231080c25e3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338820.893562:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000699ae558/0x83671231080c25e3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338820.893572:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000699ae558/0x83671231080c25e3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338820.893579:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787338820.893581:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787338820.893588:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338820.898589:0:15066:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787338820.898603:0:15066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000699ae558/0x83671231080c25e3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787338820.900504:0:15066:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787338820.900519:0:15066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000337a423a/0x83671231080c25ea lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.900540:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=473s v=(0 0) 00010000:00010000:3.0:1787338820.900546:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787338820.900554:0:15066:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000337a423a/0x83671231080c25ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.900572:0:15066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000337a423a/0x83671231080c25ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.900593:0:15066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000337a423a/0x83671231080c25ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.900602:0:15066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000337a423a/0x83671231080c25ea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338820.908466:0:14369:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787338820.908481:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000337a423a/0x83671231080c25ea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338820.908495:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea5600 already unused, calling callback (ffffffffc1546230) 00010000:00010000:2.0:1787338820.908500:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000337a423a/0x83671231080c25ea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338820.908510:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000337a423a/0x83671231080c25ea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338820.908531:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000337a423a/0x83671231080c25ea lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338820.908539:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787338820.908541:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787338820.908542:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338820.911639:0:15066:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787338820.911654:0:15066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000337a423a/0x83671231080c25ea lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338820.912905:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787338820.917943:0:15066:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787338820.917966:0:15066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000316c4f2c/0x83671231080c25f1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.917993:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=473s v=(0 0) 00010000:00010000:3.0:1787338820.918000:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787338820.918007:0:15066:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000316c4f2c/0x83671231080c25f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.918025:0:15066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000316c4f2c/0x83671231080c25f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.918037:0:15066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000316c4f2c/0x83671231080c25f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.918059:0:15066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000316c4f2c/0x83671231080c25f1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.918086:0:15066:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787338820.918106:0:14369:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787338820.918112:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000316c4f2c/0x83671231080c25f1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.918120:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea4a00 already unused, calling callback (ffffffffc1546230) 00010000:00010000:3.0:1787338820.918125:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000316c4f2c/0x83671231080c25f1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.918134:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000316c4f2c/0x83671231080c25f1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.918154:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000316c4f2c/0x83671231080c25f1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.918161:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000316c4f2c/0x83671231080c25f1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.919262:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338820.919269:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338820.919271:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787338820.920300:0:15066:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787338820.920321:0:15066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003ae84a4/0x83671231080c25f8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.920339:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=473s v=(0 0) 00010000:00010000:3.0:1787338820.920343:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787338820.920348:0:15066:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003ae84a4/0x83671231080c25f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.920362:0:15066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000003ae84a4/0x83671231080c25f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.920371:0:15066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003ae84a4/0x83671231080c25f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.920379:0:15066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000003ae84a4/0x83671231080c25f8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.920396:0:15066:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787338820.921515:0:14370:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787338820.921526:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000003ae84a4/0x83671231080c25f8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338820.921539:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea5c00 already unused, calling callback (ffffffffc1546230) 00010000:00010000:1.0:1787338820.921544:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000003ae84a4/0x83671231080c25f8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338820.921566:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000003ae84a4/0x83671231080c25f8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338820.921588:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000003ae84a4/0x83671231080c25f8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338820.921594:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000003ae84a4/0x83671231080c25f8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338820.921621:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338820.921622:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338820.921624:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787338820.922442:0:15066:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787338820.922456:0:15066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000337a423a/0x83671231080c25ff lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.922472:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=473s v=(0 0) 00010000:00010000:3.0:1787338820.922478:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787338820.922486:0:15066:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000337a423a/0x83671231080c25ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.922500:0:15066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000337a423a/0x83671231080c25ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.922526:0:15066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000337a423a/0x83671231080c25ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.922535:0:15066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000337a423a/0x83671231080c25ff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.922562:0:15066:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787338820.922757:0:14369:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787338820.922765:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000337a423a/0x83671231080c25ff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338820.922774:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea5600 already unused, calling callback (ffffffffc1546230) 00010000:00010000:1.0:1787338820.922801:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000337a423a/0x83671231080c25ff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338820.922810:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000337a423a/0x83671231080c25ff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338820.922827:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000337a423a/0x83671231080c25ff lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338820.922846:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000337a423a/0x83671231080c25ff lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338820.922864:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338820.922866:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338820.922868:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787338820.940700:0:15066:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787338820.940714:0:15066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000316c4f2c/0x83671231080c2606 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.940730:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=473s v=(0 0) 00010000:00010000:3.0:1787338820.940735:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787338820.940741:0:15066:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000316c4f2c/0x83671231080c2606 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.940754:0:15066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000316c4f2c/0x83671231080c2606 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.940763:0:15066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000316c4f2c/0x83671231080c2606 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.940770:0:15066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000316c4f2c/0x83671231080c2606 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.940944:0:15066:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787338820.941553:0:15066:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787338820.941560:0:15066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000699ae558/0x83671231080c260d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.941571:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=473s v=(0 0) 00010000:00010000:3.0:1787338820.941574:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787338820.941579:0:15066:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000699ae558/0x83671231080c260d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.941589:0:15066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000699ae558/0x83671231080c260d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.941598:0:15066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000699ae558/0x83671231080c260d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.941606:0:15066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000699ae558/0x83671231080c260d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.941622:0:15066:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787338820.941632:0:14369:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787338820.941639:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000316c4f2c/0x83671231080c2606 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.941646:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea4a00 already unused, calling callback (ffffffffc1546230) 00010000:00010000:3.0:1787338820.941656:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000316c4f2c/0x83671231080c2606 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.941665:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000316c4f2c/0x83671231080c2606 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338820.941784:0:14370:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787338820.941987:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000316c4f2c/0x83671231080c2606 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.941997:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000316c4f2c/0x83671231080c2606 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.942013:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338820.942015:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338820.942017:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787338820.942613:0:15066:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787338820.942621:0:15066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f3186d5/0x83671231080c2614 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.942631:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=473s v=(0 0) 00010000:00010000:3.0:1787338820.942634:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787338820.942639:0:15066:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f3186d5/0x83671231080c2614 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.942648:0:15066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f3186d5/0x83671231080c2614 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.942656:0:15066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f3186d5/0x83671231080c2614 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.942670:0:15066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f3186d5/0x83671231080c2614 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.943050:0:15066:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787338820.943551:0:15066:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787338820.943560:0:15066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010ca6bfa/0x83671231080c261b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338820.943571:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=473s v=(0 0) 00010000:00010000:2.0:1787338820.943575:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787338820.943579:0:15066:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010ca6bfa/0x83671231080c261b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338820.943600:0:15066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010ca6bfa/0x83671231080c261b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338820.943609:0:15066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010ca6bfa/0x83671231080c261b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338820.943618:0:15066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010ca6bfa/0x83671231080c261b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338820.944009:0:14369:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787338820.944018:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f3186d5/0x83671231080c2614 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338820.944027:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea5a00 already unused, calling callback (ffffffffc1546230) 00010000:00010000:1.0:1787338820.944031:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f3186d5/0x83671231080c2614 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338820.944039:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f3186d5/0x83671231080c2614 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338820.944054:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f3186d5/0x83671231080c2614 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338820.944060:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f3186d5/0x83671231080c2614 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338820.944074:0:14369:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787338820.944077:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010ca6bfa/0x83671231080c261b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338820.944089:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf3c53400 already unused, calling callback (ffffffffc1546230) 00010000:00010000:1.0:1787338820.944092:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010ca6bfa/0x83671231080c261b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338820.944099:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010ca6bfa/0x83671231080c261b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338820.944108:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010ca6bfa/0x83671231080c261b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338820.944115:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338820.944116:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338820.944118:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338820.946129:0:15652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338820.946141:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000699ae558/0x83671231080c260d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338820.946153:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea4e00 already unused, calling callback (ffffffffc1546230) 00010000:00010000:1.0:1787338820.946157:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000699ae558/0x83671231080c260d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338820.946168:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000699ae558/0x83671231080c260d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338820.946196:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000699ae558/0x83671231080c260d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338820.946216:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000699ae558/0x83671231080c260d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338820.946237:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338820.946238:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338820.946241:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338820.946247:0:15652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338820.946249:0:15652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787338820.948135:0:15066:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787338820.948147:0:15066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010ca6bfa/0x83671231080c261b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787338820.950596:0:15066:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787338820.950614:0:15066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9333e1a/0x83671231080c2622 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338820.950635:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=473s v=(0 0) 00010000:00010000:2.0:1787338820.950640:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787338820.950647:0:15066:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9333e1a/0x83671231080c2622 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338820.950662:0:15066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9333e1a/0x83671231080c2622 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338820.951266:0:15066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9333e1a/0x83671231080c2622 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338820.951274:0:15066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d9333e1a/0x83671231080c2622 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338820.951294:0:15066:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787338820.951829:0:14369:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787338820.951838:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d9333e1a/0x83671231080c2622 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.951846:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf3c52200 already unused, calling callback (ffffffffc1546230) 00010000:00010000:3.0:1787338820.951851:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9333e1a/0x83671231080c2622 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.951862:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9333e1a/0x83671231080c2622 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.951899:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d9333e1a/0x83671231080c2622 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.951907:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9333e1a/0x83671231080c2622 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.951928:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338820.951930:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338820.951932:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787338820.954444:0:15066:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787338820.954461:0:15066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014a9f122/0x83671231080c2629 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338820.954478:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=473s v=(0 0) 00010000:00010000:2.0:1787338820.954482:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787338820.954488:0:15066:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000014a9f122/0x83671231080c2629 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338820.954500:0:15066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000014a9f122/0x83671231080c2629 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338820.954510:0:15066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014a9f122/0x83671231080c2629 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338820.954517:0:15066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000014a9f122/0x83671231080c2629 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338820.954593:0:15066:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787338820.956315:0:15066:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787338820.956326:0:15066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003cc00a2/0x83671231080c2630 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338820.956341:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=473s v=(0 0) 00010000:00010000:2.0:1787338820.956345:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787338820.956350:0:15066:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003cc00a2/0x83671231080c2630 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338820.956362:0:15066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000003cc00a2/0x83671231080c2630 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338820.956370:0:15066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003cc00a2/0x83671231080c2630 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338820.956377:0:15066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000003cc00a2/0x83671231080c2630 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.957038:0:15652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787338820.957059:0:15652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000014a9f122/0x83671231080c2629 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.957070:0:15652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf3c53200 already unused, calling callback (ffffffffc1546230) 00010000:00010000:3.0:1787338820.957075:0:15652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000014a9f122/0x83671231080c2629 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.957085:0:15652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000014a9f122/0x83671231080c2629 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.957105:0:15652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000014a9f122/0x83671231080c2629 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.957112:0:15652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000014a9f122/0x83671231080c2629 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.957130:0:15652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787338820.957134:0:15652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000003cc00a2/0x83671231080c2630 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.957140:0:15652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf3c52a00 already unused, calling callback (ffffffffc1546230) 00010000:00010000:3.0:1787338820.957143:0:15652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000003cc00a2/0x83671231080c2630 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.957150:0:15652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000003cc00a2/0x83671231080c2630 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.957171:0:15652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000003cc00a2/0x83671231080c2630 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.959785:0:15652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338820.959801:0:15652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338820.959805:0:15652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787338820.961913:0:15066:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787338820.961928:0:15066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000003cc00a2/0x83671231080c2630 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338820.961975:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787338820.962863:0:15066:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787338820.962907:0:15066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005187540e/0x83671231080c2637 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338820.962921:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=473s v=(0 0) 00010000:00010000:2.0:1787338820.962926:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787338820.962932:0:15066:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005187540e/0x83671231080c2637 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338820.962945:0:15066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005187540e/0x83671231080c2637 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338820.962954:0:15066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005187540e/0x83671231080c2637 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338820.962961:0:15066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005187540e/0x83671231080c2637 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338820.962979:0:15066:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787338820.965009:0:15066:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787338820.965023:0:15066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001c71a9a/0x83671231080c263e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338820.965039:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=473s v=(0 0) 00010000:00010000:2.0:1787338820.965043:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787338820.965048:0:15066:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001c71a9a/0x83671231080c263e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338820.965059:0:15066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001c71a9a/0x83671231080c263e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338820.965076:0:15066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001c71a9a/0x83671231080c263e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338820.965084:0:15066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000001c71a9a/0x83671231080c263e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338820.965107:0:15066:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787338820.965393:0:14369:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787338820.965402:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005187540e/0x83671231080c2637 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.965412:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf3c52800 already unused, calling callback (ffffffffc1546230) 00010000:00010000:3.0:1787338820.965416:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005187540e/0x83671231080c2637 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.965427:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005187540e/0x83671231080c2637 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.965445:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005187540e/0x83671231080c2637 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.965453:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005187540e/0x83671231080c2637 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.965471:0:14369:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787338820.965474:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000001c71a9a/0x83671231080c263e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.965492:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf3c52e00 already unused, calling callback (ffffffffc1546230) 00010000:00010000:3.0:1787338820.965496:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000001c71a9a/0x83671231080c263e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.965503:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000001c71a9a/0x83671231080c263e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.965512:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000001c71a9a/0x83671231080c263e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.965520:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001c71a9a/0x83671231080c263e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.965531:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338820.965533:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338820.965534:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338820.965927:0:15652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338820.966770:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787338820.968404:0:15066:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787338820.968420:0:15066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000433f254a/0x83671231080c2645 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338820.968436:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=473s v=(0 0) 00010000:00010000:2.0:1787338820.968440:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787338820.968445:0:15066:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000433f254a/0x83671231080c2645 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338820.968458:0:15066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000433f254a/0x83671231080c2645 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338820.968468:0:15066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000433f254a/0x83671231080c2645 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338820.968474:0:15066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000433f254a/0x83671231080c2645 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338820.968504:0:15066:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787338820.968517:0:14369:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787338820.968522:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000433f254a/0x83671231080c2645 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338820.968528:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf3c53c00 already unused, calling callback (ffffffffc1546230) 00010000:00010000:2.0:1787338820.968532:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000433f254a/0x83671231080c2645 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338820.968539:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000433f254a/0x83671231080c2645 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338820.968555:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000433f254a/0x83671231080c2645 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338820.968561:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000433f254a/0x83671231080c2645 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338820.968577:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787338820.968578:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787338820.968580:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787338820.973034:0:15066:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787338820.973051:0:15066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d81b2a98/0x83671231080c264c lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338820.973070:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=473s v=(0 0) 00010000:00010000:2.0:1787338820.973082:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787338820.973089:0:15066:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d81b2a98/0x83671231080c264c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338820.973103:0:15066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d81b2a98/0x83671231080c264c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338820.973113:0:15066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d81b2a98/0x83671231080c264c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338820.973120:0:15066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d81b2a98/0x83671231080c264c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338820.973136:0:15066:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787338820.975100:0:15652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787338820.975113:0:15652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d81b2a98/0x83671231080c264c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.975127:0:15652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e3000 already unused, calling callback (ffffffffc1546230) 00010000:00010000:3.0:1787338820.975132:0:15652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d81b2a98/0x83671231080c264c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.975162:0:15652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d81b2a98/0x83671231080c264c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.975276:0:15652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d81b2a98/0x83671231080c264c lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.975284:0:15652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d81b2a98/0x83671231080c264c lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.975305:0:15652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338820.975307:0:15652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338820.975309:0:15652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787338820.977565:0:15066:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787338820.977577:0:15066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067580d13/0x83671231080c2653 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338820.977593:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=473s v=(0 0) 00010000:00010000:2.0:1787338820.977597:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787338820.977603:0:15066:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067580d13/0x83671231080c2653 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338820.977615:0:15066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067580d13/0x83671231080c2653 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338820.977626:0:15066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067580d13/0x83671231080c2653 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338820.977639:0:15066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067580d13/0x83671231080c2653 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338820.977664:0:15066:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787338820.978080:0:15066:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787338820.978086:0:15066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4fa2797/0x83671231080c265a lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338820.978094:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=473s v=(0 0) 00010000:00010000:2.0:1787338820.978096:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787338820.978100:0:15066:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4fa2797/0x83671231080c265a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338820.978107:0:15066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e4fa2797/0x83671231080c265a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338820.978114:0:15066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4fa2797/0x83671231080c265a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338820.978120:0:15066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e4fa2797/0x83671231080c265a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338820.980641:0:15066:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1787338820.981540:0:15066:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787338820.981551:0:15066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7e9fe58/0x83671231080c2661 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338820.981572:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=473s v=(0 0) 00010000:00010000:2.0:1787338820.981577:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787338820.981583:0:15066:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b7e9fe58/0x83671231080c2661 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338820.981595:0:15066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b7e9fe58/0x83671231080c2661 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338820.981604:0:15066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7e9fe58/0x83671231080c2661 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338820.981612:0:15066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b7e9fe58/0x83671231080c2661 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.982466:0:14369:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787338820.982476:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067580d13/0x83671231080c2653 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.982488:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e3a00 already unused, calling callback (ffffffffc1546230) 00010000:00010000:3.0:1787338820.982493:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067580d13/0x83671231080c2653 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.982501:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067580d13/0x83671231080c2653 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.982520:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067580d13/0x83671231080c2653 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.982544:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067580d13/0x83671231080c2653 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.982630:0:14369:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787338820.982635:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e4fa2797/0x83671231080c265a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.982641:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e3e00 already unused, calling callback (ffffffffc1546230) 00010000:00010000:3.0:1787338820.982644:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4fa2797/0x83671231080c265a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.982651:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4fa2797/0x83671231080c265a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.982660:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e4fa2797/0x83671231080c265a lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.982666:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e4fa2797/0x83671231080c265a lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.982677:0:14369:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787338820.982681:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b7e9fe58/0x83671231080c2661 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.982686:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e2800 already unused, calling callback (ffffffffc1546230) 00010000:00010000:3.0:1787338820.982696:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7e9fe58/0x83671231080c2661 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.982703:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7e9fe58/0x83671231080c2661 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.982711:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b7e9fe58/0x83671231080c2661 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.982717:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338820.982719:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338820.982720:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338820.982855:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787338820.983570:0:15066:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787338820.983578:0:15066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b7e9fe58/0x83671231080c2661 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787338820.983612:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:2.0:1787338820.984200:0:15066:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787338820.984208:0:15066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000abd97688/0x83671231080c2668 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338820.984221:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=473s v=(0 0) 00010000:00010000:2.0:1787338820.984225:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787338820.984231:0:15066:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000abd97688/0x83671231080c2668 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338820.984252:0:15066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000abd97688/0x83671231080c2668 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338820.984263:0:15066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000abd97688/0x83671231080c2668 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338820.984271:0:15066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000abd97688/0x83671231080c2668 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.984440:0:15652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787338820.984446:0:15652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000abd97688/0x83671231080c2668 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.984453:0:15652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e2e00 already unused, calling callback (ffffffffc1546230) 00010000:00010000:3.0:1787338820.984458:0:15652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000abd97688/0x83671231080c2668 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.984465:0:15652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000abd97688/0x83671231080c2668 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.984478:0:15652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000abd97688/0x83671231080c2668 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338820.984562:0:15066:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787338820.984566:0:15066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000abd97688/0x83671231080c2668 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338820.984809:0:15652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787338820.984812:0:15652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787338820.985008:0:15066:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787338820.985013:0:15066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ccd4cd8/0x83671231080c266f lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338820.985021:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=473s v=(0 0) 00010000:00010000:2.0:1787338820.985024:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787338820.985028:0:15066:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ccd4cd8/0x83671231080c266f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338820.985036:0:15066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ccd4cd8/0x83671231080c266f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338820.985053:0:15066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ccd4cd8/0x83671231080c266f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338820.985059:0:15066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ccd4cd8/0x83671231080c266f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.985104:0:14369:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787338820.985112:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ccd4cd8/0x83671231080c266f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.985118:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e2000 already unused, calling callback (ffffffffc1546230) 00010000:00010000:3.0:1787338820.985121:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ccd4cd8/0x83671231080c266f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.985128:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ccd4cd8/0x83671231080c266f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.985139:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ccd4cd8/0x83671231080c266f lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.985146:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338820.985147:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338820.985149:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787338820.986007:0:15066:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787338820.986016:0:15066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ccd4cd8/0x83671231080c266f lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338820.986079:0:15652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787338820.986561:0:15066:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787338820.986568:0:15066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007bcb55fc/0x83671231080c2676 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338820.986578:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=473s v=(0 0) 00010000:00010000:2.0:1787338820.986581:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787338820.986586:0:15066:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007bcb55fc/0x83671231080c2676 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338820.986595:0:15066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007bcb55fc/0x83671231080c2676 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338820.986603:0:15066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007bcb55fc/0x83671231080c2676 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338820.986619:0:15066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007bcb55fc/0x83671231080c2676 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338820.986914:0:14370:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787338820.986921:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007bcb55fc/0x83671231080c2676 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338820.986928:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e2200 already unused, calling callback (ffffffffc1546230) 00010000:00010000:1.0:1787338820.986933:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007bcb55fc/0x83671231080c2676 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338820.986940:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007bcb55fc/0x83671231080c2676 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338820.986956:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007bcb55fc/0x83671231080c2676 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338820.986963:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338820.986964:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338820.986972:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787338820.987019:0:15066:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787338820.987024:0:15066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007bcb55fc/0x83671231080c2676 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.987298:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787338820.987646:0:15066:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787338820.987653:0:15066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b77f5d0/0x83671231080c267d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338820.987664:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=473s v=(0 0) 00010000:00010000:0.0:1787338820.987667:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787338820.987673:0:15066:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b77f5d0/0x83671231080c267d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338820.987693:0:15066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b77f5d0/0x83671231080c267d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338820.987701:0:15066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b77f5d0/0x83671231080c267d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338820.987708:0:15066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b77f5d0/0x83671231080c267d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338820.987737:0:15066:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787338820.987803:0:15652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787338820.987809:0:15652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b77f5d0/0x83671231080c267d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.987817:0:15652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbffef4200 already unused, calling callback (ffffffffc1546230) 00010000:00010000:3.0:1787338820.987820:0:15652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b77f5d0/0x83671231080c267d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.987828:0:15652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b77f5d0/0x83671231080c267d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.987852:0:15652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b77f5d0/0x83671231080c267d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.987859:0:15652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b77f5d0/0x83671231080c267d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338820.987903:0:15652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338820.987905:0:15652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338820.987907:0:15652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787338820.988378:0:15066:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787338820.988385:0:15066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ae237a6/0x83671231080c2684 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338820.988394:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=473s v=(0 0) 00010000:00010000:0.0:1787338820.988397:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787338820.988402:0:15066:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ae237a6/0x83671231080c2684 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338820.988411:0:15066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ae237a6/0x83671231080c2684 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338820.988419:0:15066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ae237a6/0x83671231080c2684 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338820.988426:0:15066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ae237a6/0x83671231080c2684 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338820.988447:0:15066:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787338820.988552:0:14370:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787338820.988559:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ae237a6/0x83671231080c2684 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338820.988566:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbffef5c00 already unused, calling callback (ffffffffc1546230) 00010000:00010000:1.0:1787338820.988570:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ae237a6/0x83671231080c2684 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338820.988578:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ae237a6/0x83671231080c2684 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338820.988591:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ae237a6/0x83671231080c2684 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338820.988598:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ae237a6/0x83671231080c2684 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1787338820.988606:0:15066:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00010000:00010000:1.0:1787338820.988612:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338820.988614:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338820.988615:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787338820.988719:0:15066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf4705880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14404:x1874160212080640:12345-0@lo:5:osp-pre-0-0.0 Request processed in 126659us (127092us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338820.988729:0:15066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787338820.989831:0:14404:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf4706300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14404:1874160212080640:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1787338820.989848:0:14404:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:1.0:1787338820.989929:0:14404:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf4706300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14404:1874160212080768:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1787338820.989970:0:14404:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338820.990014:0:14404:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbd0cd7480 going to sleep for 11 seconds 00000100:00100000:2.0:1787338820.990074:0:15650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212080768 00000100:00100000:2.0:1787338820.990080:0:15650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212080768 00000100:00100000:2.0:1787338820.990117:0:15650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787338820.990126:0:15650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf4704700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:14404:x1874160212080768:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1787338820.990162:0:15650:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:2.0:1787338820.994953:0:15650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf4704700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:14404:x1874160212080768:12345-0@lo:5:osp-pre-0-0.0 Request processed in 4820us (4974us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1787338820.994965:0:15650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787338820.997642:0:14404:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf4706300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14404:1874160212080768:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1787338820.997667:0:14404:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:3.0:1787338821.558965:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338822.582131:0:15652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787338823.380936:0:15781:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787338823.380941:0:15781:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1787338823.381091:0:15781:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff90bac2048000 00000020:01000004:1.0:1787338823.381105:0:15781:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1787338823.381117:0:15781:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1787338823.381129:0:15781:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff90bbffd80000) 00000020:00000080:1.0:1787338823.381144:0:15781:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1787338823.398987:0:15781:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1787338823.400078:0:15781:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1787338823.400856:0:15781:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1787338823.401173:0:15781:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:1.0:1787338823.401433:0:15781:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1787338823.401722:0:15781:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 485: rc = 0 00100000:10000000:1.0:1787338823.401846:0:15781:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 485: rc = 0 00100000:10000000:1.0:1787338823.402019:0:15781:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 485: rc = 0 00100000:10000000:1.0:1787338823.402453:0:15781:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 549: rc = 0 00100000:10000000:1.0:1787338823.403593:0:15781:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 549: rc = 0 00100000:10000000:1.0:1787338823.404677:0:15781:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 549: rc = 0 00100000:10000000:1.0:1787338823.405079:0:15781:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 549: rc = 0 00100000:10000000:1.0:1787338823.405476:0:15781:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 549: rc = 0 00100000:10000000:1.0:1787338823.405747:0:15781:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 549: rc = 0 00000020:00000080:1.0:1787338823.406679:0:15781:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1787338823.406691:0:15781:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787338823.406702:0:15781:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x83671231080c2692 00000020:01000004:1.0:1787338823.406711:0:15781:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:1.0:1787338823.406748:0:15781:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.153@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1787338823.406752:0:15781:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.153@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1787338823.406759:0:15781:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1787338823.406782:0:15781:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:1.0:1787338823.406787:0:15781:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.153@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1787338823.422843:0:15781:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.153@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787338823.422907:0:15781:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.153@tcp, index=0001, flags=0x20002 00000020:01000004:0.0:1787338823.422915:0:15781:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787338823.422917:0:15781:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787338823.422919:0:15781:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787338823.422920:0:15781:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787338823.422921:0:15781:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787338823.422922:0:15781:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787338823.422924:0:15781:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787338823.422926:0:15781:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787338823.422927:0:15781:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787338823.422931:0:15781:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:0.0:1787338823.422933:0:15781:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787338823.422934:0:15781:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787338823.422935:0:15781:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787338823.422936:0:15781:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787338823.422937:0:15781:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787338823.422938:0:15781:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787338823.422939:0:15781:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787338823.422940:0:15781:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787338823.422941:0:15781:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787338823.422971:0:15781:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1787338823.422991:0:15781:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc4094a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c0e6575-df80-419a-8cc7-cbad06c93254:15781:1874160212080896:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787338823.423067:0:15781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338823.425574:0:15781:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc6171cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787338823.425673:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212080896 00000100:00100000:3.0:1787338823.425683:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212080896 00000100:00100000:3.0:1787338823.425788:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787338823.425799:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c0e6575-df80-419a-8cc7-cbad06c93254+16:15781:x1874160212080896:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787338823.425831:0:14376:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1787338823.425834:0:14376:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:3.0:1787338823.425837:0:14376:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1787338823.442788:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c0e6575-df80-419a-8cc7-cbad06c93254+16:15781:x1874160212080896:12345-0@lo:253:mount.lustre.0 Request processed in 16979us (19708us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338823.442804:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787338823.442810:0:15781:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc4094a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c0e6575-df80-419a-8cc7-cbad06c93254:15781:1874160212080896:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787338823.442826:0:15781:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1787338823.442829:0:15781:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787338823.442831:0:15781:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787338823.442832:0:15781:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787338823.442833:0:15781:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787338823.442834:0:15781:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787338823.442835:0:15781:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787338823.442837:0:15781:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787338823.442839:0:15781:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787338823.442840:0:15781:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787338823.442860:0:15781:0:(tgt_mount.c:101:server_register_mount()) register mount ffff90bac2048000 from lustre-OST0001 10000000:01000000:0.0:1787338823.442916:0:15781:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1787338823.442920:0:15781:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1787338823.442941:0:15781:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff90bbee0a99b8 local copy 00010000:00010000:0.0:1787338823.442952:0:15781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbf3c52600/0x83671231080c243f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c2446 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338823.443221:0:15781:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc4094a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c0e6575-df80-419a-8cc7-cbad06c93254:15781:1874160212081024:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787338823.443255:0:15781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338823.443333:0:15781:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbfaccc9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787338823.443790:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212081024 00000100:00100000:2.0:1787338823.443797:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212081024 00000100:00100000:1.0:1787338823.446058:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787338823.446080:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c0e6575-df80-419a-8cc7-cbad06c93254+16:15781:x1874160212081024:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787338823.446429:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c0e6575-df80-419a-8cc7-cbad06c93254+16:15781:x1874160212081024:12345-0@lo:501:mount.lustre.0 Request processed in 359us (3171us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787338823.446438:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787338823.446492:0:15781:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc4094a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c0e6575-df80-419a-8cc7-cbad06c93254:15781:1874160212081024:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1787338823.446518:0:15781:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.153@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1787338823.446697:0:15781:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.153@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1787338823.446708:0:15781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbf3c52600/0x83671231080c243f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c2446 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338823.446719:0:15781:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.153@tcp lock: ffff90bbf3c52600/0x83671231080c243f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c2446 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787338823.446761:0:15781:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff90bac2048000 10000000:01000000:0.0:1787338823.446767:0:15781:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787338823.446771:0:15781:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1787338823.446774:0:15781:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787338823.446778:0:15781:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1787338823.446780:0:15781:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1787338823.446810:0:15781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbffef5e00/0x83671231080c2699 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338823.446818:0:15781:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.153@tcp lock: ffff90bbffef5e00/0x83671231080c2699 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338823.446827:0:15781:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.153@tcp lock: ffff90bbffef5e00/0x83671231080c2699 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338823.446864:0:15781:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc4094a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c0e6575-df80-419a-8cc7-cbad06c93254:15781:1874160212081152:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787338823.446938:0:15781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338823.446969:0:15781:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbfaccc9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787338823.447373:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212081152 00000100:00100000:1.0:1787338823.447380:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212081152 00000100:00100000:1.0:1787338823.447426:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787338823.447433:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c0e6575-df80-419a-8cc7-cbad06c93254+16:15781:x1874160212081152:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787338823.447443:0:14376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787338823.447456:0:14376:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90bbfbe9c800/0x83671231080c26a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x83671231080c2699 expref: -99 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338823.447477:0:14376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bbfbe9c800/0x83671231080c26a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x83671231080c2699 expref: 17 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338823.447487:0:14376:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90bbfbe9c800/0x83671231080c26a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c2699 expref: 17 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338823.447496:0:14376:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbfbe9c800, rc 0) 00000100:00100000:1.0:1787338823.447542:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c0e6575-df80-419a-8cc7-cbad06c93254+17:15781:x1874160212081152:12345-0@lo:101:mount.lustre.0 Request processed in 109us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338823.447548:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787338823.447637:0:15781:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc4094a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c0e6575-df80-419a-8cc7-cbad06c93254:15781:1874160212081152:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787338823.447653:0:15781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.153@tcp lock: ffff90bbffef5e00/0x83671231080c2699 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c26a0 expref: -99 pid: 15781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338823.447663:0:15781:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.153@tcp lock: ffff90bbffef5e00/0x83671231080c2699 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x83671231080c26a0 expref: -99 pid: 15781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787338823.450666:0:15781:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1787338823.452136:0:15781:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787338823.452423:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1787338823.452467:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1787338823.452501:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1787338823.452551:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1787338823.452588:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1787338823.452618:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1787338823.452684:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1787338823.452692:0:15781:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1787338823.452817:0:15781:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf4707480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c0e6575-df80-419a-8cc7-cbad06c93254:15781:1874160212081280:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787338823.452919:0:15781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338823.452973:0:15781:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbd0cd79c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787338823.453059:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212081280 00000100:00100000:2.0:1787338823.453066:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212081280 00000100:00100000:2.0:1787338823.453123:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787338823.453134:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee098850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c0e6575-df80-419a-8cc7-cbad06c93254+17:15781:x1874160212081280:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787338823.453496:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee098850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c0e6575-df80-419a-8cc7-cbad06c93254+17:15781:x1874160212081280:12345-0@lo:501:mount.lustre.0 Request processed in 363us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338823.453504:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787338823.453603:0:15781:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf4707480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c0e6575-df80-419a-8cc7-cbad06c93254:15781:1874160212081280:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787338823.453638:0:15781:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc4094a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c0e6575-df80-419a-8cc7-cbad06c93254:15781:1874160212081408:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787338823.453675:0:15781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338823.453697:0:15781:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbfaccc9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787338823.453823:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212081408 00000100:00100000:1.0:1787338823.453829:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212081408 00000100:00100000:1.0:1787338823.453923:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787338823.453931:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee099050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c0e6575-df80-419a-8cc7-cbad06c93254+17:15781:x1874160212081408:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787338823.454234:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee099050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c0e6575-df80-419a-8cc7-cbad06c93254+17:15781:x1874160212081408:12345-0@lo:503:mount.lustre.0 Request processed in 304us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338823.454241:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787338823.454786:0:15781:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc4094a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c0e6575-df80-419a-8cc7-cbad06c93254:15781:1874160212081408:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787338823.455604:0:15781:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787338823.455691:0:15781:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc4094a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c0e6575-df80-419a-8cc7-cbad06c93254:15781:1874160212081536:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787338823.455776:0:15781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338823.455837:0:15781:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbfaccc9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787338823.455980:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212081536 00000100:00100000:3.0:1787338823.455988:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212081536 00000100:00100000:3.0:1787338823.456034:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787338823.456043:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee09ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c0e6575-df80-419a-8cc7-cbad06c93254+17:15781:x1874160212081536:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787338823.456264:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee09ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c0e6575-df80-419a-8cc7-cbad06c93254+17:15781:x1874160212081536:12345-0@lo:502:mount.lustre.0 Request processed in 222us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338823.456273:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787338823.456554:0:15781:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc4094a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c0e6575-df80-419a-8cc7-cbad06c93254:15781:1874160212081536:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787338823.456852:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1787338823.456948:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1787338823.456978:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1787338823.457030:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1787338823.457075:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1787338823.457110:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1787338823.457171:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1787338823.457211:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1787338823.457271:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:0.0:1787338823.457498:0:15781:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc4094a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c0e6575-df80-419a-8cc7-cbad06c93254:15781:1874160212081664:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787338823.457558:0:15781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338823.457594:0:15781:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbfaccc9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787338823.457707:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212081664 00000100:00100000:1.0:1787338823.457714:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212081664 00000100:00100000:1.0:1787338823.457760:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787338823.457775:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee099450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c0e6575-df80-419a-8cc7-cbad06c93254+17:15781:x1874160212081664:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787338823.457985:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee099450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c0e6575-df80-419a-8cc7-cbad06c93254+17:15781:x1874160212081664:12345-0@lo:502:mount.lustre.0 Request processed in 216us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338823.457998:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787338823.458104:0:15781:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc4094a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c0e6575-df80-419a-8cc7-cbad06c93254:15781:1874160212081664:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787338823.458179:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:0.0:1787338823.458189:0:15781:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:0.0:1787338823.460632:0:15782:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787338823.460644:0:15782:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1787338823.460651:0:15782:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787338823.460653:0:15782:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1787338823.460660:0:15782:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787338823.460675:0:15782:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff90bbde3e99b8) 00000020:00000080:0.0:1787338823.460702:0:15782:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:0.0:1787338823.460707:0:15782:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787338823.460795:0:15782:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90bac2048000 from lustre-OST0001, refs=2 00080000:01000000:0.0:1787338823.460804:0:15782:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787338823.460811:0:15782:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x83671231080c26ae 00010000:00010000:0.0:1787338823.465475:0:15782:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:0.0:1787338823.466443:0:15782:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:0.0:1787338823.468558:0:15782:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1787338823.475389:0:15782:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1787338823.475408:0:15782:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787338823.475433:0:15782:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787338823.475435:0:15782:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1787338823.475439:0:15782:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787338823.475444:0:15782:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787338823.475467:0:15782:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787338823.475472:0:15782:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787338823.475474:0:15782:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787338823.475477:0:15782:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787338823.475480:0:15782:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787338823.475481:0:15782:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:0.0:1787338823.475484:0:15782:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787338823.475486:0:15782:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787338823.475488:0:15782:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787338823.475492:0:15782:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1787338823.475562:0:15782:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787338823.475566:0:15782:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787338823.475567:0:15782:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787338823.475571:0:15782:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:1.0:1787338823.476656:0:15781:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1787338823.476691:0:15781:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.153@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1787338823.476706:0:15781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbffef5e00/0x83671231080c2699 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c26a0 expref: -99 pid: 15781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338823.476720:0:15781:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.153@tcp lock: ffff90bbffef5e00/0x83671231080c2699 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c26a0 expref: -99 pid: 15781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787338823.476727:0:15781:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90bac2048000 from 1 10000000:01000000:1.0:1787338823.476742:0:15781:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787338823.476790:0:15781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9d200/0x83671231080c26b5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338823.476801:0:15781:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9d200/0x83671231080c26b5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338823.476814:0:15781:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9d200/0x83671231080c26b5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338823.476849:0:15781:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf4707b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c0e6575-df80-419a-8cc7-cbad06c93254:15781:1874160212081792:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787338823.477128:0:15781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338823.477211:0:15781:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbd0cd7240 going to sleep for 11 seconds 00000100:00100000:3.0:1787338823.477724:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212081792 00000100:00100000:3.0:1787338823.477756:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212081792 00000100:00100000:3.0:1787338823.477851:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787338823.477862:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee09a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c0e6575-df80-419a-8cc7-cbad06c93254+17:15781:x1874160212081792:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787338823.477908:0:14376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787338823.477925:0:14376:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90bbf7ea4a00/0x83671231080c26bc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x83671231080c26b5 expref: -99 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338823.477952:0:14376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bbf7ea4a00/0x83671231080c26bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x83671231080c26b5 expref: 18 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338823.477962:0:14376:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90bbf7ea4a00/0x83671231080c26bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c26b5 expref: 18 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338823.477971:0:14376:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf7ea4a00, rc 0) 00000100:00100000:3.0:1787338823.478022:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee09a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c0e6575-df80-419a-8cc7-cbad06c93254+18:15781:x1874160212081792:12345-0@lo:101:mount.lustre.0 Request processed in 162us (894us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338823.478029:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787338823.479863:0:15781:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf4707b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c0e6575-df80-419a-8cc7-cbad06c93254:15781:1874160212081792:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787338823.479929:0:15781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9d200/0x83671231080c26b5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c26bc expref: -99 pid: 15781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338823.479942:0:15781:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9d200/0x83671231080c26b5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x83671231080c26bc expref: -99 pid: 15781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787338823.480525:0:15781:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1787338823.481218:0:15781:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787338823.481482:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1787338823.481531:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1787338823.481596:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1787338823.481604:0:15781:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1787338823.481673:0:15781:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc01ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c0e6575-df80-419a-8cc7-cbad06c93254:15781:1874160212081920:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787338823.481753:0:15781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338823.482241:0:15781:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc7c843c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787338823.482278:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212081920 00000100:00100000:0.0:1787338823.482341:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212081920 00000100:00100000:1.0:1787338823.482459:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787338823.482470:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee098c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c0e6575-df80-419a-8cc7-cbad06c93254+18:15781:x1874160212081920:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787338823.482703:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee098c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c0e6575-df80-419a-8cc7-cbad06c93254+18:15781:x1874160212081920:12345-0@lo:501:mount.lustre.0 Request processed in 234us (949us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338823.482711:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787338823.482794:0:15781:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc01ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c0e6575-df80-419a-8cc7-cbad06c93254:15781:1874160212081920:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787338823.482830:0:15781:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc4094a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c0e6575-df80-419a-8cc7-cbad06c93254:15781:1874160212082048:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787338823.482866:0:15781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338823.483146:0:15781:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc9261180 going to sleep for 11 seconds 00000100:00100000:3.0:1787338823.483185:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212082048 00000100:00100000:3.0:1787338823.483190:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212082048 00000100:00100000:3.0:1787338823.483212:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787338823.483220:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee099c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c0e6575-df80-419a-8cc7-cbad06c93254+18:15781:x1874160212082048:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787338823.483417:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee099c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c0e6575-df80-419a-8cc7-cbad06c93254+18:15781:x1874160212082048:12345-0@lo:503:mount.lustre.0 Request processed in 197us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338823.483424:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787338823.483565:0:15781:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc4094a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c0e6575-df80-419a-8cc7-cbad06c93254:15781:1874160212082048:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787338823.484256:0:15781:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787338823.484406:0:15781:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc4094a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c0e6575-df80-419a-8cc7-cbad06c93254:15781:1874160212082176:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787338823.484454:0:15781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338823.484482:0:15781:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc6171300 going to sleep for 11 seconds 00000100:00100000:2.0:1787338823.484542:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212082176 00000100:00100000:2.0:1787338823.484549:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212082176 00000100:00100000:2.0:1787338823.484581:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787338823.484589:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbff826450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c0e6575-df80-419a-8cc7-cbad06c93254+18:15781:x1874160212082176:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787338823.484759:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbff826450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c0e6575-df80-419a-8cc7-cbad06c93254+18:15781:x1874160212082176:12345-0@lo:502:mount.lustre.0 Request processed in 169us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338823.484767:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787338823.484936:0:15781:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc4094a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c0e6575-df80-419a-8cc7-cbad06c93254:15781:1874160212082176:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787338823.485175:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1787338823.485226:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1787338823.485282:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1787338823.485679:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1787338823.485725:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1787338823.485790:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1787338823.485825:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1787338823.485859:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:0.0:1787338823.486000:0:15781:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc4094a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c0e6575-df80-419a-8cc7-cbad06c93254:15781:1874160212082304:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787338823.486055:0:15781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338823.486128:0:15781:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc6171300 going to sleep for 11 seconds 00000100:00100000:1.0:1787338823.486232:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212082304 00000100:00100000:1.0:1787338823.486240:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212082304 00000100:00100000:2.0:1787338823.486524:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787338823.486533:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbff824050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c0e6575-df80-419a-8cc7-cbad06c93254+18:15781:x1874160212082304:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787338823.486742:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbff824050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c0e6575-df80-419a-8cc7-cbad06c93254+18:15781:x1874160212082304:12345-0@lo:502:mount.lustre.0 Request processed in 199us (676us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338823.486751:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787338823.486843:0:15781:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc4094a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c0e6575-df80-419a-8cc7-cbad06c93254:15781:1874160212082304:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787338823.486993:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1787338823.487008:0:15781:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1787338823.488021:0:15786:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787338823.488031:0:15786:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787338823.488033:0:15786:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787338823.488041:0:15786:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90bac2048000 00000020:00000080:0.0:1787338823.488043:0:15786:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787338823.488050:0:15786:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787338823.488052:0:15786:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787338823.488053:0:15786:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1787338823.488055:0:15786:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787338823.488057:0:15786:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787338823.488059:0:15786:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787338823.488062:0:15786:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90bac2048000 00000020:00000080:0.0:1787338823.488064:0:15786:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787338823.488116:0:15786:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787338823.488120:0:15786:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787338823.488121:0:15786:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1787338823.488124:0:15786:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787338823.488126:0:15786:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787338823.488127:0:15786:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787338823.488131:0:15786:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90bac2048000 00000020:00000080:0.0:1787338823.488132:0:15786:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787338823.488182:0:15786:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787338823.488186:0:15786:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787338823.488187:0:15786:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1787338823.488190:0:15786:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:1.0:1787338823.488556:0:15781:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1787338823.488578:0:15781:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787338823.488603:0:15781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9d200/0x83671231080c26b5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c26bc expref: -99 pid: 15781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338823.488617:0:15781:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9d200/0x83671231080c26b5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c26bc expref: -99 pid: 15781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787338823.488661:0:15781:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787338823.488664:0:15781:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff90bac2048000 10000000:01000000:1.0:1787338823.488668:0:15781:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff90bac2048000 10000000:01000000:1.0:1787338823.488673:0:15781:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787338823.488678:0:15781:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90bac2048000 from 1 10000000:01000000:1.0:1787338823.488681:0:15781:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787338823.488716:0:15781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9c600/0x83671231080c26c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338823.488725:0:15781:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9c600/0x83671231080c26c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338823.488756:0:15781:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9c600/0x83671231080c26c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338823.488790:0:15781:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf4706680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c0e6575-df80-419a-8cc7-cbad06c93254:15781:1874160212082432:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787338823.488853:0:15781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338823.488920:0:15781:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbd0cd7240 going to sleep for 11 seconds 00000100:00100000:2.0:1787338823.492559:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212082432 00000100:00100000:2.0:1787338823.492576:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212082432 00000100:00100000:2.0:1787338823.492638:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787338823.492650:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbff824450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c0e6575-df80-419a-8cc7-cbad06c93254+18:15781:x1874160212082432:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787338823.492666:0:14375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787338823.492685:0:14375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90bbf40e3c00/0x83671231080c26ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x83671231080c26c3 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338823.492711:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bbf40e3c00/0x83671231080c26ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x83671231080c26c3 expref: 19 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338823.492722:0:14375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90bbf40e3c00/0x83671231080c26ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c26c3 expref: 19 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338823.492741:0:14375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf40e3c00, rc 0) 00000100:00100000:2.0:1787338823.492825:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbff824450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c0e6575-df80-419a-8cc7-cbad06c93254+19:15781:x1874160212082432:12345-0@lo:101:mount.lustre.0 Request processed in 177us (3971us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338823.492833:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787338823.492987:0:15781:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf4706680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c0e6575-df80-419a-8cc7-cbad06c93254:15781:1874160212082432:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787338823.493005:0:15781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9c600/0x83671231080c26c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c26ca expref: -99 pid: 15781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338823.493024:0:15781:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9c600/0x83671231080c26c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x83671231080c26ca expref: -99 pid: 15781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787338823.493604:0:15781:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:1.0:1787338823.493954:0:15781:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787338823.494205:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1787338823.494249:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1787338823.494283:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1787338823.494328:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1787338823.494365:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1787338823.494412:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1787338823.494447:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1787338823.494475:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1787338823.494517:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1787338823.494547:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1787338823.494578:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1787338823.494623:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1787338823.494660:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1787338823.494696:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1787338823.494772:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1787338823.494809:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1787338823.494842:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1787338823.494916:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1787338823.494956:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1787338823.494986:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1787338823.495033:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1787338823.495067:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1787338823.495097:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1787338823.495147:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1787338823.495183:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1787338823.495217:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1787338823.495277:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1787338823.495311:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1787338823.495345:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1787338823.495394:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:1.0:1787338823.495455:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:1.0:1787338823.495488:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:1.0:1787338823.495519:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:1.0:1787338823.495566:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:1.0:1787338823.495599:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:1.0:1787338823.495643:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:1.0:1787338823.495676:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:1.0:1787338823.495779:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:1.0:1787338823.495788:0:15781:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:1.0:1787338823.495902:0:15781:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf4706680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c0e6575-df80-419a-8cc7-cbad06c93254:15781:1874160212082560:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787338823.495977:0:15781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338823.502350:0:15781:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbd0cd7240 going to sleep for 11 seconds 00000100:00100000:3.0:1787338823.505828:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212082560 00000100:00100000:3.0:1787338823.505849:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212082560 00000100:00100000:3.0:1787338823.505948:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787338823.505961:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbff825850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c0e6575-df80-419a-8cc7-cbad06c93254+19:15781:x1874160212082560:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787338823.508007:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbff825850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c0e6575-df80-419a-8cc7-cbad06c93254+19:15781:x1874160212082560:12345-0@lo:501:mount.lustre.0 Request processed in 2041us (12020us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338823.508021:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787338823.508974:0:15781:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf4706680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c0e6575-df80-419a-8cc7-cbad06c93254:15781:1874160212082560:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787338823.509032:0:15781:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc4094a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c0e6575-df80-419a-8cc7-cbad06c93254:15781:1874160212082688:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787338823.509093:0:15781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338823.509139:0:15781:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc6171300 going to sleep for 11 seconds 00000100:00100000:3.0:1787338823.509262:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212082688 00000100:00100000:3.0:1787338823.509270:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212082688 00000100:00100000:3.0:1787338823.509380:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787338823.509391:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbff827050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c0e6575-df80-419a-8cc7-cbad06c93254+19:15781:x1874160212082688:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787338823.509565:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbff827050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c0e6575-df80-419a-8cc7-cbad06c93254+19:15781:x1874160212082688:12345-0@lo:503:mount.lustre.0 Request processed in 176us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338823.509573:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787338823.509616:0:15781:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc4094a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c0e6575-df80-419a-8cc7-cbad06c93254:15781:1874160212082688:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787338823.511662:0:15781:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787338823.511793:0:15781:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbedcb5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c0e6575-df80-419a-8cc7-cbad06c93254:15781:1874160212082816:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787338823.511866:0:15781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338823.512817:0:15781:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc67a60c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787338823.515211:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212082816 00000100:00100000:0.0:1787338823.515230:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212082816 00000100:00100000:0.0:1787338823.515289:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787338823.515366:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbff827450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c0e6575-df80-419a-8cc7-cbad06c93254+19:15781:x1874160212082816:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787338823.515668:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbff827450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c0e6575-df80-419a-8cc7-cbad06c93254+19:15781:x1874160212082816:12345-0@lo:502:mount.lustre.0 Request processed in 369us (3802us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338823.515677:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787338823.517416:0:15781:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbedcb5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c0e6575-df80-419a-8cc7-cbad06c93254:15781:1874160212082816:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787338823.517771:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1787338823.517832:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1787338823.517863:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1787338823.517938:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1787338823.517977:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1787338823.518035:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1787338823.518071:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1787338823.518103:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1787338823.518633:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1787338823.518668:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1787338823.518701:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1787338823.518828:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1787338823.518863:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1787338823.518921:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1787338823.518963:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1787338823.518992:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1787338823.519120:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1787338823.519176:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1787338823.519206:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1787338823.519233:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1787338823.519274:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1787338823.522621:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1787338823.522675:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1787338823.522762:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1787338823.522801:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1787338823.522837:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1787338823.523548:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1787338823.523608:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1787338823.523645:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1787338823.523687:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1787338823.523714:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1787338823.523756:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1787338823.523790:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1787338823.523841:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1787338823.524243:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1787338823.524309:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1787338823.524349:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1787338823.524384:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1787338823.524477:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1787338823.524515:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1787338823.524571:0:15781:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbedcb5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c0e6575-df80-419a-8cc7-cbad06c93254:15781:1874160212082944:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787338823.524656:0:15781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338823.524706:0:15781:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc67a60c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787338823.525001:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212082944 00000100:00100000:1.0:1787338823.525009:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212082944 00000100:00100000:1.0:1787338823.525068:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787338823.525079:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc67c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c0e6575-df80-419a-8cc7-cbad06c93254+19:15781:x1874160212082944:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787338823.525343:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc67c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c0e6575-df80-419a-8cc7-cbad06c93254+19:15781:x1874160212082944:12345-0@lo:502:mount.lustre.0 Request processed in 264us (685us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338823.525352:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787338823.525686:0:15781:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbedcb5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c0e6575-df80-419a-8cc7-cbad06c93254:15781:1874160212082944:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787338823.525792:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1787338823.525804:0:15781:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1787338823.527080:0:15791:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1787338823.527097:0:15791:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff90bbee59b370) 00000020:00000080:1.0:1787338823.527268:0:15791:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:1.0:1787338823.527424:0:15791:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90bac2048000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787338823.527429:0:15791:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90bac2048000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787338823.527432:0:15791:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90bac2048000 3 00010000:00080000:1.0:1787338823.527465:0:15791:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90bac2b55000@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.153@tcp at head 00010000:00010000:1.0:1787338823.539280:0:15791:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:1.0:1787338823.539712:0:15791:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1787338823.539761:0:15791:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787338823.539777:0:15791:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x83671231080c26d8 00000100:00080000:1.0:1787338823.539789:0:15791:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787338823.539796:0:15791:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff90bac2b55000 using connection 192.168.201.153@tcp/0@lo 00000100:00100000:1.0:1787338823.539839:0:15791:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90bbf4706a00 x1874160212083072/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787338823.539866:0:15791:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787338823.540420:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf4706a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3313:1874160212083072:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787338823.540502:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338823.540567:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212083072 00000100:00100000:0.0:1787338823.540574:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212083072 00000100:00100000:0.0:1787338823.540616:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787338823.540625:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4094000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3313:x1874160212083072:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787338823.540655:0:14382:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 476 last 0 00000020:00000080:0.0:1787338823.540690:0:14382:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x83671231080c26df 00000004:00100000:0.0:1787338823.540705:0:14382:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787338823.540750:0:14382:0:(import.c:65:import_set_state_nolock()) ffff90bac1c34800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787338823.540801:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4094000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874160212083072:12345-0@lo:38:llog_process_th.0 Request processed in 175us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338823.540820:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787338823.540858:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90bbf4706a00 x1874160212083072/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787338833 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787338823.540870:0:3313:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787338823.540895:0:3313:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1787338823.540902:0:3313:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787338823.540907:0:3313:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787338823.540909:0:3313:0:(import.c:65:import_set_state_nolock()) ffff90bac2b55000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787338823.540915:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf4706a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3313:1874160212083072:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1787338823.541470:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787338823.541476:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787338823.541479:0:37:0:(import.c:65:import_set_state_nolock()) ffff90bbf40f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787338823.541484:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 473 00000100:00080000:3.0:1787338823.541488:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1787338823.541493:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff90bbf40f3800 using connection 192.168.201.153@tcp/0@lo 00000100:00100000:3.0:1787338823.541513:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90bbedcb4000 x1874160212083328/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787338823.541567:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbedcb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874160212083456:0@lo:400:kworker.0 00000100:00100000:3.0:1787338823.541606:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338823.541632:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787338823.541638:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbedcb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874160212083200:0@lo:400:kworker.0 00000100:00100000:3.0:1787338823.541667:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338823.541695:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787338823.541702:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbedcb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1874160212083584:0@lo:400:kworker.0 00000100:00100000:3.0:1787338823.541724:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338823.541764:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212083456 00000100:00100000:3.0:1787338823.541770:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212083456 00000100:00100000:3.0:1787338823.541801:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212083584 00000100:00100000:3.0:1787338823.541804:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212083584 00000100:00100000:3.0:1787338823.541829:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787338823.541836:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbedcb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874160212083456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787338823.541903:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbedcb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874160212083456:12345-0@lo:400:kworker.0 Request processed in 67us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338823.541917:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787338823.541931:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787338823.541937:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbedcb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874160212083584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787338823.541969:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbedcb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874160212083584:12345-0@lo:400:kworker.0 Request processed in 32us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338823.541975:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787338823.541995:0:15065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212083200 00000100:00100000:3.0:1787338823.541999:0:15065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212083200 00000100:00100000:3.0:1787338823.542040:0:15065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787338823.542047:0:15065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbedcb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3315:x1874160212083200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787338823.542077:0:15065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbedcb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3315:x1874160212083200:12345-0@lo:400:kworker.0 Request processed in 31us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338823.542083:0:15065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1787338823.542099:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787338823.542103:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787338823.542527:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbedcb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1874160212083328:0@lo:8:kworker.0 00000100:00100000:3.0:1787338823.542631:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbedcb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874160212083200:0@lo:400:kworker.0 00000100:00100000:0.0:1787338823.542675:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1787338823.542805:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90bbedcb6300 x1874160212083456/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787338839 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787338823.542817:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbedcb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874160212083456:0@lo:400:kworker.0 00010000:00080000:3.0:1787338823.542846:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90bbedcb6a00 x1874160212083584/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787338839 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787338823.542855:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbedcb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1874160212083584:0@lo:400:kworker.0 00000040:00080000:2.0:1787338823.543073:0:15791:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000100:00100000:3.0:1787338823.545489:0:15066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212083328 00000100:00100000:3.0:1787338823.545499:0:15066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212083328 00000100:00100000:3.0:1787338823.547905:0:15066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787338823.547919:0:15066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4094a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3313:x1874160212083328:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1787338823.548025:0:15066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4094a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3313:x1874160212083328:12345-0@lo:8:kworker.0 Request processed in 107us (5348us total) trans 0 rc -11/-11 00000100:00100000:3.0:1787338823.548032:0:15066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787338823.549201:0:3313:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787338823.549213:0:3313:0:(import.c:65:import_set_state_nolock()) ffff90bbf40f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787338823.549219:0:3313:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1787338823.549223:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbedcb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1874160212083328:0@lo:8:kworker.0 00000020:01000000:3.0:1787338823.549559:0:15781:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1787338823.549597:0:15781:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787338823.549626:0:15781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9c600/0x83671231080c26c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c26ca expref: -99 pid: 15781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338823.549639:0:15781:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9c600/0x83671231080c26c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c26ca expref: -99 pid: 15781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787338823.549695:0:15781:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787338823.549697:0:15781:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787338823.549698:0:15781:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787338823.549699:0:15781:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787338823.549700:0:15781:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787338823.549702:0:15781:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787338823.549704:0:15781:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787338823.549706:0:15781:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787338823.549708:0:15781:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787338823.549712:0:15781:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1787338823.549714:0:15781:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787338823.549716:0:15781:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787338823.549717:0:15781:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787338823.549718:0:15781:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787338823.549719:0:15781:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787338823.549720:0:15781:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787338823.549721:0:15781:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787338823.549722:0:15781:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787338823.549723:0:15781:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787338823.549761:0:15781:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1787338823.549782:0:15781:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbedcb6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c0e6575-df80-419a-8cc7-cbad06c93254:15781:1874160212083712:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787338823.549855:0:15781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338823.549930:0:15781:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc67a6d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787338823.550495:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212083712 00000100:00100000:1.0:1787338823.550502:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212083712 00000100:00100000:1.0:1787338823.550555:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787338823.550564:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc67c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c0e6575-df80-419a-8cc7-cbad06c93254+19:15781:x1874160212083712:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787338823.550593:0:14376:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1787338823.550609:0:14376:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1787338823.586477:0:14376:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787338823.586525:0:14376:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1787338823.587267:0:14397:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787338823.587272:0:14397:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787338823.589813:0:14397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90bbfbe9c400/0x83671231080c26e6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338823.589838:0:14397:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90bbf7ea4000/0x83671231080c25c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c25b9 expref: 19 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338823.589848:0:14397:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90bbfbe9c400/0x83671231080c26e6 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338823.589907:0:14397:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90bbf7ea4000/0x83671231080c25c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x83671231080c25b9 expref: 19 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338823.589924:0:14397:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90bbf7ea4000/0x83671231080c25c0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x83671231080c25b9 expref: 19 pid: 14375 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338823.589959:0:14397:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf4705f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14397:1874160212083840:0@lo:104: 00000100:00100000:1.0:1787338823.590102:0:14397:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338823.590219:0:14397:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbeb0b6300 going to sleep for 11 seconds 00000100:00100000:3.0:1787338823.590272:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212083840 00000100:00100000:3.0:1787338823.590280:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212083840 00000100:00100000:3.0:1787338823.590342:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787338823.590351:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf4704380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2c0e6575-df80-419a-8cc7-cbad06c93254+3:14397:x1874160212083840:12345-0@lo:104: 00010000:00010000:3.0:1787338823.590364:0:14365:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.153@tcp lock: ffff90bbffef5400/0x83671231080c25b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x83671231080c25c0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338823.590419:0:14365:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787338823.590426:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf4704380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2c0e6575-df80-419a-8cc7-cbad06c93254+3:14397:x1874160212083840:12345-0@lo:104: Request processed in 76us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338823.590434:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1787338823.590455:0:14370:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787338823.590462:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.153@tcp lock: ffff90bbffef5400/0x83671231080c25b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x83671231080c25c0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338823.590469:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbffef5400 already unused, calling callback (ffffffffc1b2ec20) 10000000:00010000:3.0:1787338823.590474:0:14370:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.153@tcp lock: ffff90bbffef5400/0x83671231080c25b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x83671231080c25c0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338823.590482:0:14370:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.153@tcp lock: ffff90bbffef5400/0x83671231080c25b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x83671231080c25c0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787338823.590488:0:14370:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.153@tcp lock: ffff90bbffef5400/0x83671231080c25b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x83671231080c25c0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787338823.590492:0:14370:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787338823.590536:0:14370:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.153@tcp lock: ffff90bbffef5400/0x83671231080c25b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c25c0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338823.590542:0:14370:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787338823.590562:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.153@tcp lock: ffff90bbffef5400/0x83671231080c25b9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c25c0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338823.590567:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.153@tcp lock: ffff90bbffef5400/0x83671231080c25b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c25c0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338823.590582:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338823.590583:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338823.590585:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787338823.590596:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbedcb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c0e6575-df80-419a-8cc7-cbad06c93254:3317:1874160212083968:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787338823.590624:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338823.590670:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212083968 00000100:00100000:3.0:1787338823.590674:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212083968 00010000:00010000:3.0:1787338823.590689:0:14367:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90bbf7ea4000/0x83671231080c25c0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x83671231080c25b9 expref: 20 pid: 14375 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338823.590709:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787338823.590716:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbedcb5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c0e6575-df80-419a-8cc7-cbad06c93254+20:3317:x1874160212083968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787338823.590725:0:14367:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787338823.590740:0:14367:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90bbf7ea4000/0x83671231080c25c0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x83671231080c25b9 expref: 20 pid: 14375 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338823.590750:0:14367:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90bbf7ea4000/0x83671231080c25c0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x83671231080c25b9 expref: 20 pid: 14375 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338823.590766:0:14367:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90bbfbe9c400/0x83671231080c26e6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338823.590781:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bbfbe9c400/0x83671231080c26e6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787338823.590793:0:14367:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003521617s 00010000:00010000:3.0:1787338823.590796:0:14367:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90bbfbe9c400/0x83671231080c26e6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338823.590801:0:14367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90bbfbe9c400/0x83671231080c26e6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338823.590806:0:14367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90bbfbe9c400/0x83671231080c26e6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338823.590810:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90bbfbe9c400/0x83671231080c26e6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338823.590813:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbfbe9c400 already unused, calling callback (ffffffffc1546230) 00010000:00010000:3.0:1787338823.590815:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90bbfbe9c400/0x83671231080c26e6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338823.590820:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90bbfbe9c400/0x83671231080c26e6 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338823.590826:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90bbfbe9c400/0x83671231080c26e6 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338823.590832:0:14367:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787338823.590860:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbedcb5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c0e6575-df80-419a-8cc7-cbad06c93254+20:3317:x1874160212083968:12345-0@lo:103:ldlm_bl.0 Request processed in 145us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338823.590867:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787338823.590916:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbedcb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c0e6575-df80-419a-8cc7-cbad06c93254:3317:1874160212083968:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787338823.590934:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90bbf7ea4000/0x83671231080c25c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x83671231080c25b9 expref: 19 pid: 14375 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338823.590944:0:14397:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf4705f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14397:1874160212083840:0@lo:104: 00010000:00010000:3.0:1787338823.590957:0:14397:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90bbfbe9c400/0x83671231080c26e6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338823.590965:0:14397:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90bbfbe9c400/0x83671231080c26e6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338823.590972:0:14397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90bbfbe9c400/0x83671231080c26e6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338823.590977:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90bbfbe9c400/0x83671231080c26e6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338823.592897:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc67c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c0e6575-df80-419a-8cc7-cbad06c93254+18:15781:x1874160212083712:12345-0@lo:253:mount.lustre.0 Request processed in 42301us (43007us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338823.592911:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787338823.593070:0:15781:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbedcb6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c0e6575-df80-419a-8cc7-cbad06c93254:15781:1874160212083712:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787338823.593088:0:15781:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1787338823.593091:0:15781:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787338823.593092:0:15781:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787338823.593094:0:15781:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787338823.593095:0:15781:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787338823.593096:0:15781:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787338823.593097:0:15781:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787338823.593099:0:15781:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787338823.593114:0:15781:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787338823.593116:0:15781:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787338823.593134:0:15781:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1787338823.598420:0:15781:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1787338823.598600:0:15781:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1787338823.598772:0:15781:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1787338823.599105:0:15781:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1787338823.599263:0:15781:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1787338823.599620:0:15781:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1787338823.600385:0:15781:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:3.0:1787338823.608419:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1787338823.641467:0:15781:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1787338823.641482:0:15781:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1787338823.641520:0:15781:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787338823.641591:0:15781:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.153@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787338823.641605:0:15781:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1787338823.641643:0:15781:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00000001:00100000:1.0:1787338824.464779:0:6714:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1787338824.464798:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00010000:00010000:3.0:1787338824.630545:0:15652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787338825.336250:0:14378:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787338825.336257:0:14378:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90bbc8428000 from 8 10000000:01000000:0.0:1787338825.336261:0:14378:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787338825.336310:0:14378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbffef4a00/0x83671231080c26ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338825.336323:0:14378:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.153@tcp lock: ffff90bbffef4a00/0x83671231080c26ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338825.336336:0:14378:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.153@tcp lock: ffff90bbffef4a00/0x83671231080c26ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338825.336361:0:14378:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc4097b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c0e6575-df80-419a-8cc7-cbad06c93254:14378:1874160212084096:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787338825.336436:0:14378:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338825.336487:0:14378:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc67a63c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787338825.337190:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212084096 00000100:00100000:3.0:1787338825.337199:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212084096 00000100:00100000:3.0:1787338825.337248:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787338825.337257:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc67c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c0e6575-df80-419a-8cc7-cbad06c93254+18:14378:x1874160212084096:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787338825.337289:0:14373:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787338825.337304:0:14373:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90bbf7ea4000/0x83671231080c26f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x83671231080c26ed expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338825.337328:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bbf7ea4000/0x83671231080c26f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x83671231080c26ed expref: 19 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338825.337338:0:14373:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90bbf7ea4000/0x83671231080c26f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c26ed expref: 19 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338825.337347:0:14373:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf7ea4000, rc 0) 00000100:00100000:3.0:1787338825.337402:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc67c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c0e6575-df80-419a-8cc7-cbad06c93254+19:14378:x1874160212084096:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 146us (966us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338825.337409:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787338825.339358:0:14378:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc4097b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c0e6575-df80-419a-8cc7-cbad06c93254:14378:1874160212084096:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787338825.339383:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.153@tcp lock: ffff90bbffef4a00/0x83671231080c26ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c26f4 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338825.339403:0:14378:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.153@tcp lock: ffff90bbffef4a00/0x83671231080c26ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x83671231080c26f4 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338825.339464:0:14378:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc01ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c0e6575-df80-419a-8cc7-cbad06c93254:14378:1874160212084224:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787338825.339518:0:14378:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338825.339559:0:14378:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc2c1c780 going to sleep for 11 seconds 00000100:00100000:0.0:1787338825.341113:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212084224 00000100:00100000:0.0:1787338825.341127:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212084224 00000100:00100000:0.0:1787338825.341188:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787338825.341198:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc67c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c0e6575-df80-419a-8cc7-cbad06c93254+19:14378:x1874160212084224:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787338825.341220:0:14376:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787338825.341242:0:14376:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787338825.341245:0:14376:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1787338825.341361:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc67c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c0e6575-df80-419a-8cc7-cbad06c93254+19:14378:x1874160212084224:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 164us (1842us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338825.341368:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787338825.341494:0:14378:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc01ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c0e6575-df80-419a-8cc7-cbad06c93254:14378:1874160212084224:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787338825.341556:0:14378:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.153@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787338825.341565:0:14378:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbffef4a00/0x83671231080c26ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c26f4 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338825.341576:0:14378:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.153@tcp lock: ffff90bbffef4a00/0x83671231080c26ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c26f4 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338825.655251:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787338826.366938:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787338826.366964:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc4095f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874160212084352:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787338826.367032:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338826.367097:0:15068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212084352 00000100:00100000:3.0:1787338826.367104:0:15068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212084352 00000100:00100000:3.0:1787338826.367151:0:15068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787338826.367159:0:15068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbedcb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874160212084352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787338826.367196:0:15068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787338826.367243:0:15068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbedcb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874160212084352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338826.367261:0:15068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1787338826.367281:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787338826.367324:0:3315:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1787338826.367361:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc4095f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874160212084352:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787338826.678892:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787338827.128535:0:14412:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787338827.702033:0:15652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338828.728188:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787338828.924985:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787338828.924992:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787338828.925002:0:37:0:(import.c:65:import_set_state_nolock()) ffff90bbf40f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787338828.925013:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff90bbf40f3800 using connection 192.168.201.153@tcp/0@lo 00000100:00100000:0.0:1787338828.925038:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90bbc4095500 x1874160212084736/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787338828.925094:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc4096680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1874160212084992:0@lo:400:kworker.0 00000100:00100000:0.0:1787338828.925161:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338828.925222:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787338828.925228:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc4095c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c0e6575-df80-419a-8cc7-cbad06c93254:3314:1874160212084480:0@lo:400:kworker.0 00000100:00100000:0.0:1787338828.925259:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338828.925281:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc4096d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1874160212085120:0@lo:400:kworker.0 00000100:00100000:0.0:1787338828.925301:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338828.925327:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc4095880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874160212084864:0@lo:400:kworker.0 00000100:00100000:0.0:1787338828.925350:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338828.925368:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787338828.925374:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc4094e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874160212084608:0@lo:400:kworker.0 00000100:00100000:0.0:1787338828.925401:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338828.925426:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc4095500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1874160212084736:0@lo:8:kworker.0 00000100:00100000:0.0:1787338828.925449:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338828.925476:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212084480 00000100:00100000:0.0:1787338828.925482:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212084480 00000100:00100000:0.0:1787338828.925524:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787338828.925534:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc67c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c0e6575-df80-419a-8cc7-cbad06c93254+19:3314:x1874160212084480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787338828.925579:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc67c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c0e6575-df80-419a-8cc7-cbad06c93254+19:3314:x1874160212084480:12345-0@lo:400:kworker.0 Request processed in 47us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338828.925586:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787338828.925649:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212084992 00000100:00100000:0.0:1787338828.925653:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212084992 00000100:00100000:0.0:1787338828.925682:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212085120 00000100:00100000:0.0:1787338828.925685:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212085120 00000100:00100000:0.0:1787338828.925698:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212084864 00000100:00100000:0.0:1787338828.925700:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212084864 00000100:00100000:0.0:1787338828.925712:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787338828.925718:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4097480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874160212084992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787338828.925748:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4097480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874160212084992:12345-0@lo:400:kworker.0 Request processed in 30us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338828.925754:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787338828.925765:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787338828.925770:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4096a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874160212085120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787338828.925791:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4096a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874160212085120:12345-0@lo:400:kworker.0 Request processed in 21us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338828.925796:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787338828.925804:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787338828.925809:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4095180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874160212084864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787338828.925835:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4095180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874160212084864:12345-0@lo:400:kworker.0 Request processed in 26us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338828.925840:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787338828.925855:0:15065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212084608 00000100:00100000:0.0:1787338828.925857:0:15065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212084608 00000100:00100000:0.0:1787338828.925910:0:15065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212084736 00000100:00100000:0.0:1787338828.925913:0:15065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212084736 00000100:00100000:0.0:1787338828.925928:0:15065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787338828.925934:0:15065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4095f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1874160212084608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787338828.925960:0:15065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4095f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1874160212084608:12345-0@lo:400:kworker.0 Request processed in 27us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338828.925971:0:15065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787338828.925981:0:15065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787338828.925985:0:15065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4097b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3313:x1874160212084736:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1787338828.926007:0:15065:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 481 last 0 00000020:00000080:0.0:1787338828.926034:0:15065:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x83671231080c26fb 00002000:00100000:0.0:1787338828.926047:0:15065:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff90bac1c37800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211392c ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1787338828.926051:0:15065:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1787338828.926054:0:15065:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787338828.926353:0:15065:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787338828.926374:0:15065:0:(import.c:65:import_set_state_nolock()) ffff90bac1c33800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787338828.926415:0:15065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4097b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3313:x1874160212084736:12345-0@lo:8:kworker.0 Request processed in 427us (964us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338828.926421:0:15065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1787338828.926447:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787338828.926451:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787338828.926480:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbc4095500 x1874160212084736/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787338853 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787338828.926495:0:3313:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1787338828.926502:0:3313:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787338828.926507:0:3313:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1787338828.926509:0:3313:0:(import.c:65:import_set_state_nolock()) ffff90bbf40f3800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787338828.928713:0:14406:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:2.0:1787338828.928745:0:14406:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc01dc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14406:1874160212085376:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1787338828.928806:0:14406:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338828.928833:0:14406:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbde498780 going to sleep for 11 seconds 00000100:00100000:2.0:1787338828.928897:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc4094e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874160212084608:0@lo:400:kworker.0 00010000:00080000:2.0:1787338828.928921:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbc4095880 x1874160212084864/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787338844 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787338828.928933:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc4095880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874160212084864:0@lo:400:kworker.0 00000100:00100000:3.0:1787338828.929249:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc01ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874160212085248:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787338828.929281:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338828.929317:0:15068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212085248 00000100:00100000:3.0:1787338828.929323:0:15068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212085248 00000100:00100000:3.0:1787338828.929373:0:15068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787338828.929383:0:15068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbedcb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3316:x1874160212085248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787338828.929412:0:15068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787338828.929454:0:15068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbedcb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3316:x1874160212085248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338828.929461:0:15068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787338828.929495:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbfc01ca80 x1874160212085248/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787338844 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787338828.929510:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc01ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874160212085248:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787338828.929549:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc4095c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c0e6575-df80-419a-8cc7-cbad06c93254:3314:1874160212084480:0@lo:400:kworker.0 00010000:00080000:3.0:1787338828.929566:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbc4096d80 x1874160212085120/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787338844 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787338828.929574:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc4096d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1874160212085120:0@lo:400:kworker.0 00010000:00080000:3.0:1787338828.929585:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbc4096680 x1874160212084992/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787338844 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787338828.929753:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc4096680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1874160212084992:0@lo:400:kworker.0 00000004:00080000:0.0:1787338828.930755:0:3313:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787338828.930766:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc4095500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1874160212084736:0@lo:8:kworker.0 00000100:00080000:0.0:1787338828.930798:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787338828.930814:0:15065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212085376 00000100:00100000:0.0:1787338828.930820:0:15065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212085376 00000100:00100000:0.0:1787338828.930862:0:15065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787338828.930870:0:15065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc01fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14406:x1874160212085376:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1787338828.933234:0:15065:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1787338828.933244:0:15065:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:0.0:1787338828.933250:0:15065:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00000004:00080000:1.0:1787338828.933998:0:14405:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787338828.934381:0:14405:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 481775506187ns, next at 0ns, rc = 0 00002000:00010000:2.0:1787338828.964480:0:15065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787338828.964500:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d81b2a98/0x83671231080c2702 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338828.964517:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=481s v=(0 0) 00010000:00010000:2.0:1787338828.964521:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787338828.964528:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d81b2a98/0x83671231080c2702 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338828.964544:0:15065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d81b2a98/0x83671231080c2702 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338828.964555:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d81b2a98/0x83671231080c2702 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338828.964563:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d81b2a98/0x83671231080c2702 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338828.964596:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787338828.965063:0:15065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787338828.965069:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067580d13/0x83671231080c2709 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338828.965076:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=481s v=(0 0) 00010000:00010000:2.0:1787338828.965079:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787338828.965083:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000067580d13/0x83671231080c2709 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338828.965093:0:15065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000067580d13/0x83671231080c2709 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338828.965106:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067580d13/0x83671231080c2709 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338828.965112:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000067580d13/0x83671231080c2709 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338828.965125:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1787338828.965483:0:15065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787338828.965489:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4fa2797/0x83671231080c2710 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338828.965497:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=481s v=(0 0) 00010000:00010000:2.0:1787338828.965499:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787338828.965503:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e4fa2797/0x83671231080c2710 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338828.965511:0:15065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e4fa2797/0x83671231080c2710 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338828.965519:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4fa2797/0x83671231080c2710 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338828.965526:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e4fa2797/0x83671231080c2710 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338828.965555:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1787338828.965981:0:15065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787338828.965987:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007bcb55fc/0x83671231080c2717 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338828.965996:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=481s v=(0 0) 00010000:00010000:2.0:1787338828.965999:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787338828.966002:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007bcb55fc/0x83671231080c2717 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338828.966013:0:15065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007bcb55fc/0x83671231080c2717 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338828.966020:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007bcb55fc/0x83671231080c2717 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338828.966027:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007bcb55fc/0x83671231080c2717 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338828.966036:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:2.0:1787338828.966422:0:15065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787338828.966428:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ccd4cd8/0x83671231080c271e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338828.966437:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=481s v=(0 0) 00010000:00010000:2.0:1787338828.966444:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787338828.966450:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009ccd4cd8/0x83671231080c271e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338828.966459:0:15065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009ccd4cd8/0x83671231080c271e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338828.966467:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ccd4cd8/0x83671231080c271e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338828.966473:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009ccd4cd8/0x83671231080c271e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338828.966480:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:2.0:1787338828.966838:0:15065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787338828.966844:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000abd97688/0x83671231080c2725 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338828.966852:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=481s v=(0 0) 00010000:00010000:2.0:1787338828.966855:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787338828.966859:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000abd97688/0x83671231080c2725 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338828.966867:0:15065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000abd97688/0x83671231080c2725 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338828.966898:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000abd97688/0x83671231080c2725 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338828.966911:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000abd97688/0x83671231080c2725 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338828.966918:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:3.0:1787338828.967791:0:14369:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1787338828.967807:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d81b2a98/0x83671231080c2702 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338828.967819:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e3000 already unused, calling callback (ffffffffc1546230) 00010000:00010000:3.0:1787338828.967823:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d81b2a98/0x83671231080c2702 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338828.967834:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d81b2a98/0x83671231080c2702 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338828.967855:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d81b2a98/0x83671231080c2702 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338828.967862:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d81b2a98/0x83671231080c2702 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338828.967906:0:14369:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1787338828.967910:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000067580d13/0x83671231080c2709 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338828.967918:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e3a00 already unused, calling callback (ffffffffc1546230) 00010000:00010000:3.0:1787338828.967921:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000067580d13/0x83671231080c2709 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338828.967928:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000067580d13/0x83671231080c2709 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338828.967951:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000067580d13/0x83671231080c2709 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338828.967958:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000067580d13/0x83671231080c2709 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338828.967970:0:14369:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1787338828.967974:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e4fa2797/0x83671231080c2710 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338828.967980:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e3e00 already unused, calling callback (ffffffffc1546230) 00010000:00010000:3.0:1787338828.967983:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4fa2797/0x83671231080c2710 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338828.967989:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4fa2797/0x83671231080c2710 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338828.967998:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e4fa2797/0x83671231080c2710 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338828.968005:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e4fa2797/0x83671231080c2710 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338828.968015:0:14369:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787338828.968018:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007bcb55fc/0x83671231080c2717 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338828.968030:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e2200 already unused, calling callback (ffffffffc1546230) 00010000:00010000:3.0:1787338828.968033:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007bcb55fc/0x83671231080c2717 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338828.968040:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007bcb55fc/0x83671231080c2717 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338828.968050:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007bcb55fc/0x83671231080c2717 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338828.968057:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007bcb55fc/0x83671231080c2717 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338828.968070:0:14369:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787338828.968074:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009ccd4cd8/0x83671231080c271e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338828.968080:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e2000 already unused, calling callback (ffffffffc1546230) 00010000:00010000:3.0:1787338828.968083:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009ccd4cd8/0x83671231080c271e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338828.968090:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009ccd4cd8/0x83671231080c271e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338828.968099:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009ccd4cd8/0x83671231080c271e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338828.968122:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009ccd4cd8/0x83671231080c271e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338828.968137:0:14369:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787338828.968141:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000abd97688/0x83671231080c2725 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338828.968147:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e2e00 already unused, calling callback (ffffffffc1546230) 00010000:00010000:3.0:1787338828.968150:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000abd97688/0x83671231080c2725 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338828.968157:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000abd97688/0x83671231080c2725 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338828.968168:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000abd97688/0x83671231080c2725 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338828.968174:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000abd97688/0x83671231080c2725 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338828.968184:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338828.968185:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338828.968187:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338828.968196:0:15652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338828.968546:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787338828.972145:0:15065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787338828.972161:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7e9fe58/0x83671231080c272c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338828.972179:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=481s v=(0 0) 00010000:00010000:2.0:1787338828.972183:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787338828.972191:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b7e9fe58/0x83671231080c272c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338828.972332:0:15065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b7e9fe58/0x83671231080c272c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338828.972346:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7e9fe58/0x83671231080c272c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338828.972355:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b7e9fe58/0x83671231080c272c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338828.972379:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787338828.972663:0:14369:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787338828.972671:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b7e9fe58/0x83671231080c272c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338828.972679:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e2800 already unused, calling callback (ffffffffc1546230) 00010000:00010000:0.0:1787338828.972685:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7e9fe58/0x83671231080c272c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338828.972694:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7e9fe58/0x83671231080c272c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338828.972714:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b7e9fe58/0x83671231080c272c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338828.972722:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b7e9fe58/0x83671231080c272c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338828.972744:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787338828.972746:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787338828.972747:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787338828.974429:0:15065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787338828.974441:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f317e23a/0x83671231080c2733 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338828.974463:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=481s v=(0 0) 00010000:00010000:2.0:1787338828.974467:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787338828.974473:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f317e23a/0x83671231080c2733 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338828.974486:0:15065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f317e23a/0x83671231080c2733 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338828.974496:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f317e23a/0x83671231080c2733 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338828.974503:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f317e23a/0x83671231080c2733 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338828.974521:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787338828.975051:0:15065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787338828.975058:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a07fcf0/0x83671231080c273a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338828.975066:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=481s v=(0 0) 00010000:00010000:2.0:1787338828.975069:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787338828.975074:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a07fcf0/0x83671231080c273a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338828.975083:0:15065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006a07fcf0/0x83671231080c273a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338828.975103:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a07fcf0/0x83671231080c273a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338828.975109:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006a07fcf0/0x83671231080c273a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338828.975123:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1787338828.976710:0:15065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787338828.976721:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0b9c1b0/0x83671231080c2741 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338828.976735:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=481s v=(0 0) 00010000:00010000:2.0:1787338828.976739:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787338828.976744:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0b9c1b0/0x83671231080c2741 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338828.976758:0:15065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0b9c1b0/0x83671231080c2741 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338828.976767:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0b9c1b0/0x83671231080c2741 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338828.976774:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b0b9c1b0/0x83671231080c2741 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338828.976807:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1787338828.977370:0:14369:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787338828.977379:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f317e23a/0x83671231080c2733 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338828.977394:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e3400 already unused, calling callback (ffffffffc1546230) 00010000:00010000:0.0:1787338828.977398:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f317e23a/0x83671231080c2733 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338828.977406:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f317e23a/0x83671231080c2733 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338828.977424:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f317e23a/0x83671231080c2733 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338828.977431:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f317e23a/0x83671231080c2733 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338828.977453:0:14369:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787338828.977456:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006a07fcf0/0x83671231080c273a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338828.977462:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e2400 already unused, calling callback (ffffffffc1546230) 00010000:00010000:0.0:1787338828.977465:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006a07fcf0/0x83671231080c273a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338828.977473:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006a07fcf0/0x83671231080c273a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338828.977483:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006a07fcf0/0x83671231080c273a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338828.977496:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006a07fcf0/0x83671231080c273a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338828.977510:0:14369:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787338828.977514:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b0b9c1b0/0x83671231080c2741 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338828.977520:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e2a00 already unused, calling callback (ffffffffc1546230) 00010000:00010000:0.0:1787338828.977523:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0b9c1b0/0x83671231080c2741 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338828.977531:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0b9c1b0/0x83671231080c2741 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338828.977541:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b0b9c1b0/0x83671231080c2741 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338828.977547:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0b9c1b0/0x83671231080c2741 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338828.977558:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787338828.977560:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787338828.977562:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787338828.982088:0:15065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787338828.982105:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000098649397/0x83671231080c2748 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338828.982123:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=481s v=(0 0) 00010000:00010000:2.0:1787338828.982128:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787338828.982135:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000098649397/0x83671231080c2748 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338828.982150:0:15065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000098649397/0x83671231080c2748 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338828.982160:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000098649397/0x83671231080c2748 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338828.982169:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000098649397/0x83671231080c2748 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338828.982199:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787338828.982891:0:15652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787338828.982901:0:15652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000098649397/0x83671231080c2748 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338828.982917:0:15652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e3600 already unused, calling callback (ffffffffc1546230) 00010000:00010000:3.0:1787338828.982922:0:15652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000098649397/0x83671231080c2748 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338828.982932:0:15652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000098649397/0x83671231080c2748 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338828.982954:0:15652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000098649397/0x83671231080c2748 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338828.982962:0:15652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000098649397/0x83671231080c2748 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338828.982986:0:15652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338828.982988:0:15652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338828.982990:0:15652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787338828.983765:0:15065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787338828.983775:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006397681f/0x83671231080c274f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338828.983787:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=481s v=(0 0) 00010000:00010000:2.0:1787338828.983797:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787338828.983803:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006397681f/0x83671231080c274f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338828.983814:0:15065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006397681f/0x83671231080c274f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338828.983823:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006397681f/0x83671231080c274f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338828.983830:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006397681f/0x83671231080c274f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338828.983989:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787338828.984389:0:15065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787338828.984396:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bcbd0125/0x83671231080c2756 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338828.984404:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=481s v=(0 0) 00010000:00010000:2.0:1787338828.984406:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787338828.984411:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bcbd0125/0x83671231080c2756 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338828.984423:0:15065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bcbd0125/0x83671231080c2756 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338828.984431:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bcbd0125/0x83671231080c2756 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338828.984443:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bcbd0125/0x83671231080c2756 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338828.984600:0:15652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787338828.984608:0:15652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006397681f/0x83671231080c274f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338828.984616:0:15652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e2c00 already unused, calling callback (ffffffffc1546230) 00010000:00010000:3.0:1787338828.984621:0:15652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006397681f/0x83671231080c274f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338828.984630:0:15652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006397681f/0x83671231080c274f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338828.984665:0:15652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006397681f/0x83671231080c274f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338828.984673:0:15652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006397681f/0x83671231080c274f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338828.984694:0:15652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787338828.984698:0:15652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bcbd0125/0x83671231080c2756 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338828.984705:0:15652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e3800 already unused, calling callback (ffffffffc1546230) 00010000:00010000:3.0:1787338828.984708:0:15652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bcbd0125/0x83671231080c2756 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338828.984714:0:15652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bcbd0125/0x83671231080c2756 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338828.984722:0:15652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bcbd0125/0x83671231080c2756 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338828.984729:0:15652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338828.984731:0:15652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338828.984732:0:15652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338828.985129:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787338828.991942:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787338828.991958:0:15065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bcbd0125/0x83671231080c2756 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338828.992151:0:15652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787338828.992794:0:15065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787338828.992804:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000884f449/0x83671231080c275d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338828.992826:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=481s v=(0 0) 00010000:00010000:3.0:1787338828.992830:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787338828.992836:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000884f449/0x83671231080c275d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338828.992850:0:15065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000884f449/0x83671231080c275d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338828.992860:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000884f449/0x83671231080c275d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338828.992868:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000884f449/0x83671231080c275d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338828.992917:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787338828.993274:0:15065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787338828.993281:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006043dd54/0x83671231080c2764 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338828.993289:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=481s v=(0 0) 00010000:00010000:3.0:1787338828.993293:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787338828.993297:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006043dd54/0x83671231080c2764 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338828.993306:0:15065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006043dd54/0x83671231080c2764 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338828.993324:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006043dd54/0x83671231080c2764 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338828.993331:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006043dd54/0x83671231080c2764 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338828.993347:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787338828.993358:0:15652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787338828.993363:0:15652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000884f449/0x83671231080c275d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338828.993371:0:15652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea4200 already unused, calling callback (ffffffffc1546230) 00010000:00010000:3.0:1787338828.993375:0:15652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000884f449/0x83671231080c275d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338828.993384:0:15652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000884f449/0x83671231080c275d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338828.993400:0:15652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000884f449/0x83671231080c275d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338828.993408:0:15652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000884f449/0x83671231080c275d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338828.993424:0:15652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787338828.993433:0:15652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006043dd54/0x83671231080c2764 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338828.993440:0:15652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea4600 already unused, calling callback (ffffffffc1546230) 00010000:00010000:3.0:1787338828.993443:0:15652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006043dd54/0x83671231080c2764 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338828.993450:0:15652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006043dd54/0x83671231080c2764 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338828.993460:0:15652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006043dd54/0x83671231080c2764 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338828.993467:0:15652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006043dd54/0x83671231080c2764 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338828.993479:0:15652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338828.993481:0:15652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338828.993482:0:15652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787338828.993853:0:15065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787338828.993859:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099903cb8/0x83671231080c276b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338828.993867:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=481s v=(0 0) 00010000:00010000:3.0:1787338828.993869:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787338828.993898:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000099903cb8/0x83671231080c276b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338828.993918:0:15065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000099903cb8/0x83671231080c276b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338828.993926:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099903cb8/0x83671231080c276b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338828.993933:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000099903cb8/0x83671231080c276b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338828.993946:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787338828.993953:0:15652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787338828.993957:0:15652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000099903cb8/0x83671231080c276b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338828.993963:0:15652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea5400 already unused, calling callback (ffffffffc1546230) 00010000:00010000:3.0:1787338828.993967:0:15652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000099903cb8/0x83671231080c276b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338828.993975:0:15652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000099903cb8/0x83671231080c276b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338828.993984:0:15652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000099903cb8/0x83671231080c276b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338828.993991:0:15652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000099903cb8/0x83671231080c276b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338828.994008:0:15652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338828.994010:0:15652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338828.994011:0:15652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787338828.994368:0:15065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787338828.994374:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bfc126b2/0x83671231080c2772 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338828.994383:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=481s v=(0 0) 00010000:00010000:3.0:1787338828.994386:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787338828.994391:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bfc126b2/0x83671231080c2772 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338828.994400:0:15065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bfc126b2/0x83671231080c2772 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338828.994407:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bfc126b2/0x83671231080c2772 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338828.994414:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bfc126b2/0x83671231080c2772 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338828.994428:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787338828.994435:0:15652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787338828.994439:0:15652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bfc126b2/0x83671231080c2772 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338828.994456:0:15652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea4c00 already unused, calling callback (ffffffffc1546230) 00010000:00010000:3.0:1787338828.994459:0:15652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bfc126b2/0x83671231080c2772 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338828.994466:0:15652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bfc126b2/0x83671231080c2772 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338828.994478:0:15652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bfc126b2/0x83671231080c2772 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338828.994484:0:15652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bfc126b2/0x83671231080c2772 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338828.994498:0:15652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338828.994499:0:15652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338828.994501:0:15652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787338828.994973:0:15065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787338828.994979:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088b888d5/0x83671231080c2779 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338828.994988:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=481s v=(0 0) 00010000:00010000:3.0:1787338828.994991:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787338828.994995:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088b888d5/0x83671231080c2779 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338828.995006:0:15065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000088b888d5/0x83671231080c2779 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338828.995022:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088b888d5/0x83671231080c2779 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338828.995029:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000088b888d5/0x83671231080c2779 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338828.995045:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787338828.995053:0:15652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787338828.995057:0:15652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000088b888d5/0x83671231080c2779 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338828.995065:0:15652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea5800 already unused, calling callback (ffffffffc1546230) 00010000:00010000:3.0:1787338828.995068:0:15652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000088b888d5/0x83671231080c2779 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338828.995076:0:15652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000088b888d5/0x83671231080c2779 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338828.995088:0:15652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000088b888d5/0x83671231080c2779 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338828.995095:0:15652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088b888d5/0x83671231080c2779 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338828.995109:0:15652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338828.995117:0:15652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338828.995119:0:15652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787338828.995499:0:15065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787338828.995505:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000699ae558/0x83671231080c2780 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338828.995514:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=481s v=(0 0) 00010000:00010000:3.0:1787338828.995517:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787338828.995522:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000699ae558/0x83671231080c2780 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338828.995530:0:15065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000699ae558/0x83671231080c2780 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338828.995538:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000699ae558/0x83671231080c2780 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338828.995544:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000699ae558/0x83671231080c2780 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338828.995558:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787338828.995566:0:15652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787338828.995570:0:15652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000699ae558/0x83671231080c2780 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338828.995576:0:15652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea4e00 already unused, calling callback (ffffffffc1546230) 00010000:00010000:3.0:1787338828.995580:0:15652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000699ae558/0x83671231080c2780 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338828.995599:0:15652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000699ae558/0x83671231080c2780 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338828.995610:0:15652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000699ae558/0x83671231080c2780 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338828.995618:0:15652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000699ae558/0x83671231080c2780 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338828.995633:0:15652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338829.000039:0:15652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787338829.000123:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787338829.006683:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338829.009821:0:15652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787338829.010531:0:15065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787338829.010541:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f3186d5/0x83671231080c2787 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338829.010557:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=481s v=(0 0) 00010000:00010000:3.0:1787338829.010562:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787338829.010568:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f3186d5/0x83671231080c2787 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338829.010582:0:15065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002f3186d5/0x83671231080c2787 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338829.010591:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f3186d5/0x83671231080c2787 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338829.010612:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002f3186d5/0x83671231080c2787 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338829.010632:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787338829.011029:0:15065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787338829.011035:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000337a423a/0x83671231080c278e lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338829.011043:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=481s v=(0 0) 00010000:00010000:3.0:1787338829.011047:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787338829.011051:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000337a423a/0x83671231080c278e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338829.011059:0:15065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000337a423a/0x83671231080c278e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338829.011067:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000337a423a/0x83671231080c278e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338829.011075:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000337a423a/0x83671231080c278e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338829.011089:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1787338829.011398:0:15065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787338829.011403:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003ae84a4/0x83671231080c2795 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338829.011415:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=481s v=(0 0) 00010000:00010000:3.0:1787338829.011418:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787338829.011423:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000003ae84a4/0x83671231080c2795 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338829.011431:0:15065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000003ae84a4/0x83671231080c2795 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338829.011439:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003ae84a4/0x83671231080c2795 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338829.011447:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000003ae84a4/0x83671231080c2795 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338829.011462:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1787338829.011472:0:15652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787338829.011478:0:15652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002f3186d5/0x83671231080c2787 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338829.011485:0:15652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea5a00 already unused, calling callback (ffffffffc1546230) 00010000:00010000:3.0:1787338829.011490:0:15652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002f3186d5/0x83671231080c2787 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338829.011498:0:15652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002f3186d5/0x83671231080c2787 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338829.011522:0:15652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002f3186d5/0x83671231080c2787 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338829.011529:0:15652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002f3186d5/0x83671231080c2787 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338829.011547:0:15652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787338829.011550:0:15652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000337a423a/0x83671231080c278e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338829.011555:0:15652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea5600 already unused, calling callback (ffffffffc1546230) 00010000:00010000:3.0:1787338829.011558:0:15652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000337a423a/0x83671231080c278e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338829.011566:0:15652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000337a423a/0x83671231080c278e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338829.011574:0:15652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000337a423a/0x83671231080c278e lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338829.011581:0:15652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000337a423a/0x83671231080c278e lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338829.011590:0:15652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787338829.011593:0:15652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000003ae84a4/0x83671231080c2795 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338829.011602:0:15652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea5c00 already unused, calling callback (ffffffffc1546230) 00010000:00010000:3.0:1787338829.011605:0:15652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000003ae84a4/0x83671231080c2795 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338829.011612:0:15652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000003ae84a4/0x83671231080c2795 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338829.011621:0:15652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000003ae84a4/0x83671231080c2795 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338829.011627:0:15652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000003ae84a4/0x83671231080c2795 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338829.011650:0:15652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338829.011652:0:15652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338829.011654:0:15652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787338829.012477:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787338829.012589:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787338829.019005:0:15065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787338829.019018:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a4e7ed48/0x83671231080c279c lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338829.019036:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=481s v=(0 0) 00010000:00010000:3.0:1787338829.019041:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787338829.019047:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a4e7ed48/0x83671231080c279c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338829.019062:0:15065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a4e7ed48/0x83671231080c279c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338829.019078:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a4e7ed48/0x83671231080c279c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338829.019085:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a4e7ed48/0x83671231080c279c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338829.019106:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787338829.019494:0:15065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787338829.019501:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e1f24e3/0x83671231080c27a3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338829.019509:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=481s v=(0 0) 00010000:00010000:3.0:1787338829.019512:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787338829.019515:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006e1f24e3/0x83671231080c27a3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338829.019524:0:15065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006e1f24e3/0x83671231080c27a3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338829.019532:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e1f24e3/0x83671231080c27a3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338829.019540:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006e1f24e3/0x83671231080c27a3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338829.019574:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787338829.019591:0:14369:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787338829.019597:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a4e7ed48/0x83671231080c279c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338829.019605:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea5e00 already unused, calling callback (ffffffffc1546230) 00010000:00010000:3.0:1787338829.019610:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a4e7ed48/0x83671231080c279c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338829.019619:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a4e7ed48/0x83671231080c279c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338829.019648:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a4e7ed48/0x83671231080c279c lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338829.019656:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a4e7ed48/0x83671231080c279c lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338829.019673:0:14369:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787338829.019677:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006e1f24e3/0x83671231080c27a3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338829.019683:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea4400 already unused, calling callback (ffffffffc1546230) 00010000:00010000:3.0:1787338829.019687:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006e1f24e3/0x83671231080c27a3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338829.019706:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006e1f24e3/0x83671231080c27a3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338829.019717:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006e1f24e3/0x83671231080c27a3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338829.019724:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006e1f24e3/0x83671231080c27a3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338829.019739:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338829.019740:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338829.019757:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787338829.020149:0:15065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787338829.020155:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cfaba056/0x83671231080c27aa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338829.020164:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=481s v=(0 0) 00010000:00010000:3.0:1787338829.020167:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787338829.020171:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cfaba056/0x83671231080c27aa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338829.020180:0:15065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cfaba056/0x83671231080c27aa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338829.020188:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cfaba056/0x83671231080c27aa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338829.020206:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cfaba056/0x83671231080c27aa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338829.020219:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787338829.020588:0:15065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787338829.020595:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000023f2dc57/0x83671231080c27b1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338829.020603:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=481s v=(0 0) 00010000:00010000:3.0:1787338829.020606:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787338829.020610:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000023f2dc57/0x83671231080c27b1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338829.020619:0:15065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000023f2dc57/0x83671231080c27b1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338829.020627:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000023f2dc57/0x83671231080c27b1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338829.020634:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000023f2dc57/0x83671231080c27b1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338829.020664:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787338829.020675:0:14369:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787338829.020680:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cfaba056/0x83671231080c27aa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338829.020693:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bc02045400 already unused, calling callback (ffffffffc1546230) 00010000:00010000:3.0:1787338829.020697:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cfaba056/0x83671231080c27aa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338829.020705:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cfaba056/0x83671231080c27aa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338829.020717:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cfaba056/0x83671231080c27aa lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338829.020724:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cfaba056/0x83671231080c27aa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338829.020739:0:14369:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787338829.020743:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000023f2dc57/0x83671231080c27b1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338829.020749:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bc02045000 already unused, calling callback (ffffffffc1546230) 00010000:00010000:3.0:1787338829.020753:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000023f2dc57/0x83671231080c27b1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338829.020760:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000023f2dc57/0x83671231080c27b1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338829.020770:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000023f2dc57/0x83671231080c27b1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338829.020783:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000023f2dc57/0x83671231080c27b1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338829.020796:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338829.020797:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338829.020799:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787338829.021214:0:15065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787338829.021221:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008867d8ad/0x83671231080c27b8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338829.021231:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=481s v=(0 0) 00010000:00010000:3.0:1787338829.021234:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787338829.021238:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008867d8ad/0x83671231080c27b8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338829.021248:0:15065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008867d8ad/0x83671231080c27b8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338829.021256:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008867d8ad/0x83671231080c27b8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338829.021264:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008867d8ad/0x83671231080c27b8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338829.021279:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787338829.021287:0:14369:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787338829.021297:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008867d8ad/0x83671231080c27b8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338829.021305:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bc02045600 already unused, calling callback (ffffffffc1546230) 00010000:00010000:3.0:1787338829.021309:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008867d8ad/0x83671231080c27b8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338829.021317:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008867d8ad/0x83671231080c27b8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338829.021329:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008867d8ad/0x83671231080c27b8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338829.021336:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008867d8ad/0x83671231080c27b8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338829.021350:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338829.021352:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338829.021353:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787338829.024025:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787338829.024056:0:15652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787338829.042853:0:15065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787338829.042870:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5735c92/0x83671231080c27bf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338829.042906:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=481s v=(0 0) 00010000:00010000:3.0:1787338829.042912:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787338829.042918:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5735c92/0x83671231080c27bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338829.042946:0:15065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c5735c92/0x83671231080c27bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338829.042956:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5735c92/0x83671231080c27bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338829.042962:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c5735c92/0x83671231080c27bf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338829.042982:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1787338829.043257:0:15065:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:3.0:1787338829.043371:0:15065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc01fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14406:x1874160212085376:12345-0@lo:5:osp-pre-1-0.0 Request processed in 112497us (114560us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338829.043382:0:15065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787338829.043447:0:14406:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc01dc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14406:1874160212085376:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1787338829.043462:0:14406:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:3.0:1787338829.043511:0:14406:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbedcb6a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14406:1874160212085504:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1787338829.043546:0:14406:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338829.043599:0:14406:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbd1b31300 going to sleep for 11 seconds 00000100:00100000:3.0:1787338829.043620:0:15063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212085504 00000100:00100000:3.0:1787338829.043627:0:15063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212085504 00000100:00100000:3.0:1787338829.043681:0:15063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787338829.043689:0:15063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbedcb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14406:x1874160212085504:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1787338829.043729:0:15063:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00010000:00010000:0.0:1787338829.052385:0:14369:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787338829.052407:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c5735c92/0x83671231080c27bf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338829.052421:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bc02044c00 already unused, calling callback (ffffffffc1546230) 00010000:00010000:0.0:1787338829.052426:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5735c92/0x83671231080c27bf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338829.052436:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5735c92/0x83671231080c27bf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338829.052546:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c5735c92/0x83671231080c27bf lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338829.052554:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c5735c92/0x83671231080c27bf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338829.052579:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787338829.052581:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787338829.052583:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787338829.055046:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:3.0:1787338829.064514:0:15063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbedcb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14406:x1874160212085504:12345-0@lo:5:osp-pre-1-0.0 Request processed in 20813us (20955us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1787338829.064528:0:15063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787338829.064737:0:14406:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbedcb6a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14406:1874160212085504:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1787338829.064760:0:14406:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:2.0:1787338829.751152:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787338829.872405:0:16139:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg153-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787338830.775983:0:15652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787338831.480262:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf4705c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874160212085632:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787338831.480346:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338831.480460:0:15068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212085632 00000100:00100000:1.0:1787338831.480470:0:15068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212085632 00000100:00100000:1.0:1787338831.480538:0:15068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787338831.480548:0:15068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc01ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874160212085632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787338831.480584:0:15068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787338831.480644:0:15068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc01ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874160212085632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338831.480651:0:15068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1787338831.480706:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787338831.480742:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf4705c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874160212085632:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787338831.669690:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338831.669789:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192168576 00000100:00100000:1.0:1787338831.669801:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192168576 00000100:00100000:1.0:1787338831.669849:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 75 00000100:00100000:1.0:1787338831.669858:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc67c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2355:x1874160192168576:12345-192.168.201.53@tcp:250:mount.lustre.0 00010000:00080000:1.0:1787338831.669931:0:14373:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from a1770da5-776a-45c2-a341-2fca212f2072@192.168.201.53@tcp t0 exp 0000000000000000 cur 484 last 0 00000020:00000080:1.0:1787338831.669977:0:14373:0:(genops.c:1385:class_connect()) connect: client a1770da5-776a-45c2-a341-2fca212f2072, cookie 0x83671231080c27c6 00000100:00080000:1.0:1787338831.670115:0:14373:0:(import.c:65:import_set_state_nolock()) ffff90bac2b50800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787338831.675583:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc67c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1770da5-776a-45c2-a341-2fca212f2072+5:2355:x1874160192168576:12345-192.168.201.53@tcp:250:mount.lustre.0 Request processed in 5708us (5887us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338831.675615:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 75 00000100:00100000:2.0:1787338831.693784:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338831.693925:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192168704 00000100:00100000:0.0:1787338831.693936:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192168704 00000100:00100000:0.0:1787338831.694001:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 76 00000100:00100000:0.0:1787338831.694012:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc67c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1770da5-776a-45c2-a341-2fca212f2072+5:13738:x1874160192168704:12345-192.168.201.53@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787338831.694031:0:14376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787338831.694049:0:14376:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90bbffef4000/0x83671231080c27cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x81bcb3edadaba5d expref: -99 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338831.694080:0:14376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bbffef4000/0x83671231080c27cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadaba5d expref: 6 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338831.694108:0:14376:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90bbffef4000/0x83671231080c27cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadaba5d expref: 6 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338831.694118:0:14376:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbffef4000, rc 0) 00000100:00100000:0.0:1787338831.694240:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc67c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1770da5-776a-45c2-a341-2fca212f2072+6:13738:x1874160192168704:12345-192.168.201.53@tcp:101:mount.lustre.0 Request processed in 229us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338831.694247:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 76 00000100:00100000:0.0:1787338831.704668:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338831.709931:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192168832 00000100:00100000:2.0:1787338831.709946:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192168832 00000100:00100000:2.0:1787338831.710023:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 77 00000100:00100000:2.0:1787338831.710034:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc67c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1770da5-776a-45c2-a341-2fca212f2072+6:13738:x1874160192168832:12345-192.168.201.53@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787338831.710408:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc67c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1770da5-776a-45c2-a341-2fca212f2072+6:13738:x1874160192168832:12345-192.168.201.53@tcp:501:mount.lustre.0 Request processed in 374us (5748us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787338831.710416:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 77 00000100:00100000:1.0:1787338831.712979:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338831.713154:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192168960 00000100:00100000:2.0:1787338831.713164:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192168960 00000100:00100000:2.0:1787338831.713224:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 78 00000100:00100000:2.0:1787338831.713234:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc67c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1770da5-776a-45c2-a341-2fca212f2072+6:13738:x1874160192168960:12345-192.168.201.53@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787338831.713249:0:14375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787338831.713265:0:14375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90bbf40e3e00/0x83671231080c27d4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x81bcb3edadaba64 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338831.713292:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bbf40e3e00/0x83671231080c27d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadaba64 expref: 7 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338831.713306:0:14375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90bbf40e3e00/0x83671231080c27d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadaba64 expref: 7 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338831.713315:0:14375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf40e3e00, rc 0) 00000100:00100000:2.0:1787338831.713375:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc67c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1770da5-776a-45c2-a341-2fca212f2072+7:13738:x1874160192168960:12345-192.168.201.53@tcp:101:mount.lustre.0 Request processed in 142us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338831.713383:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 78 00000100:00100000:1.0:1787338831.716369:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338831.716467:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192169088 00000100:00100000:0.0:1787338831.716475:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192169088 00000100:00100000:0.0:1787338831.716528:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 79 00000100:00100000:0.0:1787338831.716539:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc67c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1770da5-776a-45c2-a341-2fca212f2072+7:13738:x1874160192169088:12345-192.168.201.53@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787338831.716821:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc67c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1770da5-776a-45c2-a341-2fca212f2072+8:13738:x1874160192169088:12345-192.168.201.53@tcp:501:mount.lustre.0 Request processed in 282us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338831.716829:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 79 00000100:00100000:0.0:1787338831.718444:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338831.718849:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192169216 00000100:00100000:3.0:1787338831.718858:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192169216 00000100:00100000:3.0:1787338831.718927:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 80 00000100:00100000:3.0:1787338831.718937:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc67c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1770da5-776a-45c2-a341-2fca212f2072+8:13738:x1874160192169216:12345-192.168.201.53@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787338831.719825:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc67c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1770da5-776a-45c2-a341-2fca212f2072+8:13738:x1874160192169216:12345-192.168.201.53@tcp:503:mount.lustre.0 Request processed in 886us (1382us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338831.719835:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 80 00000100:00100000:1.0:1787338831.725785:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338831.725894:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192169344 00000100:00100000:2.0:1787338831.725917:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192169344 00000100:00100000:2.0:1787338831.726141:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 81 00000100:00100000:2.0:1787338831.726154:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc67c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1770da5-776a-45c2-a341-2fca212f2072+8:13757:x1874160192169344:12345-192.168.201.53@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787338831.726456:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc67c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1770da5-776a-45c2-a341-2fca212f2072+8:13757:x1874160192169344:12345-192.168.201.53@tcp:502:llog_process_th.0 Request processed in 304us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338831.726464:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 81 00000100:00100000:1.0:1787338831.748460:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338831.748552:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192169472 00000100:00100000:3.0:1787338831.748562:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192169472 00000100:00100000:3.0:1787338831.748634:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 82 00000100:00100000:3.0:1787338831.748646:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc67c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1770da5-776a-45c2-a341-2fca212f2072+8:13757:x1874160192169472:12345-192.168.201.53@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787338831.749340:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc67c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1770da5-776a-45c2-a341-2fca212f2072+8:13757:x1874160192169472:12345-192.168.201.53@tcp:502:llog_process_th.0 Request processed in 692us (888us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338831.749350:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 82 00000100:00100000:2.0:1787338831.755755:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338831.757091:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192169600 00000100:00100000:0.0:1787338831.757103:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192169600 00000100:00100000:0.0:1787338831.757240:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 83 00000100:00100000:0.0:1787338831.757257:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc67c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1770da5-776a-45c2-a341-2fca212f2072+8:13738:x1874160192169600:12345-192.168.201.53@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787338831.757279:0:14375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787338831.757298:0:14375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90bbffef5800/0x83671231080c27db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x81bcb3edadaba8e expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338831.757340:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bbffef5800/0x83671231080c27db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadaba8e expref: 9 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338831.757380:0:14375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90bbffef5800/0x83671231080c27db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadaba8e expref: 9 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338831.757393:0:14375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbffef5800, rc 0) 00000100:00100000:0.0:1787338831.757459:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc67c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1770da5-776a-45c2-a341-2fca212f2072+9:13738:x1874160192169600:12345-192.168.201.53@tcp:101:mount.lustre.0 Request processed in 205us (1715us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338831.757470:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 83 00000100:00100000:1.0:1787338831.769850:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338831.771839:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192169728 00000100:00100000:2.0:1787338831.771853:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192169728 00000100:00100000:2.0:1787338831.772020:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 84 00000100:00100000:2.0:1787338831.772033:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc67c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1770da5-776a-45c2-a341-2fca212f2072+9:13738:x1874160192169728:12345-192.168.201.53@tcp:256:mount.lustre.0 20000000:01000000:2.0:1787338831.772062:0:14373:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1787338831.772087:0:14373:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787338831.772091:0:14373:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1787338831.772094:0:14373:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1787338831.772096:0:14373:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1787338831.774310:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc67c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1770da5-776a-45c2-a341-2fca212f2072+9:13738:x1874160192169728:12345-192.168.201.53@tcp:256:mount.lustre.0 Request processed in 2269us (4458us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338831.774325:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 84 00000100:00100000:3.0:1787338831.777358:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338831.777583:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192169856 00000100:00100000:0.0:1787338831.777610:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192169856 00000100:00100000:0.0:1787338831.777677:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 85 00000100:00100000:0.0:1787338831.777687:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfb90f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1770da5-776a-45c2-a341-2fca212f2072+9:13738:x1874160192169856:12345-192.168.201.53@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787338831.777708:0:14375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787338831.777725:0:14375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90bbffef5400/0x83671231080c27e2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x81bcb3edadaba95 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338831.777767:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bbffef5400/0x83671231080c27e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadaba95 expref: 10 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338831.777777:0:14375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90bbffef5400/0x83671231080c27e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadaba95 expref: 10 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338831.777786:0:14375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbffef5400, rc 0) 00000100:00100000:0.0:1787338831.777841:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfb90f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1770da5-776a-45c2-a341-2fca212f2072+10:13738:x1874160192169856:12345-192.168.201.53@tcp:101:mount.lustre.0 Request processed in 156us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338831.777852:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 85 00000100:00100000:1.0:1787338831.780491:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338831.780658:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192169984 00000100:00100000:2.0:1787338831.780667:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192169984 00000100:00100000:2.0:1787338831.780717:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 86 00000100:00100000:2.0:1787338831.780725:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfb90c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1770da5-776a-45c2-a341-2fca212f2072+10:13738:x1874160192169984:12345-192.168.201.53@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787338831.781015:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfb90c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1770da5-776a-45c2-a341-2fca212f2072+10:13738:x1874160192169984:12345-192.168.201.53@tcp:501:mount.lustre.0 Request processed in 290us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338831.781024:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 86 00000100:00100000:1.0:1787338831.783399:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338831.783577:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192170112 00000100:00100000:2.0:1787338831.783585:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192170112 00000100:00100000:2.0:1787338831.783653:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 87 00000100:00100000:2.0:1787338831.783663:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfb90c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1770da5-776a-45c2-a341-2fca212f2072+10:13738:x1874160192170112:12345-192.168.201.53@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787338831.783961:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfb90c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1770da5-776a-45c2-a341-2fca212f2072+10:13738:x1874160192170112:12345-192.168.201.53@tcp:503:mount.lustre.0 Request processed in 298us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338831.783970:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 87 00000100:00100000:2.0:1787338831.786978:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338831.787066:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192170240 00000100:00100000:0.0:1787338831.787087:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192170240 00000100:00100000:0.0:1787338831.787143:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 88 00000100:00100000:0.0:1787338831.787153:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfb90fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1770da5-776a-45c2-a341-2fca212f2072+10:13762:x1874160192170240:12345-192.168.201.53@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787338831.787570:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfb90fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1770da5-776a-45c2-a341-2fca212f2072+10:13762:x1874160192170240:12345-192.168.201.53@tcp:502:llog_process_th.0 Request processed in 417us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338831.787579:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 88 00000100:00100000:1.0:1787338831.796151:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338831.797015:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192170368 00000100:00100000:0.0:1787338831.797025:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192170368 00000100:00100000:0.0:1787338831.797084:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 89 00000100:00100000:0.0:1787338831.797094:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfb90f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1770da5-776a-45c2-a341-2fca212f2072+10:13762:x1874160192170368:12345-192.168.201.53@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787338831.797350:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfb90f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1770da5-776a-45c2-a341-2fca212f2072+10:13762:x1874160192170368:12345-192.168.201.53@tcp:502:llog_process_th.0 Request processed in 257us (1210us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338831.797367:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 89 00010000:00010000:0.0:1787338831.798909:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787338831.831466:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338831.831535:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192170496 00000100:00100000:0.0:1787338831.831546:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192170496 00000100:00100000:0.0:1787338831.831602:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 4 00000100:00100000:0.0:1787338831.831611:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf4704e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2355:x1874160192170496:12345-192.168.201.53@tcp:38:mount.lustre.0 00010000:00080000:0.0:1787338831.831641:0:14382:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 4f600308-4919-499d-be82-256c83420e0e@192.168.201.53@tcp t0 exp 0000000000000000 cur 484 last 0 00000020:00000080:0.0:1787338831.831689:0:14382:0:(genops.c:1385:class_connect()) connect: client 4f600308-4919-499d-be82-256c83420e0e, cookie 0x83671231080c27e9 00000004:00100000:0.0:1787338831.831719:0:14382:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1787338831.831724:0:14382:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:2.0:1787338831.871724:0:14382:0:(import.c:65:import_set_state_nolock()) ffff90bbffd11000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787338831.871822:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf4704e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f600308-4919-499d-be82-256c83420e0e+6:2355:x1874160192170496:12345-192.168.201.53@tcp:38:mount.lustre.0 Request processed in 40209us (40364us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338831.871835:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 4 00000100:00100000:3.0:1787338831.876249:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338831.876366:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338831.877749:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192170624 00000100:00100000:0.0:1787338831.877763:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192170624 00000100:00100000:0.0:1787338831.877832:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192170752 00000100:00100000:0.0:1787338831.877845:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192170752 00000100:00100000:3.0:1787338831.877857:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 5 00000100:00100000:3.0:1787338831.877868:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbedcb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f600308-4919-499d-be82-256c83420e0e+7:0:x1874160192170624:12345-192.168.201.53@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787338831.877928:0:14382:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00080000:2.0:1787338831.877936:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787338831.878081:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbedcb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f600308-4919-499d-be82-256c83420e0e+7:0:x1874160192170624:12345-192.168.201.53@tcp:41:mount.lustre.0 Request processed in 213us (1932us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338831.878089:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 5 00000100:00100000:3.0:1787338831.878120:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 6 00000100:00100000:3.0:1787338831.878126:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f600308-4919-499d-be82-256c83420e0e+6:13738:x1874160192170752:12345-192.168.201.53@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787338831.878146:0:14382:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787338831.879272:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f600308-4919-499d-be82-256c83420e0e+6:13738:x1874160192170752:12345-192.168.201.53@tcp:41:mount.lustre.0 Request processed in 1142us (2902us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338831.879281:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 6 00000100:00100000:3.0:1787338831.880532:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338831.880657:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192170880 00000100:00100000:0.0:1787338831.880666:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192170880 00000100:00100000:0.0:1787338831.880710:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 7 00000100:00100000:0.0:1787338831.880719:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f600308-4919-499d-be82-256c83420e0e+6:13738:x1874160192170880:12345-192.168.201.53@tcp:40:mount.lustre.0 00000100:00100000:0.0:1787338831.880782:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f600308-4919-499d-be82-256c83420e0e+6:13738:x1874160192170880:12345-192.168.201.53@tcp:40:mount.lustre.0 Request processed in 65us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338831.880789:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 7 00000100:00100000:1.0:1787338831.882078:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338831.882292:0:15650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192171008 00000100:00100000:0.0:1787338831.882298:0:15650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192171008 00000100:00100000:0.0:1787338831.882329:0:15650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 8 00000100:00100000:0.0:1787338831.882337:0:15650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf4704000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2355:x1874160192171008:12345-192.168.201.53@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787338831.882365:0:15650:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 4f600308-4919-499d-be82-256c83420e0e@192.168.201.53@tcp t0 exp 0000000000000000 cur 484 last 0 00000020:00000080:0.0:1787338831.882443:0:15650:0:(genops.c:1385:class_connect()) connect: client 4f600308-4919-499d-be82-256c83420e0e, cookie 0x83671231080c27f0 00002000:00100000:0.0:1787338831.882454:0:15650:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 4f600308-4919-499d-be82-256c83420e0e/ffff90bac1c36800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787338831.882466:0:15650:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787338831.882788:0:15650:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787338831.882817:0:15650:0:(import.c:65:import_set_state_nolock()) ffff90bac1c33000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787338831.883477:0:15650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf4704000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f600308-4919-499d-be82-256c83420e0e+6:2355:x1874160192171008:12345-192.168.201.53@tcp:8:mount.lustre.0 Request processed in 1137us (1400us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338831.883487:0:15650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 8 00000100:00100000:3.0:1787338831.883822:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338831.883957:0:15065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192171136 00000100:00100000:0.0:1787338831.883964:0:15065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192171136 00000100:00100000:3.0:1787338831.884705:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338831.884759:0:15065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 9 00000100:00100000:0.0:1787338831.884816:0:15065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2355:x1874160192171136:12345-192.168.201.53@tcp:8:mount.lustre.0 00000100:00100000:2.0:1787338831.884826:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192171264 00000100:00100000:2.0:1787338831.884831:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192171264 00010000:00080000:0.0:1787338831.884846:0:15065:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 4f600308-4919-499d-be82-256c83420e0e@192.168.201.53@tcp t0 exp 0000000000000000 cur 484 last 0 00000100:00100000:2.0:1787338831.884905:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 0 00000100:00100000:2.0:1787338831.884913:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f600308-4919-499d-be82-256c83420e0e+6:13738:x1874160192171264:12345-192.168.201.53@tcp:33:mount.lustre.0 00000020:00000080:0.0:1787338831.885115:0:15065:0:(genops.c:1385:class_connect()) connect: client 4f600308-4919-499d-be82-256c83420e0e, cookie 0x83671231080c27f7 00002000:00100000:0.0:1787338831.885126:0:15065:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 4f600308-4919-499d-be82-256c83420e0e/ffff90bac1c30800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787338831.885146:0:15065:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787338831.885490:0:15065:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787338831.885521:0:15065:0:(import.c:65:import_set_state_nolock()) ffff90bac1c32000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787338831.885598:0:15065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f600308-4919-499d-be82-256c83420e0e+6:2355:x1874160192171136:12345-192.168.201.53@tcp:8:mount.lustre.0 Request processed in 831us (1776us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338831.885606:0:15065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 9 00000004:00080000:0.0:1787338831.889802:0:14384:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 4814us 00000004:00200000:0.0:1787338831.905088:0:14384:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:0.0:1787338831.905508:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f600308-4919-499d-be82-256c83420e0e+6:13738:x1874160192171264:12345-192.168.201.53@tcp:33:mount.lustre.0 Request processed in 20588us (20798us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338831.905523:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 0 00000100:00100000:1.0:1787338832.049754:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338832.049851:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192171392 00000100:00100000:3.0:1787338832.049860:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192171392 00000100:00100000:3.0:1787338832.049953:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 8 00000100:00100000:3.0:1787338832.049962:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf4707100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f600308-4919-499d-be82-256c83420e0e+6:13783:x1874160192171392:12345-192.168.201.53@tcp:101:mkdir.0 00010000:00010000:3.0:1787338832.049985:0:14382:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787338832.050008:0:14382:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045600/0x83671231080c27fe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadababf expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338832.050059:0:14382:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045000/0x83671231080c2805 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338832.050068:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045000/0x83671231080c2805 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338832.050077:0:14382:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045000/0x83671231080c2805 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787338832.050267:0:14382:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787338832.050272:0:14382:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1787338832.050365:0:14382:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045000/0x83671231080c2805 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338832.050415:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045600/0x83671231080c27fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadababf expref: 8 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338832.050434:0:14382:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045000/0x83671231080c2805 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadababf expref: 7 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338832.050443:0:14382:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90bbc9a99000) 00010000:00010000:3.0:1787338832.050446:0:14382:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787338832.050449:0:14382:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bc02045000, rc 0) 00000100:00100000:3.0:1787338832.050506:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf4707100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f600308-4919-499d-be82-256c83420e0e+7:13783:x1874160192171392:12345-192.168.201.53@tcp:101:mkdir.0 Request processed in 543us (760us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338832.050512:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 8 00010000:00010000:2.0:1787338832.827692:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787338833.854307:0:15652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787338834.038203:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc01dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874160212085760:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787338834.038282:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338834.038426:0:15068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212085760 00000100:00100000:2.0:1787338834.038434:0:15068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212085760 00000100:00100000:2.0:1787338834.038509:0:15068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787338834.038521:0:15068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1874160212085760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787338834.038585:0:15068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787338834.038632:0:15068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1874160212085760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338834.038639:0:15068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787338834.038730:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc01ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874160212086144:0@lo:400:kworker.0 00000100:00100000:2.0:1787338834.038759:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338834.038780:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787338834.038785:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc01ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874160212086016:0@lo:400:kworker.0 00000100:00100000:2.0:1787338834.038806:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338834.038829:0:15066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212086016 00000100:00100000:2.0:1787338834.038833:0:15066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212086016 00000100:00100000:2.0:1787338834.038862:0:15066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787338834.038869:0:15066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc01d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1874160212086016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787338834.038934:0:15066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc01d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1874160212086016:12345-0@lo:400:kworker.0 Request processed in 65us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338834.038941:0:15066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787338834.038972:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc01ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874160212086016:0@lo:400:kworker.0 00000100:00080000:3.0:1787338834.039030:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787338834.039034:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787338834.039045:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc01f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1874160212086272:0@lo:400:kworker.0 00000100:00100000:3.0:1787338834.039071:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338834.039104:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc01dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874160212085760:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787338834.039255:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787338834.039261:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc01ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c0e6575-df80-419a-8cc7-cbad06c93254:3314:1874160212085888:0@lo:400:kworker.0 00000100:00100000:3.0:1787338834.039289:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338834.039331:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212086144 00000100:00100000:2.0:1787338834.039336:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212086144 00000100:00100000:2.0:1787338834.039358:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212086272 00000100:00100000:2.0:1787338834.039361:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212086272 00000100:00100000:2.0:1787338834.039380:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787338834.039387:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc01f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874160212086144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787338834.039424:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc01f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874160212086144:12345-0@lo:400:kworker.0 Request processed in 38us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338834.039431:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787338834.039452:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787338834.039459:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874160212086272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787338834.039487:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874160212086272:12345-0@lo:400:kworker.0 Request processed in 29us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338834.039493:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787338834.039519:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc01ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874160212086144:0@lo:400:kworker.0 00000100:00080000:2.0:1787338834.039559:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787338834.053089:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc01e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1874160212086400:0@lo:400:kworker.0 00000100:00100000:3.0:1787338834.053161:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338834.053214:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc01f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1874160212086272:0@lo:400:kworker.0 00000100:00100000:2.0:1787338834.053233:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212086400 00000100:00100000:2.0:1787338834.053239:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212086400 00000100:00080000:2.0:1787338834.053276:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787338834.056411:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787338834.056427:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874160212086400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787338834.056518:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874160212086400:12345-0@lo:400:kworker.0 Request processed in 96us (3357us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338834.056526:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787338834.058696:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212085888 00000100:00100000:1.0:1787338834.058711:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212085888 00000100:00100000:1.0:1787338834.058766:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787338834.058778:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfb90e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c0e6575-df80-419a-8cc7-cbad06c93254+19:3314:x1874160212085888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787338834.058858:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfb90e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c0e6575-df80-419a-8cc7-cbad06c93254+19:3314:x1874160212085888:12345-0@lo:400:kworker.0 Request processed in 83us (19567us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338834.058866:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787338834.059305:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc01ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c0e6575-df80-419a-8cc7-cbad06c93254:3314:1874160212085888:0@lo:400:kworker.0 00000100:00100000:3.0:1787338834.059325:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc01e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1874160212086400:0@lo:400:kworker.0 00000100:00100000:2.0:1787338834.120372:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338834.120492:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192171520 00000100:00100000:1.0:1787338834.120504:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192171520 00000100:00100000:1.0:1787338834.120609:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 9 00000100:00100000:1.0:1787338834.120620:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc01ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f600308-4919-499d-be82-256c83420e0e+7:13835:x1874160192171520:12345-192.168.201.53@tcp:41:lfs.0 00000004:00000024:1.0:1787338834.120663:0:14383:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1787338834.120773:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc01ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f600308-4919-499d-be82-256c83420e0e+7:13835:x1874160192171520:12345-192.168.201.53@tcp:41:lfs.0 Request processed in 154us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338834.120795:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 9 00000100:00080000:2.0:1787338834.121901:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787338834.129692:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338834.129870:0:15068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192171648 00000100:00100000:2.0:1787338834.129894:0:15068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192171648 00000100:00100000:2.0:1787338834.129973:0:15068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 5 00000100:00100000:2.0:1787338834.129985:0:15068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4f600308-4919-499d-be82-256c83420e0e+6:13835:x1874160192171648:12345-192.168.201.53@tcp:13:lfs.0 00002000:00000024:2.0:1787338834.130020:0:15068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787338834.130098:0:15068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4f600308-4919-499d-be82-256c83420e0e+6:13835:x1874160192171648:12345-192.168.201.53@tcp:13:lfs.0 Request processed in 115us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338834.130119:0:15068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 5 00000100:00080000:3.0:1787338834.130240:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787338834.132483:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338834.132543:0:15068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192171776 00000100:00100000:3.0:1787338834.132561:0:15068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192171776 00000100:00080000:1.0:1787338834.132605:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787338834.132621:0:15068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 6 00000100:00100000:3.0:1787338834.132632:0:15068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc01ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4f600308-4919-499d-be82-256c83420e0e+6:13835:x1874160192171776:12345-192.168.201.53@tcp:13:lfs.0 00002000:00000024:3.0:1787338834.132656:0:15068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787338834.132742:0:15068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc01ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4f600308-4919-499d-be82-256c83420e0e+6:13835:x1874160192171776:12345-192.168.201.53@tcp:13:lfs.0 Request processed in 111us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338834.132750:0:15068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 6 00000001:00100000:1.0:1787338834.176522:0:7651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4f600308-4919-499d-be82-256c83420e0e 00000001:00100000:1.0:1787338834.176538:0:7651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1787338834.176846:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000100:00100000:2.0:1787338834.392220:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338834.392300:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192171904 00000100:00100000:3.0:1787338834.392310:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192171904 00000100:00100000:3.0:1787338834.392373:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 91 00000100:00100000:3.0:1787338834.392384:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfb90f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1770da5-776a-45c2-a341-2fca212f2072+10:13865:x1874160192171904:12345-192.168.201.53@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787338834.392401:0:14376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787338834.392417:0:14376:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90bc02045600/0x83671231080c280c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x81bcb3edadabac6 expref: -99 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338834.392464:0:14376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bc02045600/0x83671231080c280c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabac6 expref: 11 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338834.392476:0:14376:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90bc02045600/0x83671231080c280c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabac6 expref: 11 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338834.392484:0:14376:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bc02045600, rc 0) 00000100:00100000:3.0:1787338834.392551:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfb90f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1770da5-776a-45c2-a341-2fca212f2072+11:13865:x1874160192171904:12345-192.168.201.53@tcp:101:mount.lustre.0 Request processed in 160us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338834.392559:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 91 00000100:00100000:1.0:1787338834.400684:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338834.400799:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192172032 00000100:00100000:0.0:1787338834.400809:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192172032 00000100:00100000:0.0:1787338834.400870:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 92 00000100:00100000:0.0:1787338834.400908:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfb90dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1770da5-776a-45c2-a341-2fca212f2072+11:13865:x1874160192172032:12345-192.168.201.53@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787338834.401214:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfb90dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1770da5-776a-45c2-a341-2fca212f2072+11:13865:x1874160192172032:12345-192.168.201.53@tcp:501:mount.lustre.0 Request processed in 308us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338834.401222:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 92 00000100:00100000:2.0:1787338834.413258:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338834.413471:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192172160 00000100:00100000:1.0:1787338834.413482:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192172160 00000100:00100000:1.0:1787338834.413972:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 93 00000100:00100000:1.0:1787338834.414000:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfb90d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1770da5-776a-45c2-a341-2fca212f2072+11:13865:x1874160192172160:12345-192.168.201.53@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787338834.415334:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfb90d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1770da5-776a-45c2-a341-2fca212f2072+11:13865:x1874160192172160:12345-192.168.201.53@tcp:503:mount.lustre.0 Request processed in 1343us (2455us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338834.415356:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 93 00000100:00100000:2.0:1787338834.426751:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338834.426845:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192172288 00000100:00100000:3.0:1787338834.426856:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192172288 00000100:00100000:3.0:1787338834.426957:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 94 00000100:00100000:3.0:1787338834.426969:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfb90e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1770da5-776a-45c2-a341-2fca212f2072+11:13873:x1874160192172288:12345-192.168.201.53@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787338834.427321:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfb90e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1770da5-776a-45c2-a341-2fca212f2072+11:13873:x1874160192172288:12345-192.168.201.53@tcp:502:llog_process_th.0 Request processed in 353us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338834.427329:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 94 00000100:00100000:1.0:1787338834.473630:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338834.473746:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192172416 00000100:00100000:0.0:1787338834.473761:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192172416 00000100:00100000:0.0:1787338834.473829:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 95 00000100:00100000:0.0:1787338834.473839:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfb90d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1770da5-776a-45c2-a341-2fca212f2072+11:13873:x1874160192172416:12345-192.168.201.53@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787338834.474406:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfb90d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1770da5-776a-45c2-a341-2fca212f2072+11:13873:x1874160192172416:12345-192.168.201.53@tcp:502:llog_process_th.0 Request processed in 565us (784us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338834.474432:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 95 00000100:00100000:2.0:1787338834.507331:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338834.507472:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192172544 00000100:00100000:0.0:1787338834.507487:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192172544 00000100:00100000:0.0:1787338834.507590:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 96 00000100:00100000:0.0:1787338834.507602:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfb90e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1770da5-776a-45c2-a341-2fca212f2072+11:13865:x1874160192172544:12345-192.168.201.53@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787338834.507632:0:14373:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787338834.507658:0:14373:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90bbffef4c00/0x83671231080c2813 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x81bcb3edadabaf0 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338834.507706:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bbffef4c00/0x83671231080c2813 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabaf0 expref: 12 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338834.507718:0:14373:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90bbffef4c00/0x83671231080c2813 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabaf0 expref: 12 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338834.507728:0:14373:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbffef4c00, rc 0) 00000100:00100000:0.0:1787338834.507799:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfb90e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1770da5-776a-45c2-a341-2fca212f2072+12:13865:x1874160192172544:12345-192.168.201.53@tcp:101:mount.lustre.0 Request processed in 198us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338834.507813:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 96 00000100:00100000:2.0:1787338834.527988:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338834.528096:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192172672 00000100:00100000:3.0:1787338834.528135:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192172672 00000100:00100000:3.0:1787338834.528196:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 97 00000100:00100000:3.0:1787338834.528208:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfb90c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1770da5-776a-45c2-a341-2fca212f2072+12:13865:x1874160192172672:12345-192.168.201.53@tcp:256:mount.lustre.0 20000000:01000000:3.0:1787338834.528231:0:14376:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1787338834.528260:0:14376:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1787338834.528265:0:14376:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1787338834.528273:0:14376:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1787338834.528276:0:14376:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1787338834.532726:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfb90c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1770da5-776a-45c2-a341-2fca212f2072+12:13865:x1874160192172672:12345-192.168.201.53@tcp:256:mount.lustre.0 Request processed in 4510us (4737us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338834.532757:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 97 00000100:00100000:2.0:1787338834.536663:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338834.536764:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192172800 00000100:00100000:1.0:1787338834.536774:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192172800 00000100:00100000:1.0:1787338834.536833:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 98 00000100:00100000:1.0:1787338834.536844:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffd23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1770da5-776a-45c2-a341-2fca212f2072+12:13865:x1874160192172800:12345-192.168.201.53@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787338834.536861:0:14375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787338834.536902:0:14375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90bbfbe9ca00/0x83671231080c281a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x81bcb3edadabaf7 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338834.537051:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bbfbe9ca00/0x83671231080c281a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabaf7 expref: 13 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338834.537067:0:14375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90bbfbe9ca00/0x83671231080c281a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabaf7 expref: 13 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338834.537086:0:14375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbfbe9ca00, rc 0) 00000100:00100000:1.0:1787338834.537491:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffd23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1770da5-776a-45c2-a341-2fca212f2072+13:13865:x1874160192172800:12345-192.168.201.53@tcp:101:mount.lustre.0 Request processed in 647us (838us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338834.537499:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 98 00000100:00100000:2.0:1787338834.539306:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338834.539370:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192172928 00000100:00100000:3.0:1787338834.539379:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192172928 00000100:00100000:3.0:1787338834.539430:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 99 00000100:00100000:3.0:1787338834.539439:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffd22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1770da5-776a-45c2-a341-2fca212f2072+13:13865:x1874160192172928:12345-192.168.201.53@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787338834.540080:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffd22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1770da5-776a-45c2-a341-2fca212f2072+13:13865:x1874160192172928:12345-192.168.201.53@tcp:501:mount.lustre.0 Request processed in 639us (780us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338834.540089:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 99 00000100:00100000:2.0:1787338834.542566:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338834.542659:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192173056 00000100:00100000:1.0:1787338834.542667:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192173056 00000100:00100000:1.0:1787338834.542757:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 100 00000100:00100000:1.0:1787338834.542768:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffd20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1770da5-776a-45c2-a341-2fca212f2072+13:13865:x1874160192173056:12345-192.168.201.53@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787338834.543030:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffd20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1770da5-776a-45c2-a341-2fca212f2072+13:13865:x1874160192173056:12345-192.168.201.53@tcp:503:mount.lustre.0 Request processed in 262us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338834.543038:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 100 00000100:00100000:2.0:1787338834.545803:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338834.546475:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192173184 00000100:00100000:0.0:1787338834.546489:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192173184 00000100:00100000:3.0:1787338834.546563:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 101 00000100:00100000:3.0:1787338834.546576:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffd22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1770da5-776a-45c2-a341-2fca212f2072+13:13880:x1874160192173184:12345-192.168.201.53@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787338834.546855:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffd22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1770da5-776a-45c2-a341-2fca212f2072+13:13880:x1874160192173184:12345-192.168.201.53@tcp:502:llog_process_th.0 Request processed in 280us (1059us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338834.546864:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 101 00000100:00100000:2.0:1787338834.552789:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338834.552966:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192173312 00000100:00100000:3.0:1787338834.552976:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192173312 00000100:00100000:3.0:1787338834.553019:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 102 00000100:00100000:3.0:1787338834.553030:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffd20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1770da5-776a-45c2-a341-2fca212f2072+13:13880:x1874160192173312:12345-192.168.201.53@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787338834.553290:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffd20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1770da5-776a-45c2-a341-2fca212f2072+13:13880:x1874160192173312:12345-192.168.201.53@tcp:502:llog_process_th.0 Request processed in 259us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338834.553299:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 102 00000100:00100000:3.0:1787338834.574316:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338834.574361:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338834.574391:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338834.574412:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338834.574670:0:15065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192173952 00000100:00100000:1.0:1787338834.574681:0:15065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192173952 00000100:00100000:1.0:1787338834.574731:0:15065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192174080 00000100:00100000:1.0:1787338834.574734:0:15065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192174080 00000100:00100000:1.0:1787338834.574757:0:15065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 3 00000100:00100000:1.0:1787338834.574767:0:15065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f600308-4919-499d-be82-256c83420e0e+6:2357:x1874160192173952:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:1.0:1787338834.574840:0:15065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f600308-4919-499d-be82-256c83420e0e+6:2357:x1874160192173952:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 75us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338834.574848:0:15065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 3 00000100:00100000:1.0:1787338834.574865:0:15065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 4 00000100:00100000:1.0:1787338834.574893:0:15065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f600308-4919-499d-be82-256c83420e0e+5:2357:x1874160192174080:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:1.0:1787338834.574917:0:15065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f600308-4919-499d-be82-256c83420e0e+5:2357:x1874160192174080:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 47us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338834.574949:0:15065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 4 00000100:00100000:1.0:1787338834.574973:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192173440 00000100:00100000:1.0:1787338834.574977:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192173440 00000100:00100000:1.0:1787338834.574994:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192173824 00000100:00100000:1.0:1787338834.574997:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192173824 00000100:00100000:1.0:1787338834.575011:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 16 00000100:00100000:1.0:1787338834.575017:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f600308-4919-499d-be82-256c83420e0e+7:2357:x1874160192173824:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:1.0:1787338834.575041:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f600308-4919-499d-be82-256c83420e0e+7:2357:x1874160192173824:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 25us (651us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338834.575047:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 16 00000100:00100000:1.0:1787338834.575056:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 10 00000100:00100000:1.0:1787338834.575061:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2355:x1874160192173440:12345-192.168.201.53@tcp:38:mount.lustre.0 00010000:00080000:1.0:1787338834.575082:0:14383:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 0bebf184-ca0d-4db5-82d4-d664d446db69@192.168.201.53@tcp t0 exp 0000000000000000 cur 487 last 0 00000020:00000080:1.0:1787338834.575132:0:14383:0:(genops.c:1385:class_connect()) connect: client 0bebf184-ca0d-4db5-82d4-d664d446db69, cookie 0x83671231080c2821 00000004:00100000:1.0:1787338834.575165:0:14383:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1787338834.575305:0:14383:0:(import.c:65:import_set_state_nolock()) ffff90bac2b53000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787338834.575339:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0bebf184-ca0d-4db5-82d4-d664d446db69+6:2355:x1874160192173440:12345-192.168.201.53@tcp:38:mount.lustre.0 Request processed in 276us (1032us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338834.575346:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 10 00000100:00100000:3.0:1787338834.578075:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338834.578371:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338834.593465:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192173696 00000100:00100000:0.0:1787338834.593481:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192173696 00000100:00100000:0.0:1787338834.593603:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192173568 00000100:00100000:0.0:1787338834.593607:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192173568 00000100:00100000:0.0:1787338834.593631:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 11 00000100:00100000:0.0:1787338834.593641:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0bebf184-ca0d-4db5-82d4-d664d446db69+7:13865:x1874160192173696:12345-192.168.201.53@tcp:41:mount.lustre.0 00000100:00080000:3.0:1787338834.593686:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:0.0:1787338834.593690:0:14382:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787338834.593766:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0bebf184-ca0d-4db5-82d4-d664d446db69+7:13865:x1874160192173696:12345-192.168.201.53@tcp:41:mount.lustre.0 Request processed in 126us (15700us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338834.593775:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 11 00000100:00100000:0.0:1787338834.593793:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 12 00000100:00100000:0.0:1787338834.593800:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0bebf184-ca0d-4db5-82d4-d664d446db69+6:0:x1874160192173568:12345-192.168.201.53@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787338834.593812:0:14382:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787338834.593835:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0bebf184-ca0d-4db5-82d4-d664d446db69+6:0:x1874160192173568:12345-192.168.201.53@tcp:41:mount.lustre.0 Request processed in 35us (15465us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338834.593842:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 12 00000100:00100000:0.0:1787338834.598451:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338834.598550:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192174208 00000100:00100000:3.0:1787338834.598559:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192174208 00000100:00100000:3.0:1787338834.598653:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 13 00000100:00100000:3.0:1787338834.598664:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4095500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0bebf184-ca0d-4db5-82d4-d664d446db69+6:13865:x1874160192174208:12345-192.168.201.53@tcp:40:mount.lustre.0 00000100:00100000:3.0:1787338834.598739:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4095500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0bebf184-ca0d-4db5-82d4-d664d446db69+6:13865:x1874160192174208:12345-192.168.201.53@tcp:40:mount.lustre.0 Request processed in 78us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338834.598747:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 13 00000100:00100000:0.0:1787338834.605712:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338834.605746:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338834.605780:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338834.605979:0:15065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192174336 00000100:00100000:3.0:1787338834.605989:0:15065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192174336 00000100:00100000:3.0:1787338834.606019:0:15065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192174464 00000100:00100000:3.0:1787338834.606022:0:15065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192174464 00000100:00100000:3.0:1787338834.606049:0:15065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 10 00000100:00100000:3.0:1787338834.606057:0:15065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4096680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2355:x1874160192174336:12345-192.168.201.53@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787338834.606091:0:15065:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 0bebf184-ca0d-4db5-82d4-d664d446db69@192.168.201.53@tcp t0 exp 0000000000000000 cur 487 last 0 00000100:00100000:1.0:1787338834.606102:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192174592 00000100:00100000:1.0:1787338834.606107:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192174592 00000100:00100000:1.0:1787338834.606141:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 1 00000100:00100000:1.0:1787338834.606149:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4095880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0bebf184-ca0d-4db5-82d4-d664d446db69+6:13865:x1874160192174592:12345-192.168.201.53@tcp:33:mount.lustre.0 00000020:00000080:3.0:1787338834.606352:0:15065:0:(genops.c:1385:class_connect()) connect: client 0bebf184-ca0d-4db5-82d4-d664d446db69, cookie 0x83671231080c2828 00002000:00100000:3.0:1787338834.606364:0:15065:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 0bebf184-ca0d-4db5-82d4-d664d446db69/ffff90bac2b3c800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787338834.606375:0:15065:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000004:00200000:1.0:1787338834.606408:0:14385:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:1.0:1787338834.606556:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4095880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0bebf184-ca0d-4db5-82d4-d664d446db69+6:13865:x1874160192174592:12345-192.168.201.53@tcp:33:mount.lustre.0 Request processed in 407us (855us total) trans 0 rc 0/0 00002000:00080000:3.0:1787338834.606560:0:15065:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:1.0:1787338834.606570:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 1 00000100:00080000:3.0:1787338834.606587:0:15065:0:(import.c:65:import_set_state_nolock()) ffff90bac2b39800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787338834.606616:0:15065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4096680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0bebf184-ca0d-4db5-82d4-d664d446db69+6:2355:x1874160192174336:12345-192.168.201.53@tcp:8:mount.lustre.0 Request processed in 559us (869us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338834.608830:0:15063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 11 00000100:00100000:0.0:1787338834.608844:0:15063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4096d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2355:x1874160192174464:12345-192.168.201.53@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787338834.608891:0:15063:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 0bebf184-ca0d-4db5-82d4-d664d446db69@192.168.201.53@tcp t0 exp 0000000000000000 cur 487 last 0 00000020:00000080:0.0:1787338834.608921:0:15063:0:(genops.c:1385:class_connect()) connect: client 0bebf184-ca0d-4db5-82d4-d664d446db69, cookie 0x83671231080c282f 00002000:00100000:0.0:1787338834.608935:0:15063:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 0bebf184-ca0d-4db5-82d4-d664d446db69/ffff90bac1c34000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787338834.608946:0:15063:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787338834.609176:0:15063:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787338834.609210:0:15063:0:(import.c:65:import_set_state_nolock()) ffff90bbc96a9000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787338834.609273:0:15063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4096d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0bebf184-ca0d-4db5-82d4-d664d446db69+6:2355:x1874160192174464:12345-192.168.201.53@tcp:8:mount.lustre.0 Request processed in 430us (3490us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338834.609297:0:15063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 11 00000100:00100000:3.0:1787338834.614316:0:15065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 10 00000001:00100000:0.0:1787338834.624358:0:6714:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4f600308-4919-499d-be82-256c83420e0e 00000100:00100000:3.0:1787338834.746275:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338834.746343:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192174720 00000100:00100000:0.0:1787338834.746361:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192174720 00000100:00100000:0.0:1787338834.746424:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 14 00000100:00100000:0.0:1787338834.746435:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0bebf184-ca0d-4db5-82d4-d664d446db69+6:13901:x1874160192174720:12345-192.168.201.53@tcp:101:mkdir.0 00010000:00010000:0.0:1787338834.746455:0:14383:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787338834.746478:0:14383:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4200/0x83671231080c2836 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadabb21 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338834.746558:0:14383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4600/0x83671231080c283d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338834.746571:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4600/0x83671231080c283d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338834.746587:0:14383:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4600/0x83671231080c283d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787338834.746790:0:14383:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787338834.746794:0:14383:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1787338834.746901:0:14383:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4600/0x83671231080c283d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338834.746938:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4200/0x83671231080c2836 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabb21 expref: 8 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338834.746956:0:14383:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4600/0x83671231080c283d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabb21 expref: 7 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338834.746977:0:14383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90bbc9a99000) 00010000:00010000:0.0:1787338834.746980:0:14383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787338834.746984:0:14383:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbffef4600, rc 0) 00000100:00100000:0.0:1787338834.747059:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0bebf184-ca0d-4db5-82d4-d664d446db69+7:13901:x1874160192174720:12345-192.168.201.53@tcp:101:mkdir.0 Request processed in 625us (790us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338834.747067:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 14 00010000:00010000:0.0:1787338834.871782:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787338835.894315:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787338836.598289:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787338836.603544:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf4705500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874160212086528:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787338836.603640:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338836.607596:0:15068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212086528 00000100:00100000:3.0:1787338836.607611:0:15068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212086528 00000100:00100000:3.0:1787338836.607711:0:15068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787338836.607724:0:15068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc01c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874160212086528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787338836.607764:0:15068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787338836.607847:0:15068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc01c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874160212086528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 127us (4207us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338836.607855:0:15068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:1.0:1787338836.607970:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787338836.608170:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf4705500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874160212086528:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787338836.921993:0:15652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787338837.152933:0:5861:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0bebf184-ca0d-4db5-82d4-d664d446db69 00000001:00100000:1.0:1787338837.152950:0:5861:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 4f600308-4919-499d-be82-256c83420e0e 00000040:00080000:3.0:1787338837.374369:0:14412:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:1.0:1787338837.701417:0:16342:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1787338837.942405:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787338838.967058:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787338839.158035:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787338839.158053:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbffa49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874160212086656:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787338839.158116:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338839.158178:0:15068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212086656 00000100:00100000:3.0:1787338839.158185:0:15068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212086656 00000100:00100000:3.0:1787338839.158231:0:15068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787338839.158238:0:15068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874160212086656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787338839.158267:0:15068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787338839.158300:0:15068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874160212086656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338839.158305:0:15068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1787338839.158320:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787338839.158345:0:3316:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1787338839.158364:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbffa49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874160212086656:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787338839.169308:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc4095c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c0e6575-df80-419a-8cc7-cbad06c93254:3314:1874160212086784:0@lo:400:kworker.0 00000100:00100000:0.0:1787338839.169386:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338839.169473:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212086784 00000100:00100000:0.0:1787338839.169482:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212086784 00000100:00100000:0.0:1787338839.169531:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787338839.169541:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffd21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c0e6575-df80-419a-8cc7-cbad06c93254+19:3314:x1874160212086784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787338839.170084:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffd21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c0e6575-df80-419a-8cc7-cbad06c93254+19:3314:x1874160212086784:12345-0@lo:400:kworker.0 Request processed in 542us (695us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338839.170093:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787338839.170166:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc4095c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c0e6575-df80-419a-8cc7-cbad06c93254:3314:1874160212086784:0@lo:400:kworker.0 00000100:00100000:0.0:1787338839.170214:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc4095c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874160212086912:0@lo:400:kworker.0 00000100:00100000:0.0:1787338839.170248:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338839.170284:0:15063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212086912 00000100:00100000:0.0:1787338839.170289:0:15063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212086912 00000100:00100000:0.0:1787338839.170332:0:15063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787338839.170347:0:15063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4094e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1874160212086912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787338839.170400:0:15063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4094e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1874160212086912:12345-0@lo:400:kworker.0 Request processed in 53us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338839.170407:0:15063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1787338839.170425:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787338839.170447:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc4095c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874160212086912:0@lo:400:kworker.0 00000100:00100000:0.0:1787338839.170494:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc4095c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874160212087040:0@lo:400:kworker.0 00000100:00100000:0.0:1787338839.170522:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338839.170549:0:15065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212087040 00000100:00100000:0.0:1787338839.170553:0:15065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212087040 00000100:00100000:0.0:1787338839.170577:0:15065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787338839.170597:0:15065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee083b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1874160212087040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787338839.173189:0:15065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee083b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1874160212087040:12345-0@lo:400:kworker.0 Request processed in 2594us (2655us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338839.173205:0:15065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787338839.173281:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc4095c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874160212087040:0@lo:400:kworker.0 00000100:00100000:0.0:1787338839.173345:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee082680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874160212087168:0@lo:400:kworker.0 00000100:00100000:0.0:1787338839.173382:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338839.176434:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212087168 00000100:00100000:0.0:1787338839.176451:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212087168 00000100:00100000:0.0:1787338839.176519:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787338839.176531:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee083480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874160212087168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787338839.177938:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee083480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874160212087168:12345-0@lo:400:kworker.0 Request processed in 1316us (4463us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338839.177952:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787338839.181278:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee082680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874160212087168:0@lo:400:kworker.0 00000100:00100000:0.0:1787338839.181370:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee082680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1874160212087296:0@lo:400:kworker.0 00000100:00100000:0.0:1787338839.182216:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338839.182286:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212087296 00000100:00100000:0.0:1787338839.182293:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212087296 00000100:00100000:0.0:1787338839.182353:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787338839.182363:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee080a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874160212087296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787338839.182420:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee080a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874160212087296:12345-0@lo:400:kworker.0 Request processed in 59us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338839.182428:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787338839.182476:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee082680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1874160212087296:0@lo:400:kworker.0 00000100:00100000:0.0:1787338839.182519:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee082680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1874160212087424:0@lo:400:kworker.0 00000100:00100000:0.0:1787338839.182546:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338839.182572:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212087424 00000100:00100000:0.0:1787338839.182576:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212087424 00000100:00100000:0.0:1787338839.183821:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787338839.183833:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee080380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874160212087424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787338839.183923:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee080380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874160212087424:12345-0@lo:400:kworker.0 Request processed in 92us (1374us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338839.183930:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787338839.183971:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee082680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1874160212087424:0@lo:400:kworker.0 00000100:00080000:3.0:1787338839.184966:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:1.0:1787338839.212527:0:7651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0bebf184-ca0d-4db5-82d4-d664d446db69 00000001:00100000:1.0:1787338839.758578:0:6714:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0bebf184-ca0d-4db5-82d4-d664d446db69 00000100:00100000:0.0:1787338839.877353:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338839.877396:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338839.877424:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338839.877427:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192174848 00000100:00100000:3.0:1787338839.877438:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192174848 00000100:00100000:0.0:1787338839.877442:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338839.877484:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338839.877500:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338839.877514:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 104 00000100:00100000:0.0:1787338839.877522:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338839.877525:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffd21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1770da5-776a-45c2-a341-2fca212f2072+13:2358:x1874160192174848:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:0.0:1787338839.877541:0:15063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192175104 00000100:00100000:0.0:1787338839.877544:0:15063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192175104 00000100:00100000:0.0:1787338839.877577:0:15063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192175616 00000100:00100000:0.0:1787338839.877579:0:15063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192175616 00000100:00100000:0.0:1787338839.877591:0:15063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192175232 00000100:00100000:0.0:1787338839.877593:0:15063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192175232 00000100:00100000:0.0:1787338839.877604:0:15063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192175488 00000100:00100000:3.0:1787338839.877606:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffd21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1770da5-776a-45c2-a341-2fca212f2072+13:2358:x1874160192174848:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 83us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338839.877615:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 104 00000100:00100000:0.0:1787338839.877618:0:15063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192175488 00000100:00100000:0.0:1787338839.877633:0:15063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 7 00000100:00100000:0.0:1787338839.877639:0:15063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee082680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f600308-4919-499d-be82-256c83420e0e+5:2358:x1874160192175104:12345-192.168.201.53@tcp:400:kworker.0 00000100:00080000:3.0:1787338839.877650:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787338839.877654:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787338839.877667:0:15063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee082680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f600308-4919-499d-be82-256c83420e0e+5:2358:x1874160192175104:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 28us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338839.877673:0:15063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 7 00000100:00100000:0.0:1787338839.877685:0:15063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 8 00000100:00100000:0.0:1787338839.877690:0:15063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee080700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0bebf184-ca0d-4db5-82d4-d664d446db69+5:2358:x1874160192175616:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:0.0:1787338839.877712:0:15063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee080700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0bebf184-ca0d-4db5-82d4-d664d446db69+5:2358:x1874160192175616:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 21us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338839.877717:0:15063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 8 00000100:00100000:0.0:1787338839.878042:0:15063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 9 00000100:00100000:0.0:1787338839.878050:0:15063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee082300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f600308-4919-499d-be82-256c83420e0e+5:2358:x1874160192175232:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:0.0:1787338839.878090:0:15063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee082300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f600308-4919-499d-be82-256c83420e0e+5:2358:x1874160192175232:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 40us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338839.878096:0:15063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 9 00000100:00100000:0.0:1787338839.878116:0:15063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 10 00000100:00100000:0.0:1787338839.878122:0:15063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee082a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0bebf184-ca0d-4db5-82d4-d664d446db69+5:2358:x1874160192175488:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:0.0:1787338839.878147:0:15063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee082a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0bebf184-ca0d-4db5-82d4-d664d446db69+5:2358:x1874160192175488:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 26us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338839.878154:0:15063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 10 00000100:00100000:0.0:1787338839.878172:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192175360 00000100:00100000:0.0:1787338839.878176:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192175360 00000100:00100000:0.0:1787338839.878205:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192174976 00000100:00100000:0.0:1787338839.878208:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192174976 00000100:00100000:0.0:1787338839.878223:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 20 00000100:00100000:0.0:1787338839.878229:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee081880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0bebf184-ca0d-4db5-82d4-d664d446db69+6:2358:x1874160192175360:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:0.0:1787338839.878257:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee081880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0bebf184-ca0d-4db5-82d4-d664d446db69+6:2358:x1874160192175360:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 28us (832us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338839.878264:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 20 00000100:00100000:0.0:1787338839.878276:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 21 00000100:00100000:0.0:1787338839.878282:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee083100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f600308-4919-499d-be82-256c83420e0e+6:2358:x1874160192174976:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:0.0:1787338839.878303:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee083100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f600308-4919-499d-be82-256c83420e0e+6:2358:x1874160192174976:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 22us (820us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338839.878309:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 21 00000100:00080000:3.0:1787338839.878336:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787338839.989996:0:15652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787338841.035612:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787338841.202447:0:16491:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff49cdf7f0 20000000:00000080:1.0:1787338841.202469:0:16491:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff90bac2ab2c00 uarg=0000000000000000 20000000:01000000:1.0:1787338841.202512:0:16491:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787338841.202518:0:16491:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787338841.202523:0:16491:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1787338841.208664:0:16492:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:2.0:1787338841.208921:0:16491:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1787338841.215655:0:16491:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787338841.215694:0:16491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90bbf40e2200/0x83671231080c2844 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338841.215715:0:16491:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90bbf3c53800/0x83671231080c253b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c2534 expref: 18 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338841.215723:0:16491:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90bbfbe9d600/0x83671231080c2588 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c2581 expref: 18 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338841.215730:0:16491:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90bbf7ea4a00/0x83671231080c26bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c26b5 expref: 18 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338841.215739:0:16491:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90bbffef5400/0x83671231080c27e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadaba95 expref: 12 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338841.215746:0:16491:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90bbfbe9ca00/0x83671231080c281a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabaf7 expref: 12 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338841.216346:0:16491:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90bbf40e2200/0x83671231080c2844 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338841.216393:0:16491:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90bbfbe9ca00/0x83671231080c281a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabaf7 expref: 12 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338841.216407:0:16491:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90bbfbe9ca00/0x83671231080c281a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabaf7 expref: 12 pid: 14375 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338841.216435:0:16491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc01d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16491:1874160212087552:192.168.201.53@tcp:104: 00010000:00010000:2.0:1787338841.216584:0:16491:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90bbffef5400/0x83671231080c27e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadaba95 expref: 12 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338841.216593:0:16491:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90bbffef5400/0x83671231080c27e2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadaba95 expref: 12 pid: 14375 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338841.216602:0:16491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc01c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16491:1874160212087680:192.168.201.53@tcp:104: 00010000:00010000:2.0:1787338841.216637:0:16491:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90bbf7ea4a00/0x83671231080c26bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x83671231080c26b5 expref: 18 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338841.216647:0:16491:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90bbf7ea4a00/0x83671231080c26bc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x83671231080c26b5 expref: 18 pid: 14376 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338841.216657:0:16491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc01c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16491:1874160212087808:0@lo:104: 00000100:00100000:2.0:1787338841.216702:0:16491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787338841.216745:0:16491:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90bbfbe9d600/0x83671231080c2588 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x83671231080c2581 expref: 18 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338841.216775:0:16491:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90bbfbe9d600/0x83671231080c2588 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x83671231080c2581 expref: 18 pid: 14375 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338841.216784:0:16491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc01ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16491:1874160212087936:0@lo:104: 00000100:00100000:2.0:1787338841.216809:0:16491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787338841.216832:0:16491:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90bbf3c53800/0x83671231080c253b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x83671231080c2534 expref: 18 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338841.216841:0:16491:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90bbf3c53800/0x83671231080c253b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x83671231080c2534 expref: 18 pid: 14373 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338841.216849:0:16491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc01dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16491:1874160212088064:0@lo:104: 00000100:00100000:2.0:1787338841.216896:0:16491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338841.216907:0:16491:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbf3c7f840 going to sleep for 11 seconds 00000100:00100000:3.0:1787338841.217113:0:14365:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787338841.217129:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212087808 00000100:00100000:3.0:1787338841.217135:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212087808 00000100:00100000:3.0:1787338841.217178:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212087936 00000100:00100000:3.0:1787338841.217181:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212087936 00000100:00100000:3.0:1787338841.217191:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212088064 00000100:00100000:3.0:1787338841.217193:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212088064 00000100:00100000:3.0:1787338841.217206:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787338841.217217:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc01e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2c0e6575-df80-419a-8cc7-cbad06c93254+5:16491:x1874160212087808:12345-0@lo:104: 00010000:00010000:3.0:1787338841.217232:0:14365:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9d200/0x83671231080c26b5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x83671231080c26bc expref: -99 pid: 15781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338841.217291:0:14365:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787338841.217298:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc01e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2c0e6575-df80-419a-8cc7-cbad06c93254+5:16491:x1874160212087808:12345-0@lo:104: Request processed in 83us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338841.217305:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787338841.217325:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787338841.217331:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc01f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2c0e6575-df80-419a-8cc7-cbad06c93254+4:16491:x1874160212087936:12345-0@lo:104: 00010000:00010000:3.0:1787338841.217338:0:14365:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.153@tcp lock: ffff90bbf3c52000/0x83671231080c2581 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x83671231080c2588 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338841.217385:0:14365:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787338841.217390:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc01f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2c0e6575-df80-419a-8cc7-cbad06c93254+4:16491:x1874160212087936:12345-0@lo:104: Request processed in 60us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338841.217396:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787338841.217408:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787338841.217414:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc7d8a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2c0e6575-df80-419a-8cc7-cbad06c93254+3:16491:x1874160212088064:12345-0@lo:104: 00000100:00100000:2.0:1787338841.217503:0:16491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc01c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16491:1874160212087808:0@lo:104: 00000100:00100000:2.0:1787338841.217512:0:16491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc01ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16491:1874160212087936:0@lo:104: 00010000:00010000:3.0:1787338841.217545:0:14365:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.153@tcp lock: ffff90bbf3c52400/0x83671231080c2534 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x83671231080c253b expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338841.217590:0:14365:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1787338841.217596:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc7d8a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2c0e6575-df80-419a-8cc7-cbad06c93254+3:16491:x1874160212088064:12345-0@lo:104: Request processed in 182us (723us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338841.217602:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1787338841.217646:0:14370:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787338841.217652:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9d200/0x83671231080c26b5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x83671231080c26bc expref: -99 pid: 15781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338841.217659:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbfbe9d200 already unused, calling callback (ffffffffc1b2ec20) 10000000:00010000:3.0:1787338841.217663:0:14370:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9d200/0x83671231080c26b5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x83671231080c26bc expref: -99 pid: 15781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338841.217670:0:14370:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9d200/0x83671231080c26b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x83671231080c26bc expref: -99 pid: 15781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787338841.217677:0:14370:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9d200/0x83671231080c26b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x83671231080c26bc expref: -99 pid: 15781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787338841.217683:0:14370:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787338841.217749:0:14370:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9d200/0x83671231080c26b5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c26bc expref: -99 pid: 15781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338841.217789:0:14370:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787338841.217822:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9d200/0x83671231080c26b5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c26bc expref: -99 pid: 15781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338841.217847:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9d200/0x83671231080c26b5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c26bc expref: -99 pid: 15781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338841.217859:0:14370:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787338841.217862:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.153@tcp lock: ffff90bbf3c52000/0x83671231080c2581 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x83671231080c2588 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338841.217906:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf3c52000 already unused, calling callback (ffffffffc1b2ec20) 10000000:00010000:3.0:1787338841.217910:0:14370:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.153@tcp lock: ffff90bbf3c52000/0x83671231080c2581 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x83671231080c2588 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338841.217917:0:14370:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.153@tcp lock: ffff90bbf3c52000/0x83671231080c2581 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x83671231080c2588 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787338841.217935:0:14370:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.153@tcp lock: ffff90bbf3c52000/0x83671231080c2581 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x83671231080c2588 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787338841.217940:0:14370:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787338841.217964:0:14370:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.153@tcp lock: ffff90bbf3c52000/0x83671231080c2581 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c2588 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338841.217971:0:14370:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787338841.217977:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.153@tcp lock: ffff90bbf3c52000/0x83671231080c2581 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c2588 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338841.218100:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.153@tcp lock: ffff90bbf3c52000/0x83671231080c2581 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c2588 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338841.218122:0:14370:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787338841.218125:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.153@tcp lock: ffff90bbf3c52400/0x83671231080c2534 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x83671231080c253b expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338841.218131:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf3c52400 already unused, calling callback (ffffffffc1b2ec20) 10000000:00010000:3.0:1787338841.218149:0:14370:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.153@tcp lock: ffff90bbf3c52400/0x83671231080c2534 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x83671231080c253b expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338841.218157:0:14370:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.153@tcp lock: ffff90bbf3c52400/0x83671231080c2534 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x83671231080c253b expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787338841.218163:0:14370:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.153@tcp lock: ffff90bbf3c52400/0x83671231080c2534 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x83671231080c253b expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787338841.218169:0:14370:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787338841.218184:0:14370:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.153@tcp lock: ffff90bbf3c52400/0x83671231080c2534 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c253b expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338841.218190:0:14370:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787338841.218205:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.153@tcp lock: ffff90bbf3c52400/0x83671231080c2534 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c253b expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338841.218212:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.153@tcp lock: ffff90bbf3c52400/0x83671231080c2534 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c253b expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338841.218224:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338841.218231:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338841.218233:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338841.218240:0:15652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787338841.218388:0:16491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc01dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16491:1874160212088064:0@lo:104: 00000100:00100000:1.0:1787338841.219003:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbffa4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c0e6575-df80-419a-8cc7-cbad06c93254:3317:1874160212088320:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787338841.219082:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338841.219150:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787338841.219156:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbffa49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c0e6575-df80-419a-8cc7-cbad06c93254:3317:1874160212088192:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787338841.219193:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787338841.219220:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787338841.223975:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212088320 00000100:00100000:2.0:1787338841.224021:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212088320 00010000:00010000:2.0:1787338841.224069:0:14368:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90bbfbe9d600/0x83671231080c2588 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x83671231080c2581 expref: 19 pid: 14375 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338841.224111:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212088192 00000100:00100000:2.0:1787338841.224115:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212088192 00010000:00010000:2.0:1787338841.224127:0:14368:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90bbf7ea4a00/0x83671231080c26bc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x83671231080c26b5 expref: 20 pid: 14376 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338841.224141:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787338841.224165:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf4706d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c0e6575-df80-419a-8cc7-cbad06c93254+20:3317:x1874160212088320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787338841.224180:0:14368:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787338841.224185:0:14368:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90bbfbe9d600/0x83671231080c2588 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x83671231080c2581 expref: 20 pid: 14375 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338841.224195:0:14368:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90bbfbe9d600/0x83671231080c2588 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x83671231080c2581 expref: 20 pid: 14375 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338841.224212:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90bbfbe9d600/0x83671231080c2588 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x83671231080c2581 expref: 20 pid: 14375 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338841.224229:0:14368:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787338841.224297:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf4706d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c0e6575-df80-419a-8cc7-cbad06c93254+19:3317:x1874160212088320:12345-0@lo:103:ldlm_bl.0 Request processed in 135us (5225us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338841.224304:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787338841.224320:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787338841.224326:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf4704a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c0e6575-df80-419a-8cc7-cbad06c93254+18:3317:x1874160212088192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787338841.224334:0:14368:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787338841.224338:0:14368:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90bbf7ea4a00/0x83671231080c26bc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x83671231080c26b5 expref: 18 pid: 14376 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338841.224346:0:14368:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90bbf7ea4a00/0x83671231080c26bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x83671231080c26b5 expref: 18 pid: 14376 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338841.224356:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90bbf7ea4a00/0x83671231080c26bc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x83671231080c26b5 expref: 18 pid: 14376 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338841.224364:0:14368:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787338841.224387:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf4704a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c0e6575-df80-419a-8cc7-cbad06c93254+17:3317:x1874160212088192:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (5193us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338841.224400:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787338841.224585:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbffa49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c0e6575-df80-419a-8cc7-cbad06c93254:3317:1874160212088192:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787338841.224596:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbffa4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c0e6575-df80-419a-8cc7-cbad06c93254:3317:1874160212088320:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787338841.224727:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbedcb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c0e6575-df80-419a-8cc7-cbad06c93254:3314:1874160212088448:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787338841.225216:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338841.225294:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212088448 00000100:00100000:3.0:1787338841.225299:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212088448 00010000:00010000:3.0:1787338841.225321:0:14368:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90bbf3c53800/0x83671231080c253b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x83671231080c2534 expref: 17 pid: 14373 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338841.225352:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787338841.225359:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbd1728450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c0e6575-df80-419a-8cc7-cbad06c93254+17:3314:x1874160212088448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787338841.225367:0:14368:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787338841.225371:0:14368:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90bbf3c53800/0x83671231080c253b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x83671231080c2534 expref: 17 pid: 14373 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338841.225379:0:14368:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90bbf3c53800/0x83671231080c253b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x83671231080c2534 expref: 17 pid: 14373 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338841.225390:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90bbf3c53800/0x83671231080c253b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x83671231080c2534 expref: 17 pid: 14373 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338841.225400:0:14368:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787338841.225442:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbd1728450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c0e6575-df80-419a-8cc7-cbad06c93254+16:3314:x1874160212088448:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338841.225448:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787338841.225494:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbedcb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c0e6575-df80-419a-8cc7-cbad06c93254:3314:1874160212088448:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787338841.230658:0:16491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc01d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16491:1874160212087552:192.168.201.53@tcp:104: 00000100:00100000:2.0:1787338841.230676:0:16491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc01c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16491:1874160212087680:192.168.201.53@tcp:104: 00010000:00010000:2.0:1787338841.230713:0:16491:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90bbf40e2200/0x83671231080c2844 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338841.231589:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338841.231677:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338841.245185:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192175744 00000100:00100000:0.0:1787338841.245201:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192175744 00010000:00010000:0.0:1787338841.245257:0:14367:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90bbfbe9ca00/0x83671231080c281a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabaf7 expref: 13 pid: 14375 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338841.245297:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192175872 00000100:00100000:0.0:1787338841.245315:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192175872 00010000:00010000:0.0:1787338841.245331:0:14367:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90bbffef5400/0x83671231080c27e2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadaba95 expref: 14 pid: 14375 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338841.245348:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 7 00000100:00100000:0.0:1787338841.245358:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbedcb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a1770da5-776a-45c2-a341-2fca212f2072+14:2359:x1874160192175744:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787338841.245375:0:14367:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787338841.245382:0:14367:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90bbfbe9ca00/0x83671231080c281a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabaf7 expref: 14 pid: 14375 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338841.245395:0:14367:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90bbfbe9ca00/0x83671231080c281a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabaf7 expref: 14 pid: 14375 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338841.245414:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90bbfbe9ca00/0x83671231080c281a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabaf7 expref: 14 pid: 14375 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338841.245444:0:14367:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787338841.245558:0:14366:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1787338841.245568:0:14366:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1787338841.245700:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 8 00000100:00100000:1.0:1787338841.245707:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbedcb6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a1770da5-776a-45c2-a341-2fca212f2072+13:2358:x1874160192175872:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787338841.245715:0:14366:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787338841.245736:0:14366:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90bbffef5400/0x83671231080c27e2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadaba95 expref: 13 pid: 14375 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338841.245745:0:14366:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90bbffef5400/0x83671231080c27e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadaba95 expref: 13 pid: 14375 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338841.245766:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90bbffef5400/0x83671231080c27e2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadaba95 expref: 13 pid: 14375 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338841.245779:0:14366:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90bbf40e2200/0x83671231080c2844 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338841.245787:0:14366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bbf40e2200/0x83671231080c2844 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338841.245800:0:14366:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90bbf40e2200/0x83671231080c2844 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338841.245806:0:14366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90bbf40e2200/0x83671231080c2844 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338841.245813:0:14366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90bbf40e2200/0x83671231080c2844 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338841.245827:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90bbf40e2200/0x83671231080c2844 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338841.245834:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e2200 already unused, calling callback (ffffffffc1546230) 00010000:00010000:1.0:1787338841.245838:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90bbf40e2200/0x83671231080c2844 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338841.245853:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90bbf40e2200/0x83671231080c2844 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338841.245890:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90bbf40e2200/0x83671231080c2844 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338841.245901:0:14366:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787338841.245963:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbedcb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a1770da5-776a-45c2-a341-2fca212f2072+12:2359:x1874160192175744:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 605us (14376us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338841.245971:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 7 00010000:00010000:0.0:1787338841.246129:0:16491:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90bbf40e2200/0x83671231080c2844 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338841.246138:0:16491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90bbf40e2200/0x83671231080c2844 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338841.246144:0:16491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90bbf40e2200/0x83671231080c2844 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338841.254972:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbedcb6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a1770da5-776a-45c2-a341-2fca212f2072+11:2358:x1874160192175872:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 9246us (23276us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338841.254999:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 8 00000100:00100000:0.0:1787338841.719050:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf4705180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874160212088576:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787338841.719135:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338841.719237:0:15068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212088576 00000100:00100000:3.0:1787338841.719247:0:15068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212088576 00000100:00100000:3.0:1787338841.719321:0:15068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787338841.719338:0:15068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee081500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874160212088576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787338841.719375:0:15068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787338841.719441:0:15068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee081500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874160212088576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338841.719449:0:15068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787338841.719484:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf4705180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874160212088576:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787338841.723942:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787338842.045367:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787338842.742114:0:14378:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787338842.742122:0:14378:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90bac2048000 from 10 10000000:01000000:3.0:1787338842.742128:0:14378:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787338842.742177:0:14378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bc02045800/0x83671231080c284b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338842.742189:0:14378:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.153@tcp lock: ffff90bc02045800/0x83671231080c284b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338842.742201:0:14378:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.153@tcp lock: ffff90bc02045800/0x83671231080c284b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338842.742228:0:14378:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbedcb5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c0e6575-df80-419a-8cc7-cbad06c93254:14378:1874160212088704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787338842.742306:0:14378:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338842.742484:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212088704 00000100:00100000:0.0:1787338842.742491:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212088704 00000100:00100000:0.0:1787338842.742539:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787338842.742547:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffd23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c0e6575-df80-419a-8cc7-cbad06c93254+16:14378:x1874160212088704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787338842.742559:0:14373:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787338842.742572:0:14373:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90bbffef5400/0x83671231080c2852 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x83671231080c284b expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338842.742594:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bbffef5400/0x83671231080c2852 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x83671231080c284b expref: 17 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338842.742604:0:14373:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90bbffef5400/0x83671231080c2852 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c284b expref: 17 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338842.742613:0:14373:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbffef5400, rc 0) 00000100:00100000:0.0:1787338842.742644:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffd23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c0e6575-df80-419a-8cc7-cbad06c93254+17:14378:x1874160212088704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 98us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338842.742651:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787338842.742776:0:14378:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc829bd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787338842.742814:0:14378:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbedcb5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c0e6575-df80-419a-8cc7-cbad06c93254:14378:1874160212088704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787338842.742829:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.153@tcp lock: ffff90bc02045800/0x83671231080c284b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c2852 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338842.742837:0:14378:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.153@tcp lock: ffff90bc02045800/0x83671231080c284b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x83671231080c2852 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338842.742928:0:14378:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbedcb5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c0e6575-df80-419a-8cc7-cbad06c93254:14378:1874160212088832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787338842.742978:0:14378:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338842.743029:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212088832 00000100:00100000:0.0:1787338842.743033:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212088832 00000100:00100000:0.0:1787338842.743068:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787338842.743076:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffd21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c0e6575-df80-419a-8cc7-cbad06c93254+17:14378:x1874160212088832:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787338842.743312:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffd21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c0e6575-df80-419a-8cc7-cbad06c93254+17:14378:x1874160212088832:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 237us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338842.743319:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787338842.744186:0:14378:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc829bd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787338842.744209:0:14378:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbedcb5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c0e6575-df80-419a-8cc7-cbad06c93254:14378:1874160212088832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787338842.744246:0:14378:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbedcb5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c0e6575-df80-419a-8cc7-cbad06c93254:14378:1874160212088960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787338842.744296:0:14378:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338842.744312:0:14378:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc829bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787338842.744427:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212088960 00000100:00100000:0.0:1787338842.744439:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212088960 00000100:00100000:0.0:1787338842.744525:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787338842.744534:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffd22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c0e6575-df80-419a-8cc7-cbad06c93254+17:14378:x1874160212088960:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787338842.744700:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffd22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c0e6575-df80-419a-8cc7-cbad06c93254+17:14378:x1874160212088960:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 167us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338842.744707:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787338842.744778:0:14378:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbedcb5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c0e6575-df80-419a-8cc7-cbad06c93254:14378:1874160212088960:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787338842.746262:0:16560:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1787338842.746512:0:14378:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1787338842.746532:0:14378:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787338842.746542:0:14378:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bc02045800/0x83671231080c284b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c2852 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338842.746553:0:14378:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.153@tcp lock: ffff90bc02045800/0x83671231080c284b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c2852 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787338842.746563:0:14378:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787338842.746565:0:14378:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90bbc2e86800 from 10 10000000:01000000:1.0:1787338842.746568:0:14378:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787338842.746605:0:14378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9da00/0x83671231080c2859 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338842.746613:0:14378:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9da00/0x83671231080c2859 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338842.746622:0:14378:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9da00/0x83671231080c2859 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338842.746644:0:14378:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf4705180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c0e6575-df80-419a-8cc7-cbad06c93254:14378:1874160212089088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787338842.746722:0:14378:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338842.747635:0:14378:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc32870c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787338842.748110:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212089088 00000100:00100000:2.0:1787338842.748119:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212089088 00000100:00100000:2.0:1787338842.748288:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787338842.748298:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffd20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c0e6575-df80-419a-8cc7-cbad06c93254+17:14378:x1874160212089088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787338842.748312:0:14373:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787338842.748329:0:14373:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90bbf40e3000/0x83671231080c2860 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x83671231080c2859 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338842.748367:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bbf40e3000/0x83671231080c2860 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x83671231080c2859 expref: 18 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338842.748377:0:14373:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90bbf40e3000/0x83671231080c2860 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c2859 expref: 18 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338842.748386:0:14373:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf40e3000, rc 0) 00000100:00100000:2.0:1787338842.748456:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffd20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c0e6575-df80-419a-8cc7-cbad06c93254+18:14378:x1874160212089088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 159us (1733us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338842.748463:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787338842.748727:0:14378:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf4705180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c0e6575-df80-419a-8cc7-cbad06c93254:14378:1874160212089088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787338842.748744:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9da00/0x83671231080c2859 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c2860 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338842.748752:0:14378:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9da00/0x83671231080c2859 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x83671231080c2860 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338842.748827:0:14378:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf4705180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c0e6575-df80-419a-8cc7-cbad06c93254:14378:1874160212089216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787338842.748892:0:14378:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338842.748912:0:14378:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc32870c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787338842.749350:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212089216 00000100:00100000:2.0:1787338842.749366:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212089216 00000100:00100000:2.0:1787338842.749389:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787338842.749405:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffd23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c0e6575-df80-419a-8cc7-cbad06c93254+18:14378:x1874160212089216:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787338842.749657:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffd23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c0e6575-df80-419a-8cc7-cbad06c93254+18:14378:x1874160212089216:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 261us (782us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338842.749664:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787338842.750139:0:14378:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf4705180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c0e6575-df80-419a-8cc7-cbad06c93254:14378:1874160212089216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787338842.750241:0:14378:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf4705180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c0e6575-df80-419a-8cc7-cbad06c93254:14378:1874160212089344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787338842.750291:0:14378:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338842.750324:0:14378:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc32870c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787338842.750539:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212089344 00000100:00100000:2.0:1787338842.750544:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212089344 00000100:00100000:2.0:1787338842.750564:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787338842.750571:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffd20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c0e6575-df80-419a-8cc7-cbad06c93254+18:14378:x1874160212089344:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787338842.750714:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffd20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c0e6575-df80-419a-8cc7-cbad06c93254+18:14378:x1874160212089344:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 142us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338842.750721:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787338842.751273:0:14378:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf4705180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c0e6575-df80-419a-8cc7-cbad06c93254:14378:1874160212089344:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787338842.752638:0:16561:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1787338842.754636:0:14378:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1787338842.754666:0:14378:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787338842.754678:0:14378:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9da00/0x83671231080c2859 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c2860 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338842.754690:0:14378:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9da00/0x83671231080c2859 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c2860 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787338842.754701:0:14378:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787338842.754703:0:14378:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90bbc8428000 from 10 10000000:01000000:2.0:1787338842.754706:0:14378:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787338842.754751:0:14378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbf40e3a00/0x83671231080c2867 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338842.754759:0:14378:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.153@tcp lock: ffff90bbf40e3a00/0x83671231080c2867 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338842.755443:0:14378:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.153@tcp lock: ffff90bbf40e3a00/0x83671231080c2867 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338842.755471:0:14378:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc01c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c0e6575-df80-419a-8cc7-cbad06c93254:14378:1874160212089472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787338842.755542:0:14378:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338842.755623:0:14378:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbf3c7f480 going to sleep for 11 seconds 00000100:00100000:0.0:1787338842.755669:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212089472 00000100:00100000:0.0:1787338842.755676:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212089472 00000100:00100000:0.0:1787338842.755753:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787338842.755763:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffd21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c0e6575-df80-419a-8cc7-cbad06c93254+18:14378:x1874160212089472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787338842.755775:0:14373:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787338842.755799:0:14373:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90bbffef5c00/0x83671231080c286e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x83671231080c2867 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338842.755834:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bbffef5c00/0x83671231080c286e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x83671231080c2867 expref: 19 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338842.755844:0:14373:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90bbffef5c00/0x83671231080c286e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c2867 expref: 19 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338842.755861:0:14373:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbffef5c00, rc 0) 00000100:00100000:0.0:1787338842.755929:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffd21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c0e6575-df80-419a-8cc7-cbad06c93254+19:14378:x1874160212089472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 166us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338842.755936:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787338842.756070:0:14378:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc01c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c0e6575-df80-419a-8cc7-cbad06c93254:14378:1874160212089472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787338842.756085:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.153@tcp lock: ffff90bbf40e3a00/0x83671231080c2867 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c286e expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338842.756094:0:14378:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.153@tcp lock: ffff90bbf40e3a00/0x83671231080c2867 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x83671231080c286e expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338842.756165:0:14378:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc01c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c0e6575-df80-419a-8cc7-cbad06c93254:14378:1874160212089600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787338842.756192:0:14378:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338842.757418:0:14378:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbf3c7f480 going to sleep for 11 seconds 00000100:00100000:0.0:1787338842.757653:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212089600 00000100:00100000:0.0:1787338842.757663:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212089600 00000100:00100000:0.0:1787338842.757703:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787338842.757711:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf3d77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c0e6575-df80-419a-8cc7-cbad06c93254+19:14378:x1874160212089600:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787338842.758080:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf3d77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c0e6575-df80-419a-8cc7-cbad06c93254+19:14378:x1874160212089600:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 368us (1885us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338842.758088:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787338842.758518:0:14378:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc01c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c0e6575-df80-419a-8cc7-cbad06c93254:14378:1874160212089600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787338842.758566:0:14378:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc01c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c0e6575-df80-419a-8cc7-cbad06c93254:14378:1874160212089728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787338842.758617:0:14378:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338842.758651:0:14378:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbf3c7f480 going to sleep for 11 seconds 00000100:00100000:0.0:1787338842.759295:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212089728 00000100:00100000:0.0:1787338842.759302:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212089728 00000100:00100000:0.0:1787338842.759329:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787338842.760427:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c0e6575-df80-419a-8cc7-cbad06c93254+19:14378:x1874160212089728:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787338842.760634:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c0e6575-df80-419a-8cc7-cbad06c93254+19:14378:x1874160212089728:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 216us (2017us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338842.760642:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787338842.760836:0:14378:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc01c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c0e6575-df80-419a-8cc7-cbad06c93254:14378:1874160212089728:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787338842.762774:0:16562:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1787338842.764235:0:14378:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1787338842.764259:0:14378:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787338842.764271:0:14378:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbf40e3a00/0x83671231080c2867 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c286e expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338842.764283:0:14378:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.153@tcp lock: ffff90bbf40e3a00/0x83671231080c2867 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c286e expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338842.956297:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338842.956695:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192176000 00000100:00100000:0.0:1787338842.956705:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192176000 00000100:00100000:0.0:1787338842.957290:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 114 00000100:00100000:0.0:1787338842.957302:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1770da5-776a-45c2-a341-2fca212f2072+11:13753:x1874160192176000:12345-192.168.201.53@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787338842.957319:0:14373:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787338842.957337:0:14373:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90bbffef4200/0x83671231080c2875 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x81bcb3edadabb28 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338842.957365:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bbffef4200/0x83671231080c2875 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabb28 expref: 12 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338842.957377:0:14373:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90bbffef4200/0x83671231080c2875 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabb28 expref: 12 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338842.957386:0:14373:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbffef4200, rc 0) 00000100:00100000:0.0:1787338842.957459:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1770da5-776a-45c2-a341-2fca212f2072+12:13753:x1874160192176000:12345-192.168.201.53@tcp:101:ll_cfg_requeue.0 Request processed in 160us (1170us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338842.957485:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 114 00000100:00100000:3.0:1787338842.965542:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338842.965618:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192176128 00000100:00100000:1.0:1787338842.965629:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192176128 00000100:00100000:1.0:1787338842.965716:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 115 00000100:00100000:1.0:1787338842.965728:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1770da5-776a-45c2-a341-2fca212f2072+12:13753:x1874160192176128:12345-192.168.201.53@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787338842.966028:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1770da5-776a-45c2-a341-2fca212f2072+12:13753:x1874160192176128:12345-192.168.201.53@tcp:501:ll_cfg_requeue.0 Request processed in 302us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338842.966037:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 115 00000100:00100000:3.0:1787338842.974592:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338842.974675:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192176256 00000100:00100000:1.0:1787338842.974685:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192176256 00000100:00100000:1.0:1787338842.974741:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 116 00000100:00100000:1.0:1787338842.974751:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1770da5-776a-45c2-a341-2fca212f2072+12:13753:x1874160192176256:12345-192.168.201.53@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787338842.975323:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1770da5-776a-45c2-a341-2fca212f2072+12:13753:x1874160192176256:12345-192.168.201.53@tcp:503:ll_cfg_requeue.0 Request processed in 571us (740us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338842.975332:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 116 00000100:00100000:2.0:1787338842.987724:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338842.987964:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192176384 00000100:00100000:3.0:1787338842.987974:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192176384 00000100:00100000:3.0:1787338842.988029:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 117 00000100:00100000:3.0:1787338842.988041:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1770da5-776a-45c2-a341-2fca212f2072+12:13753:x1874160192176384:12345-192.168.201.53@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787338842.988067:0:14376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787338842.988088:0:14376:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90bc02044a00/0x83671231080c287c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x81bcb3edadabb2f expref: -99 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338842.988116:0:14376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bc02044a00/0x83671231080c287c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabb2f expref: 13 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338842.988136:0:14376:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90bc02044a00/0x83671231080c287c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabb2f expref: 13 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338842.988157:0:14376:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bc02044a00, rc 0) 00000100:00100000:3.0:1787338842.988215:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1770da5-776a-45c2-a341-2fca212f2072+13:13753:x1874160192176384:12345-192.168.201.53@tcp:101:ll_cfg_requeue.0 Request processed in 176us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338842.988222:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 117 00000100:00100000:3.0:1787338842.990473:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338842.990574:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192176512 00000100:00100000:2.0:1787338842.990583:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192176512 00000100:00100000:2.0:1787338842.990622:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 118 00000100:00100000:2.0:1787338842.990631:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1770da5-776a-45c2-a341-2fca212f2072+13:13753:x1874160192176512:12345-192.168.201.53@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787338842.990924:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1770da5-776a-45c2-a341-2fca212f2072+13:13753:x1874160192176512:12345-192.168.201.53@tcp:501:ll_cfg_requeue.0 Request processed in 293us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338842.990932:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 118 00000100:00100000:3.0:1787338842.994240:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338842.994543:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192176640 00000100:00100000:0.0:1787338842.994553:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192176640 00000100:00100000:0.0:1787338842.994606:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 119 00000100:00100000:0.0:1787338842.994619:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1770da5-776a-45c2-a341-2fca212f2072+13:13753:x1874160192176640:12345-192.168.201.53@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787338842.994911:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1770da5-776a-45c2-a341-2fca212f2072+13:13753:x1874160192176640:12345-192.168.201.53@tcp:503:ll_cfg_requeue.0 Request processed in 293us (682us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338842.994919:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 119 00010000:00010000:3.0:1787338843.062597:0:15652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338844.087084:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787338844.278090:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787338844.278116:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbedcb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874160212089856:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787338844.278216:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338844.278413:0:15068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212089856 00000100:00100000:3.0:1787338844.278424:0:15068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212089856 00000100:00100000:3.0:1787338844.278502:0:15068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787338844.278515:0:15068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc01c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874160212089856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787338844.278551:0:15068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1787338844.278631:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787338844.278676:0:15068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc01c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874160212089856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 163us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338844.278685:0:15068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787338844.279931:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee080e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c0e6575-df80-419a-8cc7-cbad06c93254:3317:1874160212089984:0@lo:400:kworker.0 00000100:00100000:2.0:1787338844.279990:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338844.280014:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212089984 00000100:00100000:3.0:1787338844.280022:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212089984 00000100:00100000:3.0:1787338844.280062:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1787338844.280071:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c0e6575-df80-419a-8cc7-cbad06c93254+19:3317:x1874160212089984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787338844.290446:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee081c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874160212090240:0@lo:400:kworker.0 00000100:00100000:0.0:1787338844.290548:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338844.290594:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787338844.290600:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee080000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874160212090112:0@lo:400:kworker.0 00000100:00100000:0.0:1787338844.290627:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338844.290659:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212090240 00000100:00100000:0.0:1787338844.290666:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212090240 00000100:00100000:0.0:1787338844.290712:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787338844.290722:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee082d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874160212090240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787338844.290772:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee082d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874160212090240:12345-0@lo:400:kworker.0 Request processed in 51us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338844.290778:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787338844.290802:0:15063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212090112 00000100:00100000:0.0:1787338844.290806:0:15063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212090112 00000100:00100000:0.0:1787338844.290840:0:15063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787338844.290846:0:15063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee081180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1874160212090112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787338844.290901:0:15063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee081180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1874160212090112:12345-0@lo:400:kworker.0 Request processed in 54us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338844.290926:0:15063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787338844.290969:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee080000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874160212090112:0@lo:400:kworker.0 00000100:00100000:0.0:1787338844.290980:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee081c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874160212090240:0@lo:400:kworker.0 00000100:00080000:0.0:1787338844.291004:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787338844.291314:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee083800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874160212090368:0@lo:400:kworker.0 00000100:00100000:1.0:1787338844.291349:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338844.291390:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787338844.291397:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee081f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1874160212090496:0@lo:400:kworker.0 00000100:00100000:1.0:1787338844.291423:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338844.291450:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212090368 00000100:00100000:1.0:1787338844.291454:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212090368 00000100:00100000:1.0:1787338844.291487:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212090496 00000100:00100000:1.0:1787338844.291490:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212090496 00000100:00100000:1.0:1787338844.291522:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787338844.291529:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf4705180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874160212090368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787338844.291564:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf4705180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874160212090368:12345-0@lo:400:kworker.0 Request processed in 36us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338844.291571:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787338844.291584:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787338844.291590:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf4706d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874160212090496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787338844.291618:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf4706d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874160212090496:12345-0@lo:400:kworker.0 Request processed in 28us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338844.291635:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:1.0:1787338844.291654:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787338844.291674:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee081f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1874160212090496:0@lo:400:kworker.0 00000100:00100000:1.0:1787338844.291684:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee083800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874160212090368:0@lo:400:kworker.0 00000100:00100000:2.0:1787338844.292635:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbedcb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874160212089856:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787338844.298659:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c0e6575-df80-419a-8cc7-cbad06c93254+19:3317:x1874160212089984:12345-0@lo:400:kworker.0 Request processed in 18575us (18655us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338844.298677:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1787338844.300435:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee080e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c0e6575-df80-419a-8cc7-cbad06c93254:3317:1874160212089984:0@lo:400:kworker.0 00000100:00100000:2.0:1787338844.486608:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338844.486720:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192176768 00000100:00100000:1.0:1787338844.486732:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192176768 00000100:00100000:1.0:1787338844.486816:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 15 00000100:00100000:1.0:1787338844.486828:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc01d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f600308-4919-499d-be82-256c83420e0e+6:14411:x1874160192176768:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787338844.486852:0:14382:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787338844.486916:0:14382:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d400/0x83671231080c2883 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadabb36 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.487009:0:14382:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c288a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.487027:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c288a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.487041:0:14382:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c288a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.487058:0:14382:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9cc00/0x83671231080c2891 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.487065:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9cc00/0x83671231080c2891 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.487072:0:14382:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9cc00/0x83671231080c2891 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.487743:0:14382:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ce00/0x83671231080c2898 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.487754:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ce00/0x83671231080c2898 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.487763:0:14382:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ce00/0x83671231080c2898 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787338844.487849:0:14382:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1787338844.487853:0:14382:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1787338844.488035:0:14382:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ce00/0x83671231080c2898 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.488047:0:14382:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c288a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.488054:0:14382:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c288a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.488061:0:14382:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c288a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.488068:0:14382:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbfbe9d800 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:1.0:1787338844.488072:0:14382:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c288a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.488257:0:14382:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c288a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787338844.488424:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787338844.488493:0:14382:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90bbc9a99000) 00010000:00010000:1.0:1787338844.488504:0:14382:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787338844.488510:0:14382:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c288a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.488517:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c288a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.488533:0:14382:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9cc00/0x83671231080c2891 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.488540:0:14382:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9cc00/0x83671231080c2891 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.488545:0:14382:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9cc00/0x83671231080c2891 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.488550:0:14382:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbfbe9cc00 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:1.0:1787338844.488553:0:14382:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9cc00/0x83671231080c2891 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.488558:0:14382:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9cc00/0x83671231080c2891 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.488565:0:14382:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff90bbc2a93100) 00010000:00010000:1.0:1787338844.488568:0:14382:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787338844.488571:0:14382:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9cc00/0x83671231080c2891 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.488576:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9cc00/0x83671231080c2891 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.488614:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d400/0x83671231080c2883 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabb36 expref: 8 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.488640:0:14382:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ce00/0x83671231080c2898 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabb36 expref: 7 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.488648:0:14382:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff90bbc2a93700) 00010000:00010000:1.0:1787338844.488650:0:14382:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787338844.488652:0:14382:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbfbe9ce00, rc 0) 00000100:00100000:1.0:1787338844.488718:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc01d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f600308-4919-499d-be82-256c83420e0e+7:14411:x1874160192176768:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 Request processed in 1893us (2122us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338844.488728:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 15 00000100:00100000:0.0:1787338844.494192:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338844.495067:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192177024 00000100:00100000:1.0:1787338844.495080:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192177024 00000100:00100000:1.0:1787338844.495146:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 16 00000100:00100000:1.0:1787338844.495157:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee081c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f600308-4919-499d-be82-256c83420e0e+7:14411:x1874160192177024:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787338844.495180:0:14383:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787338844.495201:0:14383:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9dc00/0x83671231080c289f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadabb3d expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.495299:0:14383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c200/0x83671231080c28a6 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.495314:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c200/0x83671231080c28a6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.495326:0:14383:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c200/0x83671231080c28a6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.495402:0:14383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ca00/0x83671231080c28ad lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.495425:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ca00/0x83671231080c28ad lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.495432:0:14383:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ca00/0x83671231080c28ad lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.496008:0:14383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d200/0x83671231080c28b4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.496019:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d200/0x83671231080c28b4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.496027:0:14383:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d200/0x83671231080c28b4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787338844.496037:0:14383:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1787338844.496302:0:14383:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c200/0x83671231080c28a6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.496309:0:14383:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c200/0x83671231080c28a6 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.496316:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c200/0x83671231080c28a6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.496321:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbfbe9c200 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:1.0:1787338844.496325:0:14383:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c200/0x83671231080c28a6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.496332:0:14383:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c200/0x83671231080c28a6 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.496354:0:14383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff90bbc2a93700) 00010000:00010000:1.0:1787338844.496357:0:14383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787338844.496361:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c200/0x83671231080c28a6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.496379:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c200/0x83671231080c28a6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.496393:0:14383:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ca00/0x83671231080c28ad lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.496399:0:14383:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ca00/0x83671231080c28ad lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.496405:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ca00/0x83671231080c28ad lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.496410:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbfbe9ca00 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:1.0:1787338844.496413:0:14383:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ca00/0x83671231080c28ad lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.496419:0:14383:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ca00/0x83671231080c28ad lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.496426:0:14383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff90bbc2a93600) 00010000:00010000:1.0:1787338844.496428:0:14383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787338844.496431:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ca00/0x83671231080c28ad lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.496437:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ca00/0x83671231080c28ad lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.496805:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9dc00/0x83671231080c289f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabb3d expref: 10 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.496822:0:14383:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d200/0x83671231080c28b4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabb3d expref: 9 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.496830:0:14383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90bbc2a93900) 00010000:00010000:1.0:1787338844.496832:0:14383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787338844.496834:0:14383:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbfbe9d200, rc 0) 00000100:00100000:1.0:1787338844.496943:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee081c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f600308-4919-499d-be82-256c83420e0e+9:14411:x1874160192177024:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 Request processed in 1788us (2763us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1787338844.496951:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 16 00000100:00100000:3.0:1787338844.503510:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338844.504213:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192177152 00000100:00100000:1.0:1787338844.504224:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192177152 00000100:00100000:1.0:1787338844.504290:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 17 00000100:00100000:1.0:1787338844.504301:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbedcb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f600308-4919-499d-be82-256c83420e0e+9:14411:x1874160192177152:12345-192.168.201.53@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1787338844.504441:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbedcb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f600308-4919-499d-be82-256c83420e0e+9:14411:x1874160192177152:12345-192.168.201.53@tcp:59:lhsmtool_posix.0 Request processed in 141us (940us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338844.504449:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 17 00000040:00080000:0.0:1787338844.534708:0:14412:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787338844.544918:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338844.545141:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192177280 00000100:00100000:2.0:1787338844.545153:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192177280 00000100:00100000:2.0:1787338844.545216:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 18 00000100:00100000:2.0:1787338844.545226:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee44d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f600308-4919-499d-be82-256c83420e0e+9:14417:x1874160192177280:12345-192.168.201.53@tcp:101:lfs.0 00010000:00010000:2.0:1787338844.545247:0:14381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787338844.545285:0:14381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3600/0x83671231080c28c2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadabb44 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338844.545358:0:14381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c28c9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338844.545407:0:14381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c28c9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338844.545420:0:14381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c28c9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338844.545437:0:14381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3800/0x83671231080c28d0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338844.545443:0:14381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3800/0x83671231080c28d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338844.545449:0:14381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3800/0x83671231080c28d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338844.545726:0:14381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c28c9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338844.545734:0:14381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c28c9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338844.545740:0:14381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c28c9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338844.545746:0:14381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e2c00 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:2.0:1787338844.545750:0:14381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c28c9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338844.545757:0:14381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c28c9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338844.545769:0:14381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90bbc9a99000) 00010000:00010000:2.0:1787338844.545778:0:14381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787338844.545783:0:14381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c28c9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338844.545788:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c28c9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338844.545803:0:14381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3800/0x83671231080c28d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338844.545808:0:14381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3800/0x83671231080c28d0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338844.545814:0:14381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3800/0x83671231080c28d0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338844.545819:0:14381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e3800 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:2.0:1787338844.545822:0:14381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3800/0x83671231080c28d0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338844.545828:0:14381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3800/0x83671231080c28d0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338844.545835:0:14381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff90bbc8283c00) 00010000:00010000:2.0:1787338844.545837:0:14381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787338844.545840:0:14381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3800/0x83671231080c28d0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338844.545844:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3800/0x83671231080c28d0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338844.545920:0:14381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3600/0x83671231080c28c2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabb44 expref: 10 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338844.545938:0:14381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90bbc9a99000) 00010000:00010000:2.0:1787338844.545941:0:14381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787338844.545946:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3600/0x83671231080c28c2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabb44 expref: 10 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338844.545956:0:14381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf40e3600, rc 0) 00000100:00100000:2.0:1787338844.546033:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee44d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f600308-4919-499d-be82-256c83420e0e+9:14417:x1874160192177280:12345-192.168.201.53@tcp:101:lfs.0 Request processed in 807us (1167us total) trans 0 rc 301/301 00000100:00100000:2.0:1787338844.546041:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 18 00000100:00100000:3.0:1787338844.551169:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338844.557374:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192177408 00000100:00100000:0.0:1787338844.557394:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192177408 00000100:00100000:0.0:1787338844.557484:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 0 00000100:00100000:0.0:1787338844.557496:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee44d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:4f600308-4919-499d-be82-256c83420e0e+9:14417:x1874160192177408:12345-192.168.201.53@tcp:700:lfs.0 00000100:00100000:0.0:1787338844.557662:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee44d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:4f600308-4919-499d-be82-256c83420e0e+9:14417:x1874160192177408:12345-192.168.201.53@tcp:700:lfs.0 Request processed in 168us (6505us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338844.557670:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 0 00000100:00100000:3.0:1787338844.565347:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338844.565616:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192177664 00000100:00100000:0.0:1787338844.565627:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192177664 00000100:00100000:0.0:1787338844.565687:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 19 00000100:00100000:0.0:1787338844.565699:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee44c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f600308-4919-499d-be82-256c83420e0e+9:14417:x1874160192177664:12345-192.168.201.53@tcp:36:lfs.0 00010000:00010000:0.0:1787338844.565775:0:14383:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787338844.565808:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045000/0x83671231080c2805 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadababf expref: 9 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338844.565834:0:14383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90bbc9a99000) 00010000:00010000:0.0:1787338844.565840:0:14383:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787338844.566218:0:14383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5200/0x83671231080c28d7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338844.566241:0:14383:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4600/0x83671231080c283d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabb21 expref: 5 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338844.566249:0:14383:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5200/0x83671231080c28d7 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.568504:0:14383:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4600/0x83671231080c283d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabb21 expref: 5 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.569033:0:14383:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4600/0x83671231080c283d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabb21 expref: 5 pid: 14383 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338844.569072:0:14383:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee080000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14383:1874160212090624:192.168.201.53@tcp:104: 00000100:00100000:1.0:1787338844.569548:0:14383:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc2b9a180 going to sleep for 11 seconds 00000100:00100000:1.0:1787338844.582528:0:14383:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee080000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14383:1874160212090624:192.168.201.53@tcp:104: 00010000:00010000:1.0:1787338844.582560:0:14383:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5200/0x83671231080c28d7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338844.582759:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338844.582829:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192177792 00000100:00100000:0.0:1787338844.582837:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192177792 00010000:00010000:0.0:1787338844.582921:0:14367:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4600/0x83671231080c283d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabb21 expref: 6 pid: 14383 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338844.582964:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 9 00000100:00100000:0.0:1787338844.582974:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee44ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0bebf184-ca0d-4db5-82d4-d664d446db69+6:2358:x1874160192177792:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787338844.582990:0:14367:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787338844.582997:0:14367:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4600/0x83671231080c283d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabb21 expref: 6 pid: 14383 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338844.583010:0:14367:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4600/0x83671231080c283d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabb21 expref: 6 pid: 14383 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338844.583033:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4600/0x83671231080c283d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabb21 expref: 6 pid: 14383 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338844.583049:0:14367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90bbc9a99000) 00010000:00010000:0.0:1787338844.583055:0:14367:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5200/0x83671231080c28d7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338844.583081:0:14367:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5200/0x83671231080c28d7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338844.583088:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5200/0x83671231080c28d7 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338844.583108:0:14367:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787338844.583160:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee44ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0bebf184-ca0d-4db5-82d4-d664d446db69+5:2358:x1874160192177792:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 187us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338844.583168:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 9 00000100:00080000:1.0:1787338844.583458:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787338844.583471:0:14383:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5200/0x83671231080c28d7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.583479:0:14383:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5200/0x83671231080c28d7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.583502:0:14383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9dc00/0x83671231080c28de lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.583512:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9dc00/0x83671231080c28de lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.583520:0:14383:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9dc00/0x83671231080c28de lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787338844.585041:0:14383:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1787338844.585056:0:14383:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5200/0x83671231080c28d7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.585066:0:14383:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5200/0x83671231080c28d7 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.585097:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5200/0x83671231080c28d7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.585103:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbffef5200 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:1.0:1787338844.585108:0:14383:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5200/0x83671231080c28d7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.585116:0:14383:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5200/0x83671231080c28d7 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.585130:0:14383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90bbc9a99000) 00010000:00010000:1.0:1787338844.585133:0:14383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787338844.585137:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5200/0x83671231080c28d7 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.585143:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5200/0x83671231080c28d7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787338844.585163:0:14383:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008881d03c reply state 00000000ed7cb946 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9dc00/0x83671231080c28de lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338844.585173:0:14383:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787338844.585262:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee44c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f600308-4919-499d-be82-256c83420e0e+10:14417:x1874160192177664:12345-192.168.201.53@tcp:36:lfs.0 Request processed in 19562us (19925us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1787338844.585271:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 19 00010000:00010000:0.0:1787338844.590711:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9dc00/0x83671231080c28de lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338844.590731:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9dc00/0x83671231080c28de lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338844.590740:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9dc00/0x83671231080c28de lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338844.590746:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbfbe9dc00 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:0.0:1787338844.590751:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9dc00/0x83671231080c28de lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338844.590758:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9dc00/0x83671231080c28de lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338844.590775:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff90bbc2a93600) 00010000:00010000:0.0:1787338844.590778:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787338844.590783:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9dc00/0x83671231080c28de lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338844.590807:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9dc00/0x83671231080c28de lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338844.682537:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338844.682676:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192177920 00000100:00100000:1.0:1787338844.682688:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192177920 00000100:00100000:1.0:1787338844.682753:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 20 00000100:00100000:1.0:1787338844.682773:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee080000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f600308-4919-499d-be82-256c83420e0e+9:14425:x1874160192177920:12345-192.168.201.53@tcp:101:lctl.0 00010000:00010000:1.0:1787338844.682818:0:14382:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787338844.682855:0:14382:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c200/0x83671231080c28e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadabb4b expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.682964:0:14382:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d400/0x83671231080c28ec lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.682979:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d400/0x83671231080c28ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.682991:0:14382:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d400/0x83671231080c28ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787338844.683052:0:14382:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787338844.683057:0:14382:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:1.0:1787338844.683099:0:14382:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d400/0x83671231080c28ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.683138:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c200/0x83671231080c28e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabb4b expref: 11 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.683160:0:14382:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d400/0x83671231080c28ec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabb4b expref: 10 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.683169:0:14382:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90bbc2a93100) 00010000:00010000:1.0:1787338844.683172:0:14382:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787338844.683175:0:14382:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbfbe9d400, rc 0) 00000100:00100000:1.0:1787338844.683240:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee080000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f600308-4919-499d-be82-256c83420e0e+10:14425:x1874160192177920:12345-192.168.201.53@tcp:101:lctl.0 Request processed in 469us (714us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338844.683247:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 20 00000100:00100000:3.0:1787338844.721130:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338844.721451:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192178048 00000100:00100000:1.0:1787338844.721463:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192178048 00000100:00100000:1.0:1787338844.721529:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 21 00000100:00100000:1.0:1787338844.721540:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee44f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0bebf184-ca0d-4db5-82d4-d664d446db69+5:14426:x1874160192178048:12345-192.168.201.53@tcp:101:lfs.0 00010000:00010000:1.0:1787338844.721561:0:14383:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787338844.721581:0:14383:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c200/0x83671231080c28f3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadabb52 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.721646:0:14383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9cc00/0x83671231080c28fa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.721661:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9cc00/0x83671231080c28fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.721672:0:14383:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9cc00/0x83671231080c28fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787338844.721749:0:14383:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787338844.721759:0:14383:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:1.0:1787338844.721786:0:14383:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9cc00/0x83671231080c28fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.721811:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c200/0x83671231080c28f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabb52 expref: 7 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.721829:0:14383:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9cc00/0x83671231080c28fa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabb52 expref: 6 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.721837:0:14383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90bbc2a93100) 00010000:00010000:1.0:1787338844.721841:0:14383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787338844.721859:0:14383:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbfbe9cc00, rc 0) 00000100:00100000:1.0:1787338844.722047:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee44f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0bebf184-ca0d-4db5-82d4-d664d446db69+6:14426:x1874160192178048:12345-192.168.201.53@tcp:101:lfs.0 Request processed in 508us (937us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338844.722054:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 21 00000100:00100000:3.0:1787338844.726428:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338844.727088:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192178176 00000100:00100000:1.0:1787338844.727101:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192178176 00000100:00100000:1.0:1787338844.727275:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 22 00000100:00100000:1.0:1787338844.727287:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee44d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0bebf184-ca0d-4db5-82d4-d664d446db69+6:14426:x1874160192178176:12345-192.168.201.53@tcp:101:lfs.0 00010000:00010000:1.0:1787338844.727308:0:14381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787338844.727332:0:14381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c200/0x83671231080c2901 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadabb59 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.727440:0:14381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c2908 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.727456:0:14381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c2908 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.727467:0:14381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c2908 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.727481:0:14381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c290f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.727488:0:14381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c290f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.727495:0:14381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c290f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.727598:0:14381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c400/0x83671231080c2916 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.727620:0:14381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c400/0x83671231080c2916 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.727628:0:14381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c400/0x83671231080c2916 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787338844.727923:0:14381:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:1.0:1787338844.727992:0:14381:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787338844.728023:0:14381:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c400/0x83671231080c2916 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.728036:0:14381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c2908 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.728043:0:14381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c2908 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.728051:0:14381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c2908 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.728058:0:14381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbfbe9d800 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:1.0:1787338844.728062:0:14381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c2908 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.728070:0:14381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c2908 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.728083:0:14381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90bbc2a93100) 00010000:00010000:1.0:1787338844.728087:0:14381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787338844.728094:0:14381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c2908 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.728236:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c2908 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.728252:0:14381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c290f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.728258:0:14381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c290f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.728264:0:14381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c290f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.728269:0:14381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbfbe9d600 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:1.0:1787338844.728272:0:14381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c290f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.728278:0:14381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c290f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.728287:0:14381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff90bbc2a93400) 00010000:00010000:1.0:1787338844.728289:0:14381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787338844.728292:0:14381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c290f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.728298:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c290f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.728337:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c200/0x83671231080c2901 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabb59 expref: 8 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.728374:0:14381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c400/0x83671231080c2916 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabb59 expref: 7 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.728382:0:14381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90bbc2a93000) 00010000:00010000:1.0:1787338844.728385:0:14381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787338844.728387:0:14381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbfbe9c400, rc 0) 00000100:00100000:1.0:1787338844.728523:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee44d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0bebf184-ca0d-4db5-82d4-d664d446db69+7:14426:x1874160192178176:12345-192.168.201.53@tcp:101:lfs.0 Request processed in 1235us (2101us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338844.728532:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 22 00000100:00100000:3.0:1787338844.733597:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338844.733671:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192178432 00000100:00100000:1.0:1787338844.733682:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192178432 00000100:00100000:1.0:1787338844.733738:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 23 00000100:00100000:1.0:1787338844.733750:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee44e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0bebf184-ca0d-4db5-82d4-d664d446db69+7:14426:x1874160192178432:12345-192.168.201.53@tcp:101:lfs.0 00010000:00010000:1.0:1787338844.733783:0:14382:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787338844.733804:0:14382:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9dc00/0x83671231080c291d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadabb60 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787338844.733973:0:14382:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1787338844.734098:0:14382:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9dc00/0x83671231080c291d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabb60 expref: 9 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.734123:0:14382:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90bbc2a93100) 00010000:00010000:1.0:1787338844.734127:0:14382:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787338844.734133:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9dc00/0x83671231080c291d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabb60 expref: 9 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.734171:0:14382:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbfbe9dc00, rc 0) 00000100:00100000:1.0:1787338844.734767:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee44e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0bebf184-ca0d-4db5-82d4-d664d446db69+8:14426:x1874160192178432:12345-192.168.201.53@tcp:101:lfs.0 Request processed in 1018us (1178us total) trans 8589934595 rc 301/301 00000100:00100000:1.0:1787338844.734775:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 23 00000100:00100000:3.0:1787338844.738637:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338844.739917:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192178688 00000100:00100000:1.0:1787338844.740217:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192178688 00000100:00100000:1.0:1787338844.740852:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 24 00000100:00100000:1.0:1787338844.740867:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee44e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0bebf184-ca0d-4db5-82d4-d664d446db69+8:14426:x1874160192178688:12345-192.168.201.53@tcp:36:lfs.0 00010000:00010000:1.0:1787338844.741066:0:14381:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787338844.741097:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c400/0x83671231080c2916 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabb59 expref: 8 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.741347:0:14381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90bbc2a93000) 00010000:00010000:1.0:1787338844.741370:0:14381:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787338844.741399:0:14381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ca00/0x83671231080c292b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.741412:0:14381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ca00/0x83671231080c292b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.741421:0:14381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ca00/0x83671231080c292b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787338844.741641:0:14381:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d82fe209 reply state 0000000079594bf9 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ca00/0x83671231080c292b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338844.741650:0:14381:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1787338844.741679:0:14381:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:1.0:1787338844.742523:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee44e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0bebf184-ca0d-4db5-82d4-d664d446db69+9:14426:x1874160192178688:12345-192.168.201.53@tcp:36:lfs.0 Request processed in 1652us (3891us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1787338844.742532:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 24 00010000:00010000:2.0:1787338844.745482:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ca00/0x83671231080c292b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338844.745502:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ca00/0x83671231080c292b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338844.745510:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ca00/0x83671231080c292b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338844.745515:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbfbe9ca00 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:2.0:1787338844.745520:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ca00/0x83671231080c292b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338844.745527:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ca00/0x83671231080c292b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338844.745544:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90bbc2a93a00) 00010000:00010000:2.0:1787338844.745548:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1787338844.745552:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ca00/0x83671231080c292b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338844.745569:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ca00/0x83671231080c292b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338844.745956:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338844.746220:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192178944 00000100:00100000:0.0:1787338844.746230:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192178944 00000100:00100000:0.0:1787338844.746276:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 2 00000100:00100000:0.0:1787338844.746285:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee44c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0bebf184-ca0d-4db5-82d4-d664d446db69+8:14426:x1874160192178944:12345-192.168.201.53@tcp:35:lfs.0 00000100:00100000:0.0:1787338844.746571:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee44c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0bebf184-ca0d-4db5-82d4-d664d446db69+9:14426:x1874160192178944:12345-192.168.201.53@tcp:35:lfs.0 Request processed in 286us (621us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1787338844.746577:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 2 00000100:00100000:3.0:1787338844.750485:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338844.750617:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192179200 00000100:00100000:1.0:1787338844.750625:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192179200 00000100:00100000:1.0:1787338844.750686:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 25 00000100:00100000:1.0:1787338844.750696:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee44ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0bebf184-ca0d-4db5-82d4-d664d446db69+9:14426:x1874160192179200:12345-192.168.201.53@tcp:101:lfs.0 00010000:00010000:1.0:1787338844.750721:0:14382:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787338844.750738:0:14382:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c400/0x83671231080c2932 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadabb67 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.750811:0:14382:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9dc00/0x83671231080c2939 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.751177:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9dc00/0x83671231080c2939 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.751192:0:14382:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9dc00/0x83671231080c2939 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.751209:0:14382:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c200/0x83671231080c2940 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.751217:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c200/0x83671231080c2940 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.751223:0:14382:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c200/0x83671231080c2940 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787338844.751348:0:14382:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1787338844.751487:0:14382:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9dc00/0x83671231080c2939 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.751494:0:14382:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9dc00/0x83671231080c2939 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.751500:0:14382:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9dc00/0x83671231080c2939 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.751506:0:14382:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbfbe9dc00 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:1.0:1787338844.751510:0:14382:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9dc00/0x83671231080c2939 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.751518:0:14382:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9dc00/0x83671231080c2939 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.751531:0:14382:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90bbc2a93100) 00010000:00010000:1.0:1787338844.751534:0:14382:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787338844.751539:0:14382:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9dc00/0x83671231080c2939 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.751544:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9dc00/0x83671231080c2939 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.751553:0:14382:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c200/0x83671231080c2940 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.751556:0:14382:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c200/0x83671231080c2940 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.751560:0:14382:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c200/0x83671231080c2940 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.751571:0:14382:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbfbe9c200 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:1.0:1787338844.751573:0:14382:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c200/0x83671231080c2940 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.751576:0:14382:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c200/0x83671231080c2940 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.751581:0:14382:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff90bbc2a93000) 00010000:00010000:1.0:1787338844.751583:0:14382:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787338844.751584:0:14382:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c200/0x83671231080c2940 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.751588:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c200/0x83671231080c2940 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.751619:0:14382:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c400/0x83671231080c2932 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabb67 expref: 11 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.751626:0:14382:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90bbc2a93100) 00010000:00010000:1.0:1787338844.751627:0:14382:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787338844.751629:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c400/0x83671231080c2932 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabb67 expref: 11 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.751635:0:14382:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbfbe9c400, rc 0) 00000100:00100000:1.0:1787338844.751709:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee44ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0bebf184-ca0d-4db5-82d4-d664d446db69+10:14426:x1874160192179200:12345-192.168.201.53@tcp:101:lfs.0 Request processed in 1013us (1234us total) trans 8589934598 rc 301/301 00000100:00100000:1.0:1787338844.751714:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 25 00000100:00100000:2.0:1787338844.754675:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338844.754795:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192179328 00000100:00100000:1.0:1787338844.754818:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192179328 00000100:00100000:1.0:1787338844.754899:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 26 00000100:00100000:1.0:1787338844.754925:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc01dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0bebf184-ca0d-4db5-82d4-d664d446db69+10:14426:x1874160192179328:12345-192.168.201.53@tcp:101:lfs.0 00010000:00010000:1.0:1787338844.755181:0:14381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787338844.755376:0:14381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c294e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadabb6e expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.755478:0:14381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c2955 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.755489:0:14381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c2955 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.755497:0:14381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c2955 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787338844.755539:0:14381:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:1.0:1787338844.755541:0:14381:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787338844.755558:0:14381:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c2955 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.755578:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c294e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabb6e expref: 12 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.755591:0:14381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c2955 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabb6e expref: 11 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.755597:0:14381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90bbc2a93400) 00010000:00010000:1.0:1787338844.755599:0:14381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787338844.755602:0:14381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbfbe9d800, rc 0) 00000100:00100000:1.0:1787338844.755674:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc01dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0bebf184-ca0d-4db5-82d4-d664d446db69+11:14426:x1874160192179328:12345-192.168.201.53@tcp:101:lfs.0 Request processed in 756us (1011us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338844.755681:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 26 00000100:00100000:3.0:1787338844.760053:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338844.760174:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192179456 00000100:00100000:0.0:1787338844.760184:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192179456 00000100:00100000:0.0:1787338844.760260:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 3 00000100:00100000:0.0:1787338844.760271:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee44ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0bebf184-ca0d-4db5-82d4-d664d446db69+11:14426:x1874160192179456:12345-192.168.201.53@tcp:37:lfs.0 00000100:00100000:2.0:1787338844.766486:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee44ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0bebf184-ca0d-4db5-82d4-d664d446db69+11:14426:x1874160192179456:12345-192.168.201.53@tcp:37:lfs.0 Request processed in 6203us (6428us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338844.766502:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 3 00000100:00100000:2.0:1787338844.773225:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338844.773348:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192179712 00000100:00100000:3.0:1787338844.773371:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192179712 00000100:00100000:3.0:1787338844.773435:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 4 00000100:00100000:3.0:1787338844.773447:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbff8f1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0bebf184-ca0d-4db5-82d4-d664d446db69+11:14426:x1874160192179712:12345-192.168.201.53@tcp:35:lfs.0 00000100:00100000:3.0:1787338844.773788:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbff8f1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0bebf184-ca0d-4db5-82d4-d664d446db69+12:14426:x1874160192179712:12345-192.168.201.53@tcp:35:lfs.0 Request processed in 342us (572us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1787338844.773796:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 4 00000100:00100000:2.0:1787338844.830602:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338844.830844:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192179840 00000100:00100000:0.0:1787338844.830856:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192179840 00000100:00100000:0.0:1787338844.831123:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 27 00000100:00100000:0.0:1787338844.831132:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc01ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f600308-4919-499d-be82-256c83420e0e+10:14432:x1874160192179840:12345-192.168.201.53@tcp:101:bash.0 00010000:00010000:0.0:1787338844.831150:0:14382:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787338844.831171:0:14382:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5a00/0x83671231080c295c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadabb75 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338844.831307:0:14382:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4600/0x83671231080c2963 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338844.831341:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4600/0x83671231080c2963 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338844.831353:0:14382:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4600/0x83671231080c2963 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338844.831383:0:14382:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5200/0x83671231080c296a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338844.831390:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5200/0x83671231080c296a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338844.831396:0:14382:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5200/0x83671231080c296a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338844.831528:0:14382:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4400/0x83671231080c2971 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338844.831537:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4400/0x83671231080c2971 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338844.831545:0:14382:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4400/0x83671231080c2971 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787338844.831578:0:14382:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1787338844.831582:0:14382:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787338844.831626:0:14382:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4400/0x83671231080c2971 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338844.831639:0:14382:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4600/0x83671231080c2963 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338844.831779:0:14382:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4600/0x83671231080c2963 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338844.831786:0:14382:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4600/0x83671231080c2963 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338844.831791:0:14382:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbffef4600 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:0.0:1787338844.831796:0:14382:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4600/0x83671231080c2963 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338844.831803:0:14382:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4600/0x83671231080c2963 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338844.831814:0:14382:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90bbc2a93100) 00010000:00010000:0.0:1787338844.831826:0:14382:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787338844.831831:0:14382:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4600/0x83671231080c2963 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338844.831837:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4600/0x83671231080c2963 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338844.831853:0:14382:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5200/0x83671231080c296a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338844.831858:0:14382:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5200/0x83671231080c296a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338844.831864:0:14382:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5200/0x83671231080c296a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338844.831869:0:14382:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbffef5200 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:0.0:1787338844.831906:0:14382:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5200/0x83671231080c296a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338844.831913:0:14382:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5200/0x83671231080c296a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338844.831921:0:14382:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff90bbeb14d100) 00010000:00010000:0.0:1787338844.831924:0:14382:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787338844.831927:0:14382:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5200/0x83671231080c296a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338844.831933:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5200/0x83671231080c296a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338844.831982:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5a00/0x83671231080c295c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabb75 expref: 12 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338844.831997:0:14382:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4400/0x83671231080c2971 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabb75 expref: 11 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338844.832003:0:14382:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90bbc2a93400) 00010000:00010000:0.0:1787338844.832005:0:14382:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787338844.832008:0:14382:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbffef4400, rc 0) 00000100:00100000:0.0:1787338844.832093:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc01ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f600308-4919-499d-be82-256c83420e0e+11:14432:x1874160192179840:12345-192.168.201.53@tcp:101:bash.0 Request processed in 961us (1501us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338844.832101:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 27 00000100:00100000:0.0:1787338844.835983:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338844.836056:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192180096 00000100:00100000:1.0:1787338844.836068:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192180096 00000100:00100000:1.0:1787338844.836127:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 28 00000100:00100000:1.0:1787338844.836138:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee080e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f600308-4919-499d-be82-256c83420e0e+11:14432:x1874160192180096:12345-192.168.201.53@tcp:101:bash.0 00010000:00010000:1.0:1787338844.836164:0:14381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787338844.836187:0:14381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c2978 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadabb7c expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.836434:0:14381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c400/0x83671231080c297f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.836450:0:14381:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c2955 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabb6e expref: 11 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.836459:0:14381:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c400/0x83671231080c297f lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.836499:0:14381:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c2955 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabb6e expref: 11 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.836512:0:14381:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c2955 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabb6e expref: 11 pid: 14381 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338844.836527:0:14381:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf4704a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14381:1874160212090752:192.168.201.53@tcp:104: 00000100:00100000:1.0:1787338844.836620:0:14381:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc674c840 going to sleep for 11 seconds 00000100:00100000:1.0:1787338844.840493:0:14381:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf4704a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14381:1874160212090752:192.168.201.53@tcp:104: 00010000:00010000:1.0:1787338844.840525:0:14381:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c400/0x83671231080c297f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338844.840782:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338844.841124:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192180224 00000100:00100000:2.0:1787338844.841132:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192180224 00010000:00010000:2.0:1787338844.841170:0:14368:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c2955 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabb6e expref: 12 pid: 14381 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338844.841206:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 10 00000100:00100000:2.0:1787338844.841217:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee083800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0bebf184-ca0d-4db5-82d4-d664d446db69+12:2358:x1874160192180224:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787338844.841236:0:14368:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787338844.841245:0:14368:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c2955 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabb6e expref: 12 pid: 14381 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338844.841258:0:14368:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c2955 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabb6e expref: 12 pid: 14381 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338844.841284:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c2955 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabb6e expref: 12 pid: 14381 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338844.841411:0:14368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90bbc2a93400) 00010000:00010000:2.0:1787338844.841429:0:14368:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c400/0x83671231080c297f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338844.841439:0:14368:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c400/0x83671231080c297f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338844.841447:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c400/0x83671231080c297f lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338844.841481:0:14368:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787338844.841590:0:14381:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c400/0x83671231080c297f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338844.841598:0:14381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c400/0x83671231080c297f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338844.841622:0:14381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045400/0x83671231080c2986 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338844.841632:0:14381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045400/0x83671231080c2986 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338844.841652:0:14381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045400/0x83671231080c2986 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338844.842544:0:14381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02044e00/0x83671231080c298d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338844.842555:0:14381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02044e00/0x83671231080c298d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338844.842562:0:14381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02044e00/0x83671231080c298d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787338844.842574:0:14381:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1787338844.842603:0:14381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c400/0x83671231080c297f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338844.842610:0:14381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c400/0x83671231080c297f lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338844.842617:0:14381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c400/0x83671231080c297f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338844.842623:0:14381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbfbe9c400 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:3.0:1787338844.842627:0:14381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c400/0x83671231080c297f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338844.842636:0:14381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c400/0x83671231080c297f lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338844.842646:0:14381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90bbc2a93400) 00010000:00010000:3.0:1787338844.842649:0:14381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787338844.842660:0:14381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c400/0x83671231080c297f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338844.842667:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c400/0x83671231080c297f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787338844.842680:0:14381:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000074e8ea22 reply state 000000006810ecb2 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045400/0x83671231080c2986 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338844.842688:0:14381:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787338844.842722:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c2978 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabb7c expref: 14 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338844.842737:0:14381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02044e00/0x83671231080c298d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabb7c expref: 13 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338844.842744:0:14381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90bbc9a99d00) 00010000:00010000:3.0:1787338844.842747:0:14381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1787338844.842749:0:14381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bc02044e00, rc 0) 00000100:00100000:2.0:1787338844.843446:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee083800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0bebf184-ca0d-4db5-82d4-d664d446db69+11:2358:x1874160192180224:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 2227us (2662us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338844.843458:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 10 00000100:00100000:3.0:1787338844.843517:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee080e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f600308-4919-499d-be82-256c83420e0e+14:14432:x1874160192180096:12345-192.168.201.53@tcp:101:bash.0 Request processed in 7380us (7546us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1787338844.843525:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 28 00010000:00010000:0.0:1787338844.852561:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045400/0x83671231080c2986 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338844.852601:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045400/0x83671231080c2986 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338844.852610:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045400/0x83671231080c2986 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338844.852616:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bc02045400 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:0.0:1787338844.852621:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045400/0x83671231080c2986 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338844.852629:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045400/0x83671231080c2986 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338844.852647:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff90bbc9a99800) 00010000:00010000:0.0:1787338844.852651:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787338844.852656:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045400/0x83671231080c2986 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338844.852662:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045400/0x83671231080c2986 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338844.869842:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338844.870037:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192180352 00000100:00100000:1.0:1787338844.870048:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192180352 00000100:00100000:1.0:1787338844.870107:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 29 00000100:00100000:1.0:1787338844.870116:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee081f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f600308-4919-499d-be82-256c83420e0e+13:14432:x1874160192180352:12345-192.168.201.53@tcp:101:bash.0 00010000:00010000:1.0:1787338844.870139:0:14382:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787338844.870158:0:14382:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c200/0x83671231080c299b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadabb83 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.870242:0:14382:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9dc00/0x83671231080c29a2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.870255:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9dc00/0x83671231080c29a2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.870266:0:14382:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9dc00/0x83671231080c29a2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787338844.870307:0:14382:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1787338844.870311:0:14382:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787338844.870328:0:14382:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9dc00/0x83671231080c29a2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.870336:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9dc00/0x83671231080c29a2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.870354:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c200/0x83671231080c299b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabb83 expref: 15 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.870535:0:14382:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9dc00/0x83671231080c29a2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabb83 expref: 14 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.870544:0:14382:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90bbc9a99d00) 00010000:00010000:1.0:1787338844.870547:0:14382:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787338844.870550:0:14382:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbfbe9dc00, rc 0) 00000100:00100000:1.0:1787338844.870615:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee081f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f600308-4919-499d-be82-256c83420e0e+14:14432:x1874160192180352:12345-192.168.201.53@tcp:101:bash.0 Request processed in 500us (782us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338844.870622:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 29 00000100:00100000:3.0:1787338844.874271:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338844.874453:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192180608 00000100:00100000:1.0:1787338844.874465:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192180608 00000100:00100000:1.0:1787338844.874542:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 5 00000100:00100000:1.0:1787338844.874553:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee44c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f600308-4919-499d-be82-256c83420e0e+14:14432:x1874160192180608:12345-192.168.201.53@tcp:35:bash.0 00000100:00100000:1.0:1787338844.874974:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee44c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f600308-4919-499d-be82-256c83420e0e+15:14432:x1874160192180608:12345-192.168.201.53@tcp:35:bash.0 Request processed in 422us (711us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1787338844.874983:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 5 00000100:00100000:2.0:1787338844.933651:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338844.933781:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192180864 00000100:00100000:3.0:1787338844.933794:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192180864 00000100:00100000:3.0:1787338844.933865:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 30 00000100:00100000:3.0:1787338844.933927:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc01c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f600308-4919-499d-be82-256c83420e0e+15:14442:x1874160192180864:12345-192.168.201.53@tcp:101:lfs.0 00010000:00010000:3.0:1787338844.933968:0:14381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787338844.933995:0:14381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045e00/0x83671231080c29a9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadabb8a expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787338844.934323:0:14381:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1787338844.934471:0:14381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045e00/0x83671231080c29a9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabb8a expref: 17 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338844.934486:0:14381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90bbc2a93100) 00010000:00010000:3.0:1787338844.934490:0:14381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787338844.934495:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045e00/0x83671231080c29a9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabb8a expref: 17 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338844.934513:0:14381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bc02045e00, rc 0) 00000100:00100000:3.0:1787338844.934675:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc01c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f600308-4919-499d-be82-256c83420e0e+16:14442:x1874160192180864:12345-192.168.201.53@tcp:101:lfs.0 Request processed in 800us (1034us total) trans 8589934602 rc 301/301 00000100:00100000:3.0:1787338844.934682:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 30 00000100:00100000:0.0:1787338844.939008:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338844.939217:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192181120 00000100:00100000:2.0:1787338844.939228:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192181120 00000100:00100000:2.0:1787338844.939287:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 6 00000100:00100000:2.0:1787338844.939295:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4095880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f600308-4919-499d-be82-256c83420e0e+16:14442:x1874160192181120:12345-192.168.201.53@tcp:35:lfs.0 00000100:00100000:2.0:1787338844.939619:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4095880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f600308-4919-499d-be82-256c83420e0e+17:14442:x1874160192181120:12345-192.168.201.53@tcp:35:lfs.0 Request processed in 321us (619us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1787338844.939627:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 6 00000100:00100000:0.0:1787338844.971597:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338844.971827:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192181376 00000100:00100000:1.0:1787338844.971840:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192181376 00000100:00100000:1.0:1787338844.971938:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 31 00000100:00100000:1.0:1787338844.971951:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4094700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f600308-4919-499d-be82-256c83420e0e+17:14445:x1874160192181376:12345-192.168.201.53@tcp:101:lfs.0 00010000:00010000:1.0:1787338844.971976:0:14382:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787338844.971997:0:14382:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c200/0x83671231080c29b7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadabb91 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.972118:0:14382:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c29be lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.972144:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c29be lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.972153:0:14382:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c29be lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787338844.972164:0:14382:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787338844.972294:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c200/0x83671231080c29b7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabb91 expref: 20 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.972309:0:14382:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c29be lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabb91 expref: 19 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338844.972315:0:14382:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90bbc9a99d00) 00010000:00010000:1.0:1787338844.972317:0:14382:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787338844.972319:0:14382:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbfbe9d600, rc 0) 00000100:00100000:1.0:1787338844.972390:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4094700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f600308-4919-499d-be82-256c83420e0e+19:14445:x1874160192181376:12345-192.168.201.53@tcp:101:lfs.0 Request processed in 442us (805us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1787338844.972395:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 31 00000100:00100000:0.0:1787338844.974855:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338844.975076:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192181504 00000100:00100000:3.0:1787338844.975089:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192181504 00000100:00100000:3.0:1787338844.975226:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 32 00000100:00100000:3.0:1787338844.975237:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4096300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f600308-4919-499d-be82-256c83420e0e+19:14445:x1874160192181504:12345-192.168.201.53@tcp:54:lfs.0 00010000:00010000:3.0:1787338844.975306:0:14381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045e00/0x83671231080c29cc lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338844.975321:0:14381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045e00/0x83671231080c29cc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338844.975329:0:14381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045e00/0x83671231080c29cc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338844.975354:0:14381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045e00/0x83671231080c29cc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338844.975382:0:14381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045e00/0x83671231080c29cc lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338844.975387:0:14381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045e00/0x83671231080c29cc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338844.975392:0:14381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bc02045e00 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:3.0:1787338844.975395:0:14381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045e00/0x83671231080c29cc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338844.975401:0:14381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045e00/0x83671231080c29cc lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338844.975411:0:14381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90bbc9a99d00) 00010000:00010000:3.0:1787338844.975413:0:14381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787338844.975416:0:14381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045e00/0x83671231080c29cc lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338844.975420:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045e00/0x83671231080c29cc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338844.975564:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4096300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f600308-4919-499d-be82-256c83420e0e+19:14445:x1874160192181504:12345-192.168.201.53@tcp:54:lfs.0 Request processed in 328us (717us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338844.975573:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 32 00000100:00100000:0.0:1787338845.003166:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338845.003228:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338845.003659:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192181632 00000100:00100000:3.0:1787338845.003670:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192181632 00000100:00100000:3.0:1787338845.003738:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 121 00000100:00100000:3.0:1787338845.003763:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee098850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1770da5-776a-45c2-a341-2fca212f2072+13:2359:x1874160192181632:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:3.0:1787338845.004305:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee098850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1770da5-776a-45c2-a341-2fca212f2072+13:2359:x1874160192181632:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 489us (1084us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338845.004327:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 121 00000100:00100000:1.0:1787338845.005141:0:15065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192181888 00000100:00100000:1.0:1787338845.005151:0:15065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192181888 00000100:00100000:1.0:1787338845.005224:0:15065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 12 00000100:00100000:1.0:1787338845.005235:0:15065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4095c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f600308-4919-499d-be82-256c83420e0e+5:2359:x1874160192181888:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:1.0:1787338845.005311:0:15065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4095c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f600308-4919-499d-be82-256c83420e0e+5:2359:x1874160192181888:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 80us (2082us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338845.005318:0:15065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 12 00000100:00080000:3.0:1787338845.006638:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787338845.016098:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338845.016146:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338845.016191:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338845.017332:0:15065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192182144 00000100:00100000:3.0:1787338845.017347:0:15065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192182144 00000100:00100000:3.0:1787338845.017435:0:15065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192181760 00000100:00100000:3.0:1787338845.017439:0:15065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192181760 00000100:00100000:3.0:1787338845.017456:0:15065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192182016 00000100:00100000:3.0:1787338845.017459:0:15065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192182016 00000100:00100000:3.0:1787338845.017479:0:15065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 13 00000100:00100000:3.0:1787338845.017488:0:15065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf7eac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0bebf184-ca0d-4db5-82d4-d664d446db69+5:2359:x1874160192182144:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:3.0:1787338845.017567:0:15065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf7eac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0bebf184-ca0d-4db5-82d4-d664d446db69+5:2359:x1874160192182144:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 80us (1722us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338845.017576:0:15065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 13 00000100:00100000:3.0:1787338845.017592:0:15065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 14 00000100:00100000:3.0:1787338845.017599:0:15065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf7eae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f600308-4919-499d-be82-256c83420e0e+5:2358:x1874160192181760:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:3.0:1787338845.017624:0:15065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf7eae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f600308-4919-499d-be82-256c83420e0e+5:2358:x1874160192181760:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 26us (1478us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338845.017630:0:15065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 14 00000100:00100000:3.0:1787338845.017641:0:15065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 15 00000100:00080000:0.0:1787338845.018064:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787338845.018069:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787338845.018249:0:15065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf7eaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0bebf184-ca0d-4db5-82d4-d664d446db69+5:2358:x1874160192182016:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:3.0:1787338845.018284:0:15065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf7eaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0bebf184-ca0d-4db5-82d4-d664d446db69+5:2358:x1874160192182016:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 50us (2092us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338845.019443:0:15065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 15 00010000:00010000:3.0:1787338845.110031:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787338845.310959:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338845.311331:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192182400 00000100:00100000:0.0:1787338845.311340:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192182400 00000100:00100000:0.0:1787338845.311464:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 33 00000100:00100000:0.0:1787338845.311476:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc01df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f600308-4919-499d-be82-256c83420e0e+19:14482:x1874160192182400:12345-192.168.201.53@tcp:101:dd.0 00010000:00010000:0.0:1787338845.311498:0:14383:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787338845.311522:0:14383:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5a00/0x83671231080c29d3 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadabb98 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338845.311630:0:14383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5200/0x83671231080c29da lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338845.311659:0:14383:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02044e00/0x83671231080c298d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabb7c expref: 20 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338845.311668:0:14383:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9dc00/0x83671231080c29a2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabb83 expref: 20 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338845.311677:0:14383:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5200/0x83671231080c29da lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338845.311715:0:14383:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9dc00/0x83671231080c29a2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabb83 expref: 20 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338845.311729:0:14383:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9dc00/0x83671231080c29a2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabb83 expref: 20 pid: 14382 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338845.311774:0:14383:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf7eaed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14383:1874160212090880:192.168.201.53@tcp:104: 00010000:00010000:0.0:1787338845.312138:0:14383:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02044e00/0x83671231080c298d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabb7c expref: 20 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338845.312148:0:14383:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02044e00/0x83671231080c298d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabb7c expref: 20 pid: 14381 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338845.312159:0:14383:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf7ead180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14383:1874160212091008:192.168.201.53@tcp:104: 00000100:00100000:0.0:1787338845.312184:0:14383:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc2b9a180 going to sleep for 11 seconds 00000100:00100000:2.0:1787338845.318197:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338845.318468:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192182528 00000100:00100000:3.0:1787338845.318491:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192182528 00010000:00010000:3.0:1787338845.318537:0:14367:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9dc00/0x83671231080c29a2 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabb83 expref: 21 pid: 14382 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338845.318586:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 11 00000100:00100000:3.0:1787338845.318596:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc01d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f600308-4919-499d-be82-256c83420e0e+21:2358:x1874160192182528:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787338845.318612:0:14367:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787338845.318618:0:14367:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9dc00/0x83671231080c29a2 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabb83 expref: 21 pid: 14382 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338845.318632:0:14367:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9dc00/0x83671231080c29a2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabb83 expref: 21 pid: 14382 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338845.318659:0:14367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90bbc9a99d00) 00010000:00010000:3.0:1787338845.318664:0:14367:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5200/0x83671231080c29da lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338845.318673:0:14367:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5200/0x83671231080c29da lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338845.318680:0:14367:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787338845.318735:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc01d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f600308-4919-499d-be82-256c83420e0e+21:2358:x1874160192182528:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 140us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338845.318742:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 11 00000100:00100000:3.0:1787338845.318802:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338845.318914:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192182656 00000100:00100000:3.0:1787338845.318924:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192182656 00010000:00010000:0.0:1787338845.320940:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9dc00/0x83671231080c29a2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabb83 expref: 21 pid: 14382 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338845.320969:0:14383:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf7eaed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14383:1874160212090880:192.168.201.53@tcp:104: 00000100:00100000:0.0:1787338845.320985:0:14383:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf7ead180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14383:1874160212091008:192.168.201.53@tcp:104: 00010000:00010000:0.0:1787338845.321012:0:14383:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5200/0x83671231080c29da lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338845.321036:0:14366:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02044e00/0x83671231080c298d lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabb7c expref: 21 pid: 14381 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338845.321157:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 12 00000100:00100000:2.0:1787338845.321173:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee44ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f600308-4919-499d-be82-256c83420e0e+20:2358:x1874160192182656:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787338845.321192:0:14368:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787338845.321204:0:14368:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02044e00/0x83671231080c298d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabb7c expref: 20 pid: 14381 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338845.321228:0:14368:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02044e00/0x83671231080c298d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabb7c expref: 20 pid: 14381 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338845.321251:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02044e00/0x83671231080c298d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabb7c expref: 20 pid: 14381 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338845.321266:0:14368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90bbc9a99d00) 00010000:00010000:2.0:1787338845.321271:0:14368:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5200/0x83671231080c29da lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338845.321280:0:14368:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5200/0x83671231080c29da lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338845.321288:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5200/0x83671231080c29da lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338845.321315:0:14368:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787338845.321396:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee44ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f600308-4919-499d-be82-256c83420e0e+19:2358:x1874160192182656:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 228us (2592us total) trans 0 rc 0/0 00010000:00010000:0.0:1787338845.321399:0:14383:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5200/0x83671231080c29da lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338845.321404:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 12 00010000:00010000:0.0:1787338845.321405:0:14383:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5200/0x83671231080c29da lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787338845.321424:0:14383:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787338845.321623:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5a00/0x83671231080c29d3 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabb98 expref: 20 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338845.321649:0:14383:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5200/0x83671231080c29da lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabb98 expref: 19 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338845.321657:0:14383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90bbc9a99d00) 00010000:00010000:0.0:1787338845.321659:0:14383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787338845.321662:0:14383:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbffef5200, rc 0) 00000100:00100000:0.0:1787338845.321700:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc01df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f600308-4919-499d-be82-256c83420e0e+19:14482:x1874160192182400:12345-192.168.201.53@tcp:101:dd.0 Request processed in 10226us (10755us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1787338845.321707:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 33 00000100:00100000:2.0:1787338845.323896:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338845.323985:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192182912 00000100:00100000:3.0:1787338845.323997:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192182912 00000100:00100000:3.0:1787338845.324114:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 34 00000100:00100000:3.0:1787338845.324127:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc01e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f600308-4919-499d-be82-256c83420e0e+19:14482:x1874160192182912:12345-192.168.201.53@tcp:36:dd.0 00010000:00010000:3.0:1787338845.324455:0:14381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045000/0x83671231080c29e8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338845.324475:0:14381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045000/0x83671231080c29e8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338845.324486:0:14381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045000/0x83671231080c29e8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787338845.324539:0:14381:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934606 00000004:00010000:3.0:1787338845.324578:0:14381:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a1e6a3d2 reply state 00000000e430aa3d transno 8589934607 ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045000/0x83671231080c29e8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338845.324586:0:14381:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787338845.324681:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc01e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f600308-4919-499d-be82-256c83420e0e+22:14482:x1874160192182912:12345-192.168.201.53@tcp:36:dd.0 Request processed in 556us (870us total) trans 8589934607 rc 0/0 00000100:00100000:3.0:1787338845.324688:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 34 00000020:00080000:3.0:1787338845.324693:0:14381:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787338845.329099:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045000/0x83671231080c29e8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338845.329118:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045000/0x83671231080c29e8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338845.329126:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045000/0x83671231080c29e8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338845.329158:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bc02045000 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:2.0:1787338845.329164:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045000/0x83671231080c29e8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338845.329171:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045000/0x83671231080c29e8 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338845.329191:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90bbc9a99d00) 00010000:00010000:2.0:1787338845.329194:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787338845.329199:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045000/0x83671231080c29e8 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338845.329206:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045000/0x83671231080c29e8 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338845.543071:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338845.543174:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192183040 00000100:00100000:0.0:1787338845.543258:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192183040 00000100:00100000:0.0:1787338845.543334:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 35 00000100:00100000:0.0:1787338845.543359:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc01f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f600308-4919-499d-be82-256c83420e0e+21:14496:x1874160192183040:12345-192.168.201.53@tcp:101:stat.0 00010000:00010000:0.0:1787338845.543390:0:14383:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787338845.543417:0:14383:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5a00/0x83671231080c29ef lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadabb9f expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338845.543509:0:14383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4600/0x83671231080c29f6 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338845.543520:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4600/0x83671231080c29f6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338845.543528:0:14383:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4600/0x83671231080c29f6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338845.543540:0:14383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030c00/0x83671231080c29fd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338845.543560:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030c00/0x83671231080c29fd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338845.543565:0:14383:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030c00/0x83671231080c29fd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338845.543667:0:14383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030200/0x83671231080c2a04 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338845.543680:0:14383:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5200/0x83671231080c29da lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabb98 expref: 22 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338845.543688:0:14383:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030200/0x83671231080c2a04 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338845.543728:0:14383:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5200/0x83671231080c29da lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabb98 expref: 22 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338845.543741:0:14383:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5200/0x83671231080c29da lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabb98 expref: 22 pid: 14383 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338845.543754:0:14383:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf7ead180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14383:1874160212091136:192.168.201.53@tcp:104: 00000100:00100000:0.0:1787338845.543902:0:14383:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbd07dda80 going to sleep for 11 seconds 00000100:00100000:3.0:1787338845.547507:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338845.547568:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192183296 00000100:00100000:1.0:1787338845.547583:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192183296 00000100:00100000:1.0:1787338845.547686:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 7 00000100:00100000:1.0:1787338845.547696:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee44f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f600308-4919-499d-be82-256c83420e0e+23:13749:x1874160192183296:12345-192.168.201.53@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787338845.547724:0:14383:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf7ead180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14383:1874160212091136:192.168.201.53@tcp:104: 00010000:00010000:0.0:1787338845.547749:0:14383:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030200/0x83671231080c2a04 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338845.547977:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee44f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f600308-4919-499d-be82-256c83420e0e+24:13749:x1874160192183296:12345-192.168.201.53@tcp:35:ldlm_bl.0 Request processed in 282us (476us total) trans 8589934608 rc 0/0 00000100:00100000:1.0:1787338845.547987:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 7 00000100:00100000:2.0:1787338845.549735:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338845.549780:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192183424 00000100:00100000:3.0:1787338845.549789:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192183424 00010000:00010000:3.0:1787338845.549832:0:14367:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5200/0x83671231080c29da lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabb98 expref: 24 pid: 14383 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338845.549896:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 13 00000100:00100000:3.0:1787338845.549931:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbd172b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f600308-4919-499d-be82-256c83420e0e+24:2358:x1874160192183424:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787338845.549946:0:14367:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787338845.549953:0:14367:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5200/0x83671231080c29da lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabb98 expref: 24 pid: 14383 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338845.549967:0:14367:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5200/0x83671231080c29da lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabb98 expref: 24 pid: 14383 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338845.549991:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5200/0x83671231080c29da lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabb98 expref: 24 pid: 14383 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338845.550009:0:14367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90bbc9a99d00) 00010000:00010000:3.0:1787338845.550012:0:14367:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030200/0x83671231080c2a04 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338845.550019:0:14367:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030200/0x83671231080c2a04 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338845.550024:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030200/0x83671231080c2a04 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338845.550051:0:14367:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787338845.550097:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbd172b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f600308-4919-499d-be82-256c83420e0e+23:2358:x1874160192183424:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 170us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338845.550105:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 13 00010000:00010000:0.0:1787338845.550416:0:14383:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030200/0x83671231080c2a04 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338845.550431:0:14383:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030200/0x83671231080c2a04 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787338845.550488:0:14383:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787338845.550493:0:14383:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787338845.550527:0:14383:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030200/0x83671231080c2a04 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338845.550536:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030200/0x83671231080c2a04 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338845.550543:0:14383:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4600/0x83671231080c29f6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338845.550548:0:14383:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4600/0x83671231080c29f6 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338845.550552:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4600/0x83671231080c29f6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338845.550556:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbffef4600 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:0.0:1787338845.550559:0:14383:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4600/0x83671231080c29f6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338845.550563:0:14383:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4600/0x83671231080c29f6 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338845.550570:0:14383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90bbc2a93400) 00010000:00010000:0.0:1787338845.550571:0:14383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787338845.550573:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4600/0x83671231080c29f6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338845.550584:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4600/0x83671231080c29f6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338845.550594:0:14383:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030c00/0x83671231080c29fd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338845.550597:0:14383:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030c00/0x83671231080c29fd lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338845.550601:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030c00/0x83671231080c29fd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338845.550604:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbc0030c00 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:0.0:1787338845.550605:0:14383:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030c00/0x83671231080c29fd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338845.550608:0:14383:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030c00/0x83671231080c29fd lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338845.550612:0:14383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff90bbeb14d100) 00010000:00010000:0.0:1787338845.550614:0:14383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787338845.550615:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030c00/0x83671231080c29fd lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338845.550618:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030c00/0x83671231080c29fd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338845.550646:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5a00/0x83671231080c29ef lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabb9f expref: 23 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338845.550664:0:14383:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030200/0x83671231080c2a04 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabb9f expref: 22 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338845.550669:0:14383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90bbc9a99d00) 00010000:00010000:0.0:1787338845.550670:0:14383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787338845.550672:0:14383:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbc0030200, rc 0) 00000100:00100000:0.0:1787338845.550703:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc01f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f600308-4919-499d-be82-256c83420e0e+22:14496:x1874160192183040:12345-192.168.201.53@tcp:101:stat.0 Request processed in 7360us (7643us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338845.550709:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 35 00000100:00100000:2.0:1787338845.612244:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338845.612391:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192183680 00000100:00100000:3.0:1787338845.612404:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192183680 00000100:00100000:3.0:1787338845.612476:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 36 00000100:00100000:3.0:1787338845.612489:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc01d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f600308-4919-499d-be82-256c83420e0e+22:14502:x1874160192183680:12345-192.168.201.53@tcp:36:truncate.0 00010000:00010000:3.0:1787338845.612574:0:14381:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787338845.612611:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030200/0x83671231080c2a04 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabb9f expref: 22 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338845.612634:0:14381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90bbc9a99d00) 00010000:00010000:3.0:1787338845.612640:0:14381:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787338845.613473:0:14381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045400/0x83671231080c2a0b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338845.613493:0:14381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045400/0x83671231080c2a0b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338845.613503:0:14381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045400/0x83671231080c2a0b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787338845.613560:0:14381:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:3.0:1787338845.613584:0:14381:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e25c6df6 reply state 0000000035f84b40 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045400/0x83671231080c2a0b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338845.613594:0:14381:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787338845.613720:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc01d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f600308-4919-499d-be82-256c83420e0e+24:14502:x1874160192183680:12345-192.168.201.53@tcp:36:truncate.0 Request processed in 1230us (1486us total) trans 8589934610 rc 0/0 00000100:00100000:3.0:1787338845.613728:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 36 00000020:00080000:3.0:1787338845.613733:0:14381:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787338845.619340:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045400/0x83671231080c2a0b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338845.619368:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045400/0x83671231080c2a0b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338845.619377:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045400/0x83671231080c2a0b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338845.619385:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bc02045400 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:0.0:1787338845.619390:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045400/0x83671231080c2a0b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338845.619398:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045400/0x83671231080c2a0b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338845.619418:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90bbc9a99d00) 00010000:00010000:0.0:1787338845.619422:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787338845.619426:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045400/0x83671231080c2a0b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338845.619454:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045400/0x83671231080c2a0b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338845.731644:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338845.731718:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192183808 00000100:00100000:0.0:1787338845.731735:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192183808 00000100:00100000:0.0:1787338845.731798:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 37 00000100:00100000:0.0:1787338845.731810:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbed9caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f600308-4919-499d-be82-256c83420e0e+23:14516:x1874160192183808:12345-192.168.201.53@tcp:101:stat.0 00010000:00010000:0.0:1787338845.731843:0:14383:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787338845.731870:0:14383:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030c00/0x83671231080c2a12 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadabba6 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338845.732103:0:14383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031c00/0x83671231080c2a19 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338845.732115:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031c00/0x83671231080c2a19 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338845.732123:0:14383:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031c00/0x83671231080c2a19 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338845.732134:0:14383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031800/0x83671231080c2a20 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338845.732138:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031800/0x83671231080c2a20 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338845.732142:0:14383:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031800/0x83671231080c2a20 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338845.732361:0:14383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031a00/0x83671231080c2a27 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338845.732386:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031a00/0x83671231080c2a27 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338845.732393:0:14383:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031a00/0x83671231080c2a27 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787338845.732429:0:14383:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00000004:00200000:0.0:1787338845.732433:0:14383:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787338845.732450:0:14383:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031a00/0x83671231080c2a27 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338845.732459:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031a00/0x83671231080c2a27 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338845.732465:0:14383:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031c00/0x83671231080c2a19 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338845.732469:0:14383:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031c00/0x83671231080c2a19 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338845.732473:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031c00/0x83671231080c2a19 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338845.732477:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbc0031c00 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:0.0:1787338845.732481:0:14383:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031c00/0x83671231080c2a19 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338845.732485:0:14383:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031c00/0x83671231080c2a19 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338845.732494:0:14383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90bbc2a93400) 00010000:00010000:0.0:1787338845.732500:0:14383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787338845.732504:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031c00/0x83671231080c2a19 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338845.732508:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031c00/0x83671231080c2a19 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338845.732521:0:14383:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031800/0x83671231080c2a20 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338845.732527:0:14383:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031800/0x83671231080c2a20 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338845.732533:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031800/0x83671231080c2a20 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338845.732537:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbc0031800 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:0.0:1787338845.732540:0:14383:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031800/0x83671231080c2a20 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338845.732546:0:14383:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031800/0x83671231080c2a20 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338845.732553:0:14383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff90bbeb14d100) 00010000:00010000:0.0:1787338845.732556:0:14383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787338845.732558:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031800/0x83671231080c2a20 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338845.732565:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031800/0x83671231080c2a20 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338845.732594:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030c00/0x83671231080c2a12 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabba6 expref: 25 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338845.732613:0:14383:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031a00/0x83671231080c2a27 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabba6 expref: 24 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338845.732618:0:14383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90bbc9a99d00) 00010000:00010000:0.0:1787338845.732619:0:14383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787338845.732621:0:14383:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbc0031a00, rc 0) 00000100:00100000:0.0:1787338845.732674:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbed9caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f600308-4919-499d-be82-256c83420e0e+24:14516:x1874160192183808:12345-192.168.201.53@tcp:101:stat.0 Request processed in 867us (1044us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338845.732679:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 37 00000100:00100000:0.0:1787338845.816845:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338845.816936:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192184064 00000100:00100000:3.0:1787338845.816944:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192184064 00000100:00100000:3.0:1787338845.816993:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 38 00000100:00100000:3.0:1787338845.817000:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf7ead180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f600308-4919-499d-be82-256c83420e0e+24:14526:x1874160192184064:12345-192.168.201.53@tcp:101:lfs.0 00010000:00010000:3.0:1787338845.817025:0:14381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787338845.817054:0:14381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045e00/0x83671231080c2a2e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadabbad expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787338845.817178:0:14381:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1787338845.817299:0:14381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045e00/0x83671231080c2a2e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabbad expref: 26 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338845.817314:0:14381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90bbc2a93100) 00010000:00010000:3.0:1787338845.817317:0:14381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787338845.817322:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045e00/0x83671231080c2a2e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabbad expref: 26 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338845.817335:0:14381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bc02045e00, rc 0) 00000100:00100000:3.0:1787338845.817414:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf7ead180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f600308-4919-499d-be82-256c83420e0e+25:14526:x1874160192184064:12345-192.168.201.53@tcp:101:lfs.0 Request processed in 412us (577us total) trans 8589934611 rc 301/301 00000100:00100000:3.0:1787338845.817423:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 38 00000100:00100000:2.0:1787338845.820588:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338845.820671:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192184320 00000100:00100000:0.0:1787338845.820682:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192184320 00000100:00100000:0.0:1787338845.820746:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 8 00000100:00100000:0.0:1787338845.820759:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbed9ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f600308-4919-499d-be82-256c83420e0e+25:14526:x1874160192184320:12345-192.168.201.53@tcp:35:lfs.0 00000100:00100000:0.0:1787338845.821476:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbed9ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f600308-4919-499d-be82-256c83420e0e+26:14526:x1874160192184320:12345-192.168.201.53@tcp:35:lfs.0 Request processed in 716us (896us total) trans 8589934612 rc 0/0 00000100:00100000:0.0:1787338845.821484:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 8 00000100:00100000:3.0:1787338845.911445:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338845.913171:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192184576 00000100:00100000:0.0:1787338845.913185:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192184576 00000100:00100000:0.0:1787338845.913262:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 39 00000100:00100000:0.0:1787338845.913274:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee44ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f600308-4919-499d-be82-256c83420e0e+26:14532:x1874160192184576:12345-192.168.201.53@tcp:101:bash.0 00010000:00010000:0.0:1787338845.913301:0:14383:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787338845.913323:0:14383:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031800/0x83671231080c2a3c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadabbb4 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338845.913465:0:14383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031c00/0x83671231080c2a43 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338845.913480:0:14383:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031a00/0x83671231080c2a27 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabba6 expref: 27 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338845.913489:0:14383:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031c00/0x83671231080c2a43 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338845.913524:0:14383:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031a00/0x83671231080c2a27 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabba6 expref: 27 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338845.913538:0:14383:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031a00/0x83671231080c2a27 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabba6 expref: 27 pid: 14383 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338845.913551:0:14383:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf7eaed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14383:1874160212091264:192.168.201.53@tcp:104: 00000100:00100000:0.0:1787338845.913658:0:14383:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbd07dd300 going to sleep for 11 seconds 00000100:00100000:2.0:1787338845.918060:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338845.918105:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192184704 00000100:00100000:3.0:1787338845.918116:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192184704 00010000:00010000:3.0:1787338845.918165:0:14366:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031a00/0x83671231080c2a27 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabba6 expref: 28 pid: 14383 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338845.918172:0:14383:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf7eaed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14383:1874160212091264:192.168.201.53@tcp:104: 00010000:00010000:0.0:1787338845.918201:0:14383:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031c00/0x83671231080c2a43 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338845.918212:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 14 00000100:00100000:3.0:1787338845.918223:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbed9c9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f600308-4919-499d-be82-256c83420e0e+28:2358:x1874160192184704:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787338845.918238:0:14366:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787338845.918244:0:14366:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031a00/0x83671231080c2a27 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabba6 expref: 28 pid: 14383 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338845.918278:0:14366:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031a00/0x83671231080c2a27 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabba6 expref: 28 pid: 14383 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338845.918302:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031a00/0x83671231080c2a27 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabba6 expref: 28 pid: 14383 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338845.918321:0:14366:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90bbc9a99d00) 00010000:00010000:3.0:1787338845.918326:0:14366:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031c00/0x83671231080c2a43 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338845.918335:0:14366:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031c00/0x83671231080c2a43 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338845.918351:0:14366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031c00/0x83671231080c2a43 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338845.918381:0:14366:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787338845.918432:0:14383:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031c00/0x83671231080c2a43 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338845.918437:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbed9c9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f600308-4919-499d-be82-256c83420e0e+27:2358:x1874160192184704:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 217us (385us total) trans 0 rc 0/0 00010000:00010000:0.0:1787338845.918440:0:14383:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031c00/0x83671231080c2a43 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338845.918445:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 14 00000004:00200000:0.0:1787338845.918461:0:14383:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00010000:00010000:0.0:1787338845.918641:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031800/0x83671231080c2a3c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabbb4 expref: 28 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338845.918653:0:14383:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031c00/0x83671231080c2a43 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabbb4 expref: 27 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338845.918658:0:14383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90bbc9a99d00) 00010000:00010000:0.0:1787338845.918660:0:14383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787338845.918661:0:14383:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbc0031c00, rc 0) 00000100:00100000:0.0:1787338845.918680:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee44ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f600308-4919-499d-be82-256c83420e0e+27:14532:x1874160192184576:12345-192.168.201.53@tcp:101:bash.0 Request processed in 5411us (7257us total) trans 8589934613 rc 0/0 00000100:00100000:0.0:1787338845.918685:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 39 00000100:00100000:2.0:1787338845.921060:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338845.921220:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192184960 00000100:00100000:0.0:1787338845.921229:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192184960 00000100:00100000:0.0:1787338845.921279:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 40 00000100:00100000:0.0:1787338845.921291:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbed9c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f600308-4919-499d-be82-256c83420e0e+27:14532:x1874160192184960:12345-192.168.201.53@tcp:36:bash.0 00010000:00010000:0.0:1787338845.922175:0:14382:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031400/0x83671231080c2a51 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338845.922192:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031400/0x83671231080c2a51 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338845.922200:0:14382:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031400/0x83671231080c2a51 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787338845.922245:0:14382:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934614 00000004:00010000:0.0:1787338845.922263:0:14382:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e50dc0ed reply state 000000006b4e4b50 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031400/0x83671231080c2a51 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338845.922269:0:14382:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787338845.922371:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbed9c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f600308-4919-499d-be82-256c83420e0e+30:14532:x1874160192184960:12345-192.168.201.53@tcp:36:bash.0 Request processed in 1082us (1317us total) trans 8589934615 rc 0/0 00000100:00100000:0.0:1787338845.922376:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 40 00000020:00080000:0.0:1787338845.922380:0:14382:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787338845.923786:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031400/0x83671231080c2a51 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338845.923799:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031400/0x83671231080c2a51 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338845.923806:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031400/0x83671231080c2a51 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338845.923828:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbc0031400 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:3.0:1787338845.923833:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031400/0x83671231080c2a51 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338845.923840:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031400/0x83671231080c2a51 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338845.923855:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90bbc9a99d00) 00010000:00010000:3.0:1787338845.923859:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787338845.923863:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031400/0x83671231080c2a51 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338845.923869:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031400/0x83671231080c2a51 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338845.927584:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338845.928461:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192185088 00000100:00100000:0.0:1787338845.928472:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192185088 00000100:00100000:0.0:1787338845.929025:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 41 00000100:00100000:0.0:1787338845.929037:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbed9c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f600308-4919-499d-be82-256c83420e0e+29:14532:x1874160192185088:12345-192.168.201.53@tcp:101:bash.0 00010000:00010000:0.0:1787338845.929064:0:14383:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787338845.929084:0:14383:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031800/0x83671231080c2a58 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadabbbb expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338845.929185:0:14383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031200/0x83671231080c2a5f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338845.929196:0:14383:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031c00/0x83671231080c2a43 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabbb4 expref: 30 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338845.929202:0:14383:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031200/0x83671231080c2a5f lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338845.929231:0:14383:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031c00/0x83671231080c2a43 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabbb4 expref: 30 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338845.929240:0:14383:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031c00/0x83671231080c2a43 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabbb4 expref: 30 pid: 14383 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338845.929250:0:14383:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf7eaed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14383:1874160212091392:192.168.201.53@tcp:104: 00000100:00100000:0.0:1787338845.929326:0:14383:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbd8782840 going to sleep for 11 seconds 00000100:00100000:0.0:1787338845.932617:0:14383:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf7eaed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14383:1874160212091392:192.168.201.53@tcp:104: 00010000:00010000:0.0:1787338845.932693:0:14383:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031200/0x83671231080c2a5f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338845.933432:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338845.933469:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192185216 00000100:00100000:3.0:1787338845.933477:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192185216 00010000:00010000:3.0:1787338845.933513:0:14367:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031c00/0x83671231080c2a43 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabbb4 expref: 31 pid: 14383 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338845.933551:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 15 00000100:00100000:3.0:1787338845.933562:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbed9cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f600308-4919-499d-be82-256c83420e0e+31:2358:x1874160192185216:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787338845.933576:0:14367:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787338845.933583:0:14367:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031c00/0x83671231080c2a43 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabbb4 expref: 31 pid: 14383 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338845.933594:0:14367:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031c00/0x83671231080c2a43 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabbb4 expref: 31 pid: 14383 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338845.933635:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031c00/0x83671231080c2a43 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabbb4 expref: 31 pid: 14383 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338845.933691:0:14367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90bbc9a99d00) 00010000:00010000:3.0:1787338845.933697:0:14367:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031200/0x83671231080c2a5f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338845.933707:0:14367:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031200/0x83671231080c2a5f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338845.933714:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031200/0x83671231080c2a5f lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338845.933741:0:14367:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787338845.933799:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbed9cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f600308-4919-499d-be82-256c83420e0e+30:2358:x1874160192185216:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 239us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338845.933807:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 15 00010000:00010000:0.0:1787338845.934460:0:14383:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031200/0x83671231080c2a5f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338845.934469:0:14383:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031200/0x83671231080c2a5f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787338845.935002:0:14383:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787338845.935007:0:14383:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787338845.935029:0:14383:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031200/0x83671231080c2a5f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338845.935064:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031800/0x83671231080c2a58 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabbbb expref: 30 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338845.935082:0:14383:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031200/0x83671231080c2a5f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabbbb expref: 29 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338845.935089:0:14383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90bbc9a99d00) 00010000:00010000:0.0:1787338845.935092:0:14383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787338845.935094:0:14383:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbc0031200, rc 0) 00000100:00100000:0.0:1787338845.935152:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbed9c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f600308-4919-499d-be82-256c83420e0e+29:14532:x1874160192185088:12345-192.168.201.53@tcp:101:bash.0 Request processed in 6117us (7577us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338845.935160:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 41 00000100:00100000:2.0:1787338845.942484:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338845.942652:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192185472 00000100:00100000:1.0:1787338845.942666:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192185472 00000100:00100000:1.0:1787338845.942778:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 9 00000100:00100000:1.0:1787338845.942792:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbed9c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f600308-4919-499d-be82-256c83420e0e+29:14532:x1874160192185472:12345-192.168.201.53@tcp:35:bash.0 00000100:00100000:1.0:1787338845.943119:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbed9c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f600308-4919-499d-be82-256c83420e0e+30:14532:x1874160192185472:12345-192.168.201.53@tcp:35:bash.0 Request processed in 329us (644us total) trans 8589934616 rc 0/0 00000100:00100000:1.0:1787338845.943127:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 9 00000100:00100000:2.0:1787338846.059580:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338846.059647:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192185728 00000100:00100000:0.0:1787338846.059657:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192185728 00000100:00080000:3.0:1787338846.059789:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787338846.059921:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 42 00000100:00100000:0.0:1787338846.059953:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbed9cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f600308-4919-499d-be82-256c83420e0e+30:14542:x1874160192185728:12345-192.168.201.53@tcp:101:lfs.0 00010000:00010000:0.0:1787338846.059983:0:14382:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787338846.060009:0:14382:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031800/0x83671231080c2a66 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadabbc2 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787338846.060119:0:14382:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1787338846.060241:0:14382:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031800/0x83671231080c2a66 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabbc2 expref: 32 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338846.060257:0:14382:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90bbc2a93100) 00010000:00010000:0.0:1787338846.060261:0:14382:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787338846.060266:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031800/0x83671231080c2a66 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabbc2 expref: 32 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338846.060283:0:14382:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbc0031800, rc 0) 00000100:00100000:0.0:1787338846.060355:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbed9cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f600308-4919-499d-be82-256c83420e0e+31:14542:x1874160192185728:12345-192.168.201.53@tcp:101:lfs.0 Request processed in 389us (765us total) trans 8589934617 rc 301/301 00000100:00100000:0.0:1787338846.060363:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 42 00000100:00100000:2.0:1787338846.064485:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338846.064717:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192185856 00000100:00100000:0.0:1787338846.064727:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192185856 00000100:00100000:0.0:1787338846.064792:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 43 00000100:00100000:0.0:1787338846.064803:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbed9c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f600308-4919-499d-be82-256c83420e0e+31:14542:x1874160192185856:12345-192.168.201.53@tcp:34:lfs.0 00010000:00010000:0.0:1787338846.064901:0:14383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c2a74 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338846.064917:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c2a74 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338846.064951:0:14383:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c2a74 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338846.064968:0:14383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c2a7b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338846.064973:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c2a7b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338846.064978:0:14383:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c2a7b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338846.065083:0:14383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c2a82 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338846.065089:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c2a82 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338846.065093:0:14383:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c2a82 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787338846.065133:0:14383:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c2a82 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338846.065142:0:14383:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c2a74 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338846.065147:0:14383:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c2a74 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338846.065151:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c2a74 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338846.065164:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbc0030a00 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:0.0:1787338846.065168:0:14383:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c2a74 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338846.065173:0:14383:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c2a74 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338846.065184:0:14383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90bbc2a93400) 00010000:00010000:0.0:1787338846.065186:0:14383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787338846.065188:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c2a74 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338846.065192:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c2a74 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338846.065205:0:14383:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c2a7b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338846.065208:0:14383:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c2a7b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338846.065212:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c2a7b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338846.065215:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbc0030400 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:0.0:1787338846.065217:0:14383:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c2a7b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338846.065220:0:14383:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c2a7b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338846.065232:0:14383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff90bbeb14d100) 00010000:00010000:0.0:1787338846.065235:0:14383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787338846.065237:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c2a7b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338846.065241:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c2a7b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338846.065255:0:14383:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c2a82 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338846.065258:0:14383:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c2a82 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338846.065261:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c2a82 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338846.065264:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbc0030800 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:0.0:1787338846.065266:0:14383:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c2a82 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338846.065269:0:14383:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c2a82 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338846.065273:0:14383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90bbc9a99d00) 00010000:00010000:0.0:1787338846.065274:0:14383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787338846.065275:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c2a82 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338846.065278:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c2a82 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338846.065377:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbed9c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f600308-4919-499d-be82-256c83420e0e+31:14542:x1874160192185856:12345-192.168.201.53@tcp:34:lfs.0 Request processed in 574us (905us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338846.065386:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 43 00000100:00100000:2.0:1787338846.067719:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338846.067801:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192186112 00000100:00100000:1.0:1787338846.067809:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192186112 00000100:00100000:1.0:1787338846.067855:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 10 00000100:00100000:1.0:1787338846.067866:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbff8f2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f600308-4919-499d-be82-256c83420e0e+31:14542:x1874160192186112:12345-192.168.201.53@tcp:35:lfs.0 00000100:00100000:1.0:1787338846.068110:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbff8f2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f600308-4919-499d-be82-256c83420e0e+32:14542:x1874160192186112:12345-192.168.201.53@tcp:35:lfs.0 Request processed in 247us (399us total) trans 8589934618 rc 0/0 00000100:00100000:1.0:1787338846.068117:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 10 00000100:00100000:2.0:1787338846.114506:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338846.114706:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192186368 00000100:00100000:0.0:1787338846.114717:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192186368 00000100:00100000:0.0:1787338846.114839:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 44 00000100:00100000:0.0:1787338846.114850:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbed9c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f600308-4919-499d-be82-256c83420e0e+32:14545:x1874160192186368:12345-192.168.201.53@tcp:101:lfs.0 00010000:00010000:0.0:1787338846.115075:0:14382:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787338846.115099:0:14382:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c2a89 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadabbc9 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338846.115239:0:14382:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c2a90 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338846.115253:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c2a90 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338846.115264:0:14382:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c2a90 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338846.115279:0:14382:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c2a97 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338846.115287:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c2a97 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338846.115294:0:14382:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c2a97 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338846.115496:0:14382:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031800/0x83671231080c2a9e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338846.115506:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031800/0x83671231080c2a9e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338846.115513:0:14382:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031800/0x83671231080c2a9e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787338846.115523:0:14382:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787338846.115620:0:14382:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c2a90 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338846.115701:0:14382:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c2a90 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338846.115709:0:14382:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c2a90 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338846.115715:0:14382:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbc0030400 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:0.0:1787338846.115720:0:14382:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c2a90 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338846.115794:0:14382:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c2a90 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338846.115809:0:14382:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90bbc2a93400) 00010000:00010000:0.0:1787338846.115812:0:14382:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787338846.115817:0:14382:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c2a90 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338846.115838:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c2a90 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338846.115852:0:14382:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c2a97 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338846.115859:0:14382:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c2a97 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338846.115864:0:14382:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c2a97 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338846.115869:0:14382:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbc0030a00 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:0.0:1787338846.116060:0:14382:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c2a97 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338846.116070:0:14382:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c2a97 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338846.116078:0:14382:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff90bbeb14d100) 00010000:00010000:0.0:1787338846.116081:0:14382:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787338846.116084:0:14382:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c2a97 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338846.116089:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c2a97 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338846.116153:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c2a89 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabbc9 expref: 35 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338846.116180:0:14382:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031800/0x83671231080c2a9e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabbc9 expref: 34 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338846.116188:0:14382:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90bbc9a99d00) 00010000:00010000:0.0:1787338846.116190:0:14382:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787338846.116193:0:14382:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbc0031800, rc 0) 00000100:00100000:0.0:1787338846.116262:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbed9c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f600308-4919-499d-be82-256c83420e0e+34:14545:x1874160192186368:12345-192.168.201.53@tcp:101:lfs.0 Request processed in 1413us (1767us total) trans 8589934619 rc 0/0 00000100:00100000:0.0:1787338846.116271:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 44 00000100:00100000:2.0:1787338846.122161:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338846.122233:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192186624 00000100:00100000:0.0:1787338846.122243:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192186624 00000100:00100000:0.0:1787338846.122300:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 11 00000100:00100000:0.0:1787338846.122309:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbed9cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f600308-4919-499d-be82-256c83420e0e+34:14545:x1874160192186624:12345-192.168.201.53@tcp:35:lfs.0 00000100:00100000:0.0:1787338846.122547:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbed9cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f600308-4919-499d-be82-256c83420e0e+35:14545:x1874160192186624:12345-192.168.201.53@tcp:35:lfs.0 Request processed in 238us (397us total) trans 8589934620 rc 0/0 00000100:00100000:0.0:1787338846.122552:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 11 00000100:00100000:2.0:1787338846.125369:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338846.125547:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192186752 00000100:00100000:1.0:1787338846.125559:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192186752 00000100:00100000:1.0:1787338846.125639:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 45 00000100:00100000:1.0:1787338846.125653:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbed9c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f600308-4919-499d-be82-256c83420e0e+35:14545:x1874160192186752:12345-192.168.201.53@tcp:54:lfs.0 00010000:00010000:1.0:1787338846.125738:0:14381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c200/0x83671231080c2aac lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338846.125773:0:14381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c200/0x83671231080c2aac lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338846.125785:0:14381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c200/0x83671231080c2aac lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338846.125814:0:14381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c200/0x83671231080c2aac lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338846.125822:0:14381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c200/0x83671231080c2aac lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338846.125830:0:14381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c200/0x83671231080c2aac lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338846.125836:0:14381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbfbe9c200 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:1.0:1787338846.125843:0:14381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c200/0x83671231080c2aac lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338846.125851:0:14381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c200/0x83671231080c2aac lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338846.125863:0:14381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90bbc9a99d00) 00010000:00010000:1.0:1787338846.125866:0:14381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787338846.126414:0:14381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c200/0x83671231080c2aac lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338846.126425:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c200/0x83671231080c2aac lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338846.126517:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbed9c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f600308-4919-499d-be82-256c83420e0e+35:14545:x1874160192186752:12345-192.168.201.53@tcp:54:lfs.0 Request processed in 865us (1159us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338846.126533:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 45 00000100:00100000:2.0:1787338846.130586:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338846.130865:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192186880 00000100:00100000:3.0:1787338846.131241:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192186880 00000100:00100000:3.0:1787338846.131314:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 0 00000100:00100000:3.0:1787338846.131326:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbed9c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f600308-4919-499d-be82-256c83420e0e+35:2359:x1874160192186880:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787338846.131352:0:14368:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787338846.131380:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031800/0x83671231080c2a9e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabbc9 expref: 35 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338846.131402:0:14368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90bbc9a99d00) 00010000:00010000:3.0:1787338846.131423:0:14368:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787338846.131535:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbed9c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f600308-4919-499d-be82-256c83420e0e+34:2359:x1874160192186880:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 210us (962us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338846.131542:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 0 00010000:00010000:3.0:1787338846.135748:0:15652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787338846.308329:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338846.308452:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192187008 00000100:00100000:0.0:1787338846.308461:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192187008 00000100:00100000:0.0:1787338846.308524:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 46 00000100:00100000:0.0:1787338846.308535:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbed9ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f600308-4919-499d-be82-256c83420e0e+34:14564:x1874160192187008:12345-192.168.201.53@tcp:101:lfs.0 00010000:00010000:0.0:1787338846.308556:0:14382:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787338846.308577:0:14382:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c2ab3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadabbd0 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338846.308656:0:14382:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c2aba lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338846.308682:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c2aba lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338846.308694:0:14382:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c2aba lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787338846.308766:0:14382:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1787338846.308770:0:14382:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787338846.308794:0:14382:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c2aba lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338846.308822:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c2ab3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabbd0 expref: 36 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338846.308842:0:14382:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c2aba lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabbd0 expref: 35 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338846.308850:0:14382:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90bbc2a93400) 00010000:00010000:0.0:1787338846.308853:0:14382:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787338846.308856:0:14382:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbc0030a00, rc 0) 00000100:00100000:0.0:1787338846.309299:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbed9ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f600308-4919-499d-be82-256c83420e0e+35:14564:x1874160192187008:12345-192.168.201.53@tcp:101:lfs.0 Request processed in 765us (981us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338846.309308:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 46 00000100:00100000:2.0:1787338846.319975:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338846.320119:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192187392 00000100:00100000:0.0:1787338846.320129:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192187392 00000100:00100000:0.0:1787338846.320186:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 12 00000100:00100000:0.0:1787338846.320196:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbed9cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f600308-4919-499d-be82-256c83420e0e+35:14564:x1874160192187392:12345-192.168.201.53@tcp:35:lfs.0 00000100:00100000:0.0:1787338846.320579:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbed9cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f600308-4919-499d-be82-256c83420e0e+36:14564:x1874160192187392:12345-192.168.201.53@tcp:35:lfs.0 Request processed in 383us (615us total) trans 8589934621 rc 0/0 00000100:00100000:0.0:1787338846.320594:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 12 00000100:00100000:2.0:1787338846.324307:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338846.324414:0:16493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192187520 00000100:00100000:1.0:1787338846.324425:0:16493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192187520 00000100:00100000:1.0:1787338846.324491:0:16493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 1 00000100:00100000:1.0:1787338846.324502:0:16493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbed9c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f600308-4919-499d-be82-256c83420e0e+36:14564:x1874160192187520:12345-192.168.201.53@tcp:103:lfs.0 00010000:00010000:1.0:1787338846.324517:0:16493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1787338846.324541:0:16493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031200/0x83671231080c2a5f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabbbb expref: 36 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338846.324564:0:16493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c29be lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabb91 expref: 35 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338846.324575:0:16493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90bbc9a99d00) 00010000:00010000:1.0:1787338846.324586:0:16493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787338846.324641:0:16493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbed9c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f600308-4919-499d-be82-256c83420e0e+34:14564:x1874160192187520:12345-192.168.201.53@tcp:103:lfs.0 Request processed in 141us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338846.324649:0:16493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 1 00000100:00100000:2.0:1787338846.328228:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338846.328320:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192187648 00000100:00100000:1.0:1787338846.328345:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192187648 00000100:00100000:1.0:1787338846.328411:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 47 00000100:00100000:1.0:1787338846.328421:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbed9c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f600308-4919-499d-be82-256c83420e0e+34:14564:x1874160192187648:12345-192.168.201.53@tcp:58:lfs.0 00010000:00010000:1.0:1787338846.328548:0:14381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c200/0x83671231080c2ac1 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338846.328565:0:14381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c200/0x83671231080c2ac1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338846.328588:0:14381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c200/0x83671231080c2ac1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787338846.330235:0:14381:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787338846.330406:0:14381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:1.0:1787338846.330472:0:14381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:1.0:1787338846.330585:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbed9c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f600308-4919-499d-be82-256c83420e0e+34:14564:x1874160192187648:12345-192.168.201.53@tcp:58:lfs.0 Request processed in 2161us (2368us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338846.330596:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 47 00000100:00100000:2.0:1787338846.355079:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338846.355263:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192187776 00000100:00100000:0.0:1787338846.355273:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192187776 00000100:00100000:0.0:1787338846.355341:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 48 00000100:00100000:0.0:1787338846.355353:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbed9cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f600308-4919-499d-be82-256c83420e0e+34:14566:x1874160192187776:12345-192.168.201.53@tcp:101:lfs.0 00010000:00010000:0.0:1787338846.355373:0:14382:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787338846.355392:0:14382:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c2ac8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadabbd7 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338846.355464:0:14382:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c2acf lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338846.355479:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c2acf lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338846.355490:0:14382:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c2acf lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338846.355507:0:14382:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c2ad6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338846.355514:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c2ad6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338846.355522:0:14382:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c2ad6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338846.355620:0:14382:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031200/0x83671231080c2add lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338846.355647:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031200/0x83671231080c2add lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338846.355655:0:14382:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031200/0x83671231080c2add lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787338846.355692:0:14382:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787338846.355696:0:14382:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787338846.355713:0:14382:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031200/0x83671231080c2add lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338846.355725:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031200/0x83671231080c2add lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338846.355734:0:14382:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c2acf lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338846.355740:0:14382:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c2acf lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338846.355747:0:14382:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c2acf lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338846.355754:0:14382:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbc0030400 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:0.0:1787338846.355758:0:14382:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c2acf lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338846.355766:0:14382:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c2acf lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338846.355778:0:14382:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90bbc2a93400) 00010000:00010000:0.0:1787338846.355787:0:14382:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787338846.355792:0:14382:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c2acf lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338846.355799:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c2acf lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338846.355815:0:14382:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c2ad6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338846.355820:0:14382:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c2ad6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338846.355826:0:14382:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c2ad6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338846.355831:0:14382:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbc0031000 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:0.0:1787338846.355834:0:14382:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c2ad6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338846.355841:0:14382:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c2ad6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338846.355848:0:14382:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff90bbeb14d100) 00010000:00010000:0.0:1787338846.355851:0:14382:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787338846.355854:0:14382:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c2ad6 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338846.355860:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c2ad6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338846.355950:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c2ac8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabbd7 expref: 36 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338846.355977:0:14382:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031200/0x83671231080c2add lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabbd7 expref: 35 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338846.355985:0:14382:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90bbc2a93000) 00010000:00010000:0.0:1787338846.355987:0:14382:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787338846.355989:0:14382:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbc0031200, rc 0) 00000100:00100000:0.0:1787338846.356055:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbed9cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f600308-4919-499d-be82-256c83420e0e+35:14566:x1874160192187776:12345-192.168.201.53@tcp:101:lfs.0 Request processed in 703us (985us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338846.356062:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 48 00000040:00080000:1.0:1787338846.587554:0:14412:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787338846.587570:0:14412:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787338846.587608:0:14412:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1787338846.587615:0:14412:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1787338846.587802:0:14412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf4704a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14412:1874160212091520:192.168.201.53@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787338846.587981:0:14412:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc674c0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787338846.590284:0:14412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf4704a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14412:1874160212091520:192.168.201.53@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787338846.593441:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338846.593635:0:14392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192187904 00000100:00100000:2.0:1787338846.593645:0:14392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192187904 00000100:00100000:2.0:1787338846.593700:0:14392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 0 00000100:00100000:2.0:1787338846.593709:0:14392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee44ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:4f600308-4919-499d-be82-256c83420e0e+35:14577:x1874160192187904:12345-192.168.201.53@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1787338846.593797:0:14392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee44ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:4f600308-4919-499d-be82-256c83420e0e+35:14577:x1874160192187904:12345-192.168.201.53@tcp:900:lhsmtool_posix.0 Request processed in 89us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338846.593805:0:14392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 0 00000100:00100000:2.0:1787338846.596213:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338846.596319:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192188032 00000100:00100000:3.0:1787338846.596338:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192188032 00000100:00100000:3.0:1787338846.596418:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 49 00000100:00100000:3.0:1787338846.596428:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbed9ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f600308-4919-499d-be82-256c83420e0e+35:14577:x1874160192188032:12345-192.168.201.53@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787338846.596455:0:14381:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787338846.596550:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbed9ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f600308-4919-499d-be82-256c83420e0e+35:14577:x1874160192188032:12345-192.168.201.53@tcp:53:lhsmtool_posix.0 Request processed in 123us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338846.596557:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 49 00000100:00100000:3.0:1787338846.599257:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338846.600299:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192188160 00000100:00100000:2.0:1787338846.600311:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192188160 00000100:00100000:2.0:1787338846.600385:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 50 00000100:00100000:2.0:1787338846.600396:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee44f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f600308-4919-499d-be82-256c83420e0e+35:14577:x1874160192188160:12345-192.168.201.53@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787338846.600465:0:14383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3600/0x83671231080c2ae4 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338846.600484:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3600/0x83671231080c2ae4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338846.600497:0:14383:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3600/0x83671231080c2ae4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338846.600673:0:14383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2e00/0x83671231080c2aeb lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338846.600682:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2e00/0x83671231080c2aeb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338846.600690:0:14383:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2e00/0x83671231080c2aeb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338846.600720:0:14383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2000/0x83671231080c2af2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338846.600794:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2000/0x83671231080c2af2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338846.600801:0:14383:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2000/0x83671231080c2af2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787338846.600839:0:14383:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1787338846.600843:0:14383:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787338846.600859:0:14383:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2000/0x83671231080c2af2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338846.600870:0:14383:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3600/0x83671231080c2ae4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338846.601052:0:14383:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3600/0x83671231080c2ae4 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338846.601060:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3600/0x83671231080c2ae4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338846.601077:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e3600 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:2.0:1787338846.601082:0:14383:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3600/0x83671231080c2ae4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338846.601090:0:14383:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3600/0x83671231080c2ae4 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338846.601103:0:14383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90bbc2a93900) 00010000:00010000:2.0:1787338846.601235:0:14383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787338846.601241:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3600/0x83671231080c2ae4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338846.601248:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3600/0x83671231080c2ae4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338846.601262:0:14383:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2e00/0x83671231080c2aeb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338846.601269:0:14383:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2e00/0x83671231080c2aeb lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338846.601275:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2e00/0x83671231080c2aeb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338846.601280:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e2e00 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:2.0:1787338846.601283:0:14383:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2e00/0x83671231080c2aeb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338846.601289:0:14383:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2e00/0x83671231080c2aeb lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338846.601306:0:14383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff90bbc8283c00) 00010000:00010000:2.0:1787338846.601309:0:14383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787338846.601312:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2e00/0x83671231080c2aeb lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338846.601318:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2e00/0x83671231080c2aeb lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338846.601344:0:14383:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2000/0x83671231080c2af2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338846.601351:0:14383:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2000/0x83671231080c2af2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338846.601356:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2000/0x83671231080c2af2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338846.601361:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e2000 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:2.0:1787338846.601364:0:14383:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2000/0x83671231080c2af2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338846.601369:0:14383:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2000/0x83671231080c2af2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338846.601377:0:14383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90bbc2a93000) 00010000:00010000:2.0:1787338846.601380:0:14383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787338846.601383:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2000/0x83671231080c2af2 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338846.601388:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2000/0x83671231080c2af2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338846.601509:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee44f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f600308-4919-499d-be82-256c83420e0e+35:14577:x1874160192188160:12345-192.168.201.53@tcp:34:lhsmtool_posix.0 Request processed in 1111us (2257us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338846.601518:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 50 00000100:00100000:2.0:1787338846.604741:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338846.604804:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192188416 00000100:00100000:3.0:1787338846.604813:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192188416 00000100:00100000:3.0:1787338846.604904:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 51 00000100:00100000:3.0:1787338846.604922:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbed9c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f600308-4919-499d-be82-256c83420e0e+35:14577:x1874160192188416:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787338846.604940:0:14381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787338846.604958:0:14381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045e00/0x83671231080c2af9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadabbde expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338846.605048:0:14381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02044c00/0x83671231080c2b00 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338846.605063:0:14381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02044c00/0x83671231080c2b00 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338846.605087:0:14381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02044c00/0x83671231080c2b00 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787338846.605099:0:14381:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1787338846.605212:0:14381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02044c00/0x83671231080c2b00 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338846.605221:0:14381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02044c00/0x83671231080c2b00 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338846.605228:0:14381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02044c00/0x83671231080c2b00 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338846.605234:0:14381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bc02044c00 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:3.0:1787338846.605239:0:14381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02044c00/0x83671231080c2b00 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338846.605245:0:14381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02044c00/0x83671231080c2b00 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338846.605257:0:14381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90bbc2a93000) 00010000:00010000:3.0:1787338846.605260:0:14381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787338846.605264:0:14381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02044c00/0x83671231080c2b00 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338846.605270:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02044c00/0x83671231080c2b00 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338846.605311:0:14381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045e00/0x83671231080c2af9 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabbde expref: 37 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338846.605342:0:14381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90bbc2a93900) 00010000:00010000:3.0:1787338846.605345:0:14381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787338846.605350:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045e00/0x83671231080c2af9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabbde expref: 37 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338846.605361:0:14381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bc02045e00, rc 0) 00000100:00100000:3.0:1787338846.605414:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbed9c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f600308-4919-499d-be82-256c83420e0e+36:14577:x1874160192188416:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 Request processed in 494us (693us total) trans 8589934622 rc 301/301 00000100:00100000:3.0:1787338846.605422:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 51 00000100:00100000:3.0:1787338846.608787:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338846.608863:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192188544 00000100:00100000:2.0:1787338846.608871:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192188544 00000100:00100000:2.0:1787338846.608967:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 52 00000100:00100000:2.0:1787338846.608977:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee44c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f600308-4919-499d-be82-256c83420e0e+36:14577:x1874160192188544:12345-192.168.201.53@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787338846.609012:0:14383:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787338846.609131:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee44c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f600308-4919-499d-be82-256c83420e0e+36:14577:x1874160192188544:12345-192.168.201.53@tcp:53:lhsmtool_posix.0 Request processed in 154us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338846.609139:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 52 00000100:00100000:0.0:1787338846.614343:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338846.614449:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192188800 00000100:00100000:1.0:1787338846.614459:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192188800 00000100:00100000:1.0:1787338846.614567:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 53 00000100:00100000:1.0:1787338846.614580:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf7eaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f600308-4919-499d-be82-256c83420e0e+36:14577:x1874160192188800:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787338846.614603:0:14382:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787338846.614606:0:14382:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787338846.614632:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c2aba lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabbd0 expref: 36 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338846.614653:0:14382:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90bbc2a93400) 00010000:00010000:1.0:1787338846.614672:0:14382:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787338846.614688:0:14382:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c400/0x83671231080c2b0e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadabbe5 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787338846.615400:0:14382:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x7:0x0], count =27 00000004:00080000:1.0:1787338846.615409:0:14382:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x7:0x0]+27 in llog 00000004:00080000:1.0:1787338846.615468:0:14382:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:1.0:1787338846.615751:0:14382:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c2b15 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338846.615767:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c2b15 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338846.615777:0:14382:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c2b15 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338846.615837:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c400/0x83671231080c2b0e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabbe5 expref: 38 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338846.615901:0:14382:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c2b15 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabbe5 expref: 37 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338846.615910:0:14382:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff90bbc2a93500) 00010000:00010000:1.0:1787338846.615913:0:14382:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787338846.615916:0:14382:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbfbe9d800, rc 0) 00000100:00100000:1.0:1787338846.615981:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf7eaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f600308-4919-499d-be82-256c83420e0e+37:14577:x1874160192188800:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 Request processed in 1403us (1656us total) trans 8589934623 rc 0/0 00000100:00100000:1.0:1787338846.615989:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 53 00000100:00100000:2.0:1787338846.624223:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338846.624308:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192189056 00000100:00100000:3.0:1787338846.624318:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192189056 00000100:00100000:3.0:1787338846.624386:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 54 00000100:00100000:3.0:1787338846.624397:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbd17edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f600308-4919-499d-be82-256c83420e0e+37:14577:x1874160192189056:12345-192.168.201.53@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787338846.624455:0:14381:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787338846.624481:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c2b15 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabbe5 expref: 37 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338846.624501:0:14381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff90bbc2a93500) 00010000:00010000:3.0:1787338846.624512:0:14381:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787338846.624535:0:14381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045400/0x83671231080c2b23 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338846.624548:0:14381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045400/0x83671231080c2b23 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338846.624576:0:14381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045400/0x83671231080c2b23 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338846.624618:0:14381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045000/0x83671231080c2b2a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x295a81b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338846.624626:0:14381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045000/0x83671231080c2b2a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x295a81b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338846.624633:0:14381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045000/0x83671231080c2b2a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x295a81b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338846.624705:0:14381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045400/0x83671231080c2b23 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338846.624713:0:14381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045400/0x83671231080c2b23 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338846.624720:0:14381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045400/0x83671231080c2b23 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338846.624738:0:14381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bc02045400 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:3.0:1787338846.624742:0:14381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045400/0x83671231080c2b23 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338846.624750:0:14381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045400/0x83671231080c2b23 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338846.624758:0:14381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90bbc2a93400) 00010000:00010000:3.0:1787338846.624761:0:14381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787338846.624765:0:14381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045400/0x83671231080c2b23 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338846.624778:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045400/0x83671231080c2b23 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338846.624789:0:14381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045000/0x83671231080c2b2a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x295a81b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338846.624795:0:14381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045000/0x83671231080c2b2a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x295a81b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338846.624801:0:14381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045000/0x83671231080c2b2a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x295a81b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338846.624805:0:14381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bc02045000 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:3.0:1787338846.624808:0:14381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045000/0x83671231080c2b2a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x295a81b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338846.624814:0:14381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045000/0x83671231080c2b2a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x295a81b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338846.624823:0:14381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x295a81b (ffff90bbc9a99a00) 00010000:00010000:3.0:1787338846.624825:0:14381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787338846.624828:0:14381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045000/0x83671231080c2b2a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x295a81b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338846.624834:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045000/0x83671231080c2b2a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x295a81b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338846.624940:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbd17edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f600308-4919-499d-be82-256c83420e0e+36:14577:x1874160192189056:12345-192.168.201.53@tcp:36:lhsmtool_posix.0 Request processed in 543us (726us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787338846.624947:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 54 00000100:00100000:3.0:1787338846.627495:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338846.627574:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192189184 00000100:00100000:1.0:1787338846.627598:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192189184 00000100:00100000:1.0:1787338846.627661:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 55 00000100:00100000:1.0:1787338846.627672:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee44df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f600308-4919-499d-be82-256c83420e0e+36:14577:x1874160192189184:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787338846.627691:0:14382:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787338846.627714:0:14382:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ca00/0x83671231080c2b31 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadabbec expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338846.627760:0:14382:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c2b38 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338846.627772:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c2b38 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338846.627782:0:14382:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c2b38 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338846.628055:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ca00/0x83671231080c2b31 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabbec expref: 38 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338846.628078:0:14382:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c2b38 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabbec expref: 37 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338846.628087:0:14382:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff90bbc2a93e00) 00010000:00010000:1.0:1787338846.628090:0:14382:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787338846.628093:0:14382:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbfbe9d600, rc 0) 00000100:00100000:1.0:1787338846.628212:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee44df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f600308-4919-499d-be82-256c83420e0e+37:14577:x1874160192189184:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 Request processed in 540us (723us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338846.628219:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 55 00000100:00100000:1.0:1787338846.631725:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338846.632009:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192189440 00000100:00100000:2.0:1787338846.632020:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192189440 00000100:00100000:2.0:1787338846.632077:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 56 00000100:00100000:2.0:1787338846.632088:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf4704a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f600308-4919-499d-be82-256c83420e0e+37:14577:x1874160192189440:12345-192.168.201.53@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787338846.632169:0:14383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2e00/0x83671231080c2b3f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338846.632186:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2e00/0x83671231080c2b3f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338846.632199:0:14383:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2e00/0x83671231080c2b3f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787338846.632649:0:14383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:2.0:1787338846.632670:0:14383:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 499473795125ns, next at 500473792657ns, rc = 0 00000004:00010000:2.0:1787338846.632763:0:14383:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002ec43e97 reply state 000000004c58c91f transno 8589934624 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2e00/0x83671231080c2b3f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338846.632774:0:14383:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787338846.633253:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf4704a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f600308-4919-499d-be82-256c83420e0e+39:14577:x1874160192189440:12345-192.168.201.53@tcp:36:lhsmtool_posix.0 Request processed in 1163us (1534us total) trans 8589934624 rc 0/0 00000100:00100000:2.0:1787338846.633261:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 56 00010000:00010000:0.0:1787338846.636792:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2e00/0x83671231080c2b3f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338846.636811:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2e00/0x83671231080c2b3f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338846.636818:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2e00/0x83671231080c2b3f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338846.636824:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e2e00 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:0.0:1787338846.636829:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2e00/0x83671231080c2b3f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338846.636837:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2e00/0x83671231080c2b3f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338846.636856:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff90bbc2a93e00) 00010000:00010000:0.0:1787338846.636859:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787338846.636916:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2e00/0x83671231080c2b3f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338846.636923:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2e00/0x83671231080c2b3f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338846.637127:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338846.637241:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192189568 00000100:00100000:0.0:1787338846.637251:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192189568 00000100:00100000:0.0:1787338846.637303:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 57 00000100:00100000:0.0:1787338846.637313:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbd17ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f600308-4919-499d-be82-256c83420e0e+38:14577:x1874160192189568:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787338846.637347:0:14382:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787338846.637363:0:14382:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031a00/0x83671231080c2b46 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadabbf3 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338846.637424:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031a00/0x83671231080c2b46 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabbf3 expref: 39 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338846.637437:0:14382:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031a00/0x83671231080c2b46 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabbf3 expref: 39 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338846.637458:0:14382:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff90bbc2a93e00) 00010000:00010000:0.0:1787338846.637460:0:14382:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787338846.637462:0:14382:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbc0031a00, rc 0) 00000100:00100000:0.0:1787338846.637557:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbd17ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f600308-4919-499d-be82-256c83420e0e+39:14577:x1874160192189568:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 Request processed in 245us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338846.637564:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 57 00000100:00100000:0.0:1787338846.641319:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338846.641434:0:15066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192189696 00000100:00100000:2.0:1787338846.641443:0:15066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192189696 00000100:00100000:2.0:1787338846.641532:0:15066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 12 00000100:00100000:2.0:1787338846.641542:0:15066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf7eaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f600308-4919-499d-be82-256c83420e0e+5:2358:x1874160192189696:12345-192.168.201.53@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1787338846.641981:0:15066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf7eaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f600308-4919-499d-be82-256c83420e0e+6:2358:x1874160192189696:12345-192.168.201.53@tcp:2:lhsmtool_posix.0 Request processed in 439us (670us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1787338846.641990:0:15066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 12 00000100:00100000:3.0:1787338846.644012:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338846.644151:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192189952 00000100:00100000:1.0:1787338846.644161:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192189952 00000100:00100000:1.0:1787338846.644214:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 13 00000100:00100000:1.0:1787338846.644225:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee44ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f600308-4919-499d-be82-256c83420e0e+39:14577:x1874160192189952:12345-192.168.201.53@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787338846.644448:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee44ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f600308-4919-499d-be82-256c83420e0e+40:14577:x1874160192189952:12345-192.168.201.53@tcp:35:lhsmtool_posix.0 Request processed in 224us (444us total) trans 8589934625 rc 0/0 00000100:00100000:1.0:1787338846.644455:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 13 00000100:00100000:3.0:1787338846.646263:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338846.646451:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192190208 00000100:00100000:1.0:1787338846.646460:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192190208 00000100:00100000:1.0:1787338846.646511:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 58 00000100:00100000:1.0:1787338846.646521:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee44dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f600308-4919-499d-be82-256c83420e0e+40:14577:x1874160192190208:12345-192.168.201.53@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787338846.646611:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee44dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f600308-4919-499d-be82-256c83420e0e+40:14577:x1874160192190208:12345-192.168.201.53@tcp:57:lhsmtool_posix.0 Request processed in 90us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338846.646619:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 58 00000100:00100000:1.0:1787338846.651472:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338846.651805:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192190336 00000100:00100000:3.0:1787338846.651816:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192190336 00000100:00100000:3.0:1787338846.651914:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 59 00000100:00100000:3.0:1787338846.651926:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf4704380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f600308-4919-499d-be82-256c83420e0e+40:14577:x1874160192190336:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787338846.651947:0:14381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787338846.651969:0:14381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045000/0x83671231080c2b4d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadabbfa expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338846.652063:0:14381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045400/0x83671231080c2b54 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338846.652077:0:14381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045400/0x83671231080c2b54 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338846.652088:0:14381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045400/0x83671231080c2b54 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787338846.652125:0:14381:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787338846.652143:0:14381:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045400/0x83671231080c2b54 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338846.652170:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045000/0x83671231080c2b4d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabbfa expref: 42 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338846.652188:0:14381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045400/0x83671231080c2b54 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabbfa expref: 41 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338846.652209:0:14381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff90bbc2a93e00) 00010000:00010000:3.0:1787338846.652212:0:14381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787338846.652216:0:14381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bc02045400, rc 0) 00000100:00100000:3.0:1787338846.652273:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf4704380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f600308-4919-499d-be82-256c83420e0e+41:14577:x1874160192190336:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 Request processed in 349us (812us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338846.652280:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 59 00000100:00100000:3.0:1787338846.658056:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338846.658342:0:15650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192190464 00000100:00100000:1.0:1787338846.658353:0:15650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192190464 00000100:00100000:1.0:1787338846.658411:0:15650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 13 00000100:00100000:1.0:1787338846.658422:0:15650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee44fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f600308-4919-499d-be82-256c83420e0e+6:2359:x1874160192190464:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787338846.658441:0:15650:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787338846.658463:0:15650:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000073fe865c/0x83671231080c2b5b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadabc01 expref: -99 pid: 15650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787338846.658493:0:15650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a88a05e, blocks: 0x1 00010000:00010000:1.0:1787338846.658513:0:15650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=499s v=(0 0) 00010000:00010000:1.0:1787338846.658518:0:15650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787338846.658541:0:15650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073fe865c/0x83671231080c2b5b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc01 expref: 7 pid: 15650 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338846.658564:0:15650:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000073fe865c/0x83671231080c2b5b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc01 expref: 7 pid: 15650 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338846.658579:0:15650:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbfbe9c400, rc 0) 00000100:00100000:1.0:1787338846.658647:0:15650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee44fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f600308-4919-499d-be82-256c83420e0e+7:2359:x1874160192190464:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 Request processed in 225us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338846.658655:0:15650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 13 00000100:00100000:0.0:1787338846.669662:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338846.669746:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192190720 00000100:00100000:1.0:1787338846.669757:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192190720 00000100:00100000:1.0:1787338846.669820:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 60 00000100:00100000:1.0:1787338846.669831:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf7ead880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f600308-4919-499d-be82-256c83420e0e+41:14577:x1874160192190720:12345-192.168.201.53@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787338846.669977:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf7ead880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f600308-4919-499d-be82-256c83420e0e+41:14577:x1874160192190720:12345-192.168.201.53@tcp:57:lhsmtool_posix.0 Request processed in 147us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338846.669984:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 60 00000100:00100000:1.0:1787338846.673292:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338846.673387:0:15063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192190848 00000100:00100000:0.0:1787338846.673412:0:15063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192190848 00000100:00100000:0.0:1787338846.673471:0:15063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 14 00000100:00100000:0.0:1787338846.673481:0:15063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf4705500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f600308-4919-499d-be82-256c83420e0e+7:14577:x1874160192190848:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787338846.673498:0:15063:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787338846.673517:0:15063:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000efba33dc/0x83671231080c2b62 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadabc08 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338846.673550:0:15063:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000073fe865c/0x83671231080c2b5b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc01 expref: 8 pid: 15650 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338846.673560:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787338846.673564:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787338846.673569:0:15063:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000efba33dc/0x83671231080c2b62 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc08 expref: 8 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338846.673608:0:15063:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000073fe865c/0x83671231080c2b5b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc01 expref: 8 pid: 15650 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338846.673634:0:15063:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000073fe865c/0x83671231080c2b5b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc01 expref: 8 pid: 15650 timeout: 599 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338846.673649:0:15063:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf7eac700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:15063:1874160212091648:192.168.201.53@tcp:104: 00000100:00100000:0.0:1787338846.673747:0:15063:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc2b9a9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787338846.684138:0:15063:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf7eac700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:15063:1874160212091648:192.168.201.53@tcp:104: 00010000:00010000:1.0:1787338846.684174:0:15063:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000efba33dc/0x83671231080c2b62 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc08 expref: 8 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338846.684197:0:15063:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbc0030c00, rc 0) 00000100:00100000:1.0:1787338846.684263:0:15063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf4705500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f600308-4919-499d-be82-256c83420e0e+8:14577:x1874160192190848:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 Request processed in 10783us (10986us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338846.684286:0:15063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 14 00000100:00100000:3.0:1787338846.692494:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338846.692602:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192190976 00000100:00100000:2.0:1787338846.692620:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192190976 00010000:00010000:2.0:1787338846.692663:0:14368:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000073fe865c/0x83671231080c2b5b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc01 expref: 8 pid: 15650 timeout: 599 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338846.692707:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 16 00000100:00100000:2.0:1787338846.692718:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee44c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f600308-4919-499d-be82-256c83420e0e+8:2359:x1874160192190976:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787338846.692734:0:14368:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787338846.692757:0:14368:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000073fe865c/0x83671231080c2b5b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc01 expref: 8 pid: 15650 timeout: 599 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338846.692790:0:14368:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000073fe865c/0x83671231080c2b5b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc01 expref: 8 pid: 15650 timeout: 599 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338846.692813:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000073fe865c/0x83671231080c2b5b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc01 expref: 8 pid: 15650 timeout: 599 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338846.692831:0:14368:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787338846.692835:0:14368:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787338846.692842:0:14368:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000efba33dc/0x83671231080c2b62 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc08 expref: 7 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338846.692852:0:14368:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000efba33dc/0x83671231080c2b62 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc08 expref: 7 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338846.692986:0:14368:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000efba33dc/0x83671231080c2b62 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc08 expref: 7 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338846.693056:0:14368:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbd17ec000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:14368:1874160212091776:192.168.201.53@tcp:105: 00000100:00100000:2.0:1787338846.693135:0:14368:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbf3c7fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787338846.696726:0:14368:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbd17ec000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:14368:1874160212091776:192.168.201.53@tcp:105: 00010000:00010000:2.0:1787338846.696753:0:14368:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787338846.696812:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee44c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f600308-4919-499d-be82-256c83420e0e+7:2359:x1874160192190976:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 4095us (4327us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338846.696823:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 16 00000100:00100000:0.0:1787338846.705378:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338846.707673:0:15069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192191104 00000100:00100000:3.0:1787338846.707689:0:15069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192191104 00002000:00100000:3.0:1787338846.707744:0:15069:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x22:0x0] (0->8) req@ffff90bbf7eaf100 x1874160192191104/t0(0) o4->4f600308-4919-499d-be82-256c83420e0e@192.168.201.53@tcp:177/0 lens 504/0 e 0 to 0 dl 1787338857 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:100 00002000:00100000:3.0:1787338846.707757:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90bbf7eaf100 with x1874160192191104 ext(0->8) 00002000:00010000:3.0:1787338846.707763:0:15069:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90bbf7eaf100 00000100:00100000:3.0:1787338846.707813:0:15069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 0 00000100:00100000:3.0:1787338846.707824:0:15069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf7eaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f600308-4919-499d-be82-256c83420e0e+7:2357:x1874160192191104:12345-192.168.201.53@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1787338846.708475:0:15069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf7eaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f600308-4919-499d-be82-256c83420e0e+9:2357:x1874160192191104:12345-192.168.201.53@tcp:4:lhsmtool_posix.0 Request processed in 648us (3100us total) trans 8589934595 rc 0/0 00000100:00100000:3.0:1787338846.708485:0:15069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 0 00002000:00100000:3.0:1787338846.708494:0:15069:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x22:0x0] (0->8) req@ffff90bbf7eaf100 x1874160192191104/t8589934595(0) o4->4f600308-4919-499d-be82-256c83420e0e@192.168.201.53@tcp:177/0 lens 504/448 e 0 to 0 dl 1787338857 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:100 00002000:00100000:3.0:1787338846.708503:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90bbf7eaf100 with x1874160192191104 ext(0->8) 00002000:00010000:3.0:1787338846.708507:0:15069:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90bbf7eaf100 00000100:00100000:0.0:1787338846.717205:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338846.717290:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192191232 00000100:00100000:3.0:1787338846.717300:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192191232 00000100:00100000:3.0:1787338846.717401:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 61 00000100:00100000:3.0:1787338846.717413:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf7eae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f600308-4919-499d-be82-256c83420e0e+41:14577:x1874160192191232:12345-192.168.201.53@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1787338846.798541:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934621 is committed 00000001:00080000:3.0:1787338846.798576:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934597 is committed 00000001:00080000:3.0:1787338846.798842:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934625 is committed 00000001:00080000:3.0:1787338846.798863:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934598 is committed 00000004:00080000:3.0:1787338846.799065:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:3.0:1787338846.799111:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:2.0:1787338846.799291:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787338846.799314:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbd17ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874160212091904:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1787338846.799397:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338846.799460:0:15650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212091904 00000100:00100000:2.0:1787338846.799467:0:15650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212091904 00000100:00100000:2.0:1787338846.799521:0:15650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787338846.799531:0:15650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbd17ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1874160212091904:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1787338846.799703:0:15650:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1787338846.799706:0:15650:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1787338846 00002000:00010000:2.0:1787338846.799709:0:15650:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787338846.799711:0:15650:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787338846 -> 1787338846 00002000:00010000:2.0:1787338846.799713:0:15650:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1787338846.799998:0:15650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbd17ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3315:x1874160212091904:12345-0@lo:2:osp-syn-0-0.0 Request processed in 466us (598us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1787338846.800006:0:15650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1787338846.800030:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1787338846.800065:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90bbd17ec000/2, rc 0, transno 8589934596 00000100:00100000:2.0:1787338846.800071:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbd17ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874160212091904:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787338846.800293:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf7eae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f600308-4919-499d-be82-256c83420e0e+13:14577:x1874160192191232:12345-192.168.201.53@tcp:44:lhsmtool_posix.0 Request processed in 82880us (83092us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338846.800303:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 61 00000100:00100000:0.0:1787338846.807318:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338846.807439:0:15066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192191360 00000100:00100000:2.0:1787338846.807450:0:15066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192191360 00000100:00100000:2.0:1787338846.807510:0:15066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 16 00000100:00100000:2.0:1787338846.807522:0:15066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf7ead500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f600308-4919-499d-be82-256c83420e0e+9:2358:x1874160192191360:12345-192.168.201.53@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1787338846.840516:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787338846.840540:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee44f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874160212092032:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787338846.840608:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338846.840669:0:15068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212092032 00000100:00100000:3.0:1787338846.840677:0:15068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212092032 00000100:00100000:3.0:1787338846.840732:0:15068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787338846.840741:0:15068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbedcb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1874160212092032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787338846.840762:0:15068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787338846.840803:0:15068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbedcb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1874160212092032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338846.840810:0:15068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787338846.840854:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee44f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874160212092032:0@lo:13:osp-pre-0-0.0 00000001:00080000:1.0:1787338846.901757:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934596 is committed 00000001:00080000:1.0:1787338846.901774:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00080000:1.0:1787338846.901783:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934595 is committed 00000100:00100000:0.0:1787338846.902038:0:15066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf7ead500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f600308-4919-499d-be82-256c83420e0e+6:2358:x1874160192191360:12345-192.168.201.53@tcp:16:lhsmtool_posix.0 Request processed in 94511us (94724us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338846.902049:0:15066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 16 00000100:00100000:2.0:1787338846.905296:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338846.905376:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192191616 00000100:00100000:3.0:1787338846.905388:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192191616 00000100:00100000:3.0:1787338846.905485:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 62 00000100:00100000:3.0:1787338846.905497:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbd17eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f600308-4919-499d-be82-256c83420e0e+13:14577:x1874160192191616:12345-192.168.201.53@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787338846.905552:0:14383:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787338846.905586:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045400/0x83671231080c2b54 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabbfa expref: 13 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338846.905605:0:14383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff90bbc2a93e00) 00010000:00010000:3.0:1787338846.905610:0:14383:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787338846.905638:0:14383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045000/0x83671231080c2b69 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338846.905652:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045000/0x83671231080c2b69 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338846.905662:0:14383:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045000/0x83671231080c2b69 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787338846.905903:0:14383:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fc232499 reply state 000000001532b65b transno 8589934626 ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045000/0x83671231080c2b69 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338846.906252:0:14383:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787338846.906374:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbd17eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f600308-4919-499d-be82-256c83420e0e+14:14577:x1874160192191616:12345-192.168.201.53@tcp:36:lhsmtool_posix.0 Request processed in 878us (1086us total) trans 8589934626 rc 0/0 00000100:00100000:3.0:1787338846.906382:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 62 00010000:00010000:2.0:1787338846.908496:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045000/0x83671231080c2b69 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338846.908513:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045000/0x83671231080c2b69 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338846.908528:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045000/0x83671231080c2b69 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338846.908535:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bc02045000 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:2.0:1787338846.908540:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045000/0x83671231080c2b69 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338846.908548:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045000/0x83671231080c2b69 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338846.908566:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff90bbc2a93e00) 00010000:00010000:2.0:1787338846.908569:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787338846.908574:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045000/0x83671231080c2b69 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338846.908580:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045000/0x83671231080c2b69 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338846.912438:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338846.912845:0:15650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192191744 00000100:00100000:1.0:1787338846.912855:0:15650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192191744 00000100:00100000:1.0:1787338846.913183:0:15650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 17 00000100:00100000:1.0:1787338846.913195:0:15650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbd17ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f600308-4919-499d-be82-256c83420e0e+6:2358:x1874160192191744:12345-192.168.201.53@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787338846.913479:0:15650:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1787338846.913483:0:15650:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1787338846 -> 1787338845 00002000:00010000:1.0:1787338846.913486:0:15650:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1787338844 00002000:00010000:1.0:1787338846.913488:0:15650:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787338846 -> 1787338845 00002000:00010000:1.0:1787338846.913490:0:15650:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1787338846.913568:0:15650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbd17ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f600308-4919-499d-be82-256c83420e0e+7:2358:x1874160192191744:12345-192.168.201.53@tcp:2:lhsmtool_posix.0 Request processed in 375us (1138us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1787338846.913578:0:15650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 17 00000100:00100000:3.0:1787338846.916483:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338846.916782:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192192000 00000100:00100000:1.0:1787338846.916792:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192192000 00000100:00100000:1.0:1787338846.917429:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 63 00000100:00100000:1.0:1787338846.917442:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbedcb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f600308-4919-499d-be82-256c83420e0e+13:14577:x1874160192192000:12345-192.168.201.53@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1787338846.917509:0:14381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c400/0x83671231080c2b70 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338846.917539:0:14381:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c2b38 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabbec expref: 13 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338846.917549:0:14381:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c400/0x83671231080c2b70 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338846.917586:0:14381:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c2b38 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabbec expref: 13 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338846.917601:0:14381:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c2b38 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabbec expref: 13 pid: 14382 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338846.917617:0:14381:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf4705c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14381:1874160212092160:192.168.201.53@tcp:104: 00000100:00100000:1.0:1787338846.917740:0:14381:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc674c000 going to sleep for 11 seconds 00000100:00100000:1.0:1787338846.921243:0:14381:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf4705c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14381:1874160212092160:192.168.201.53@tcp:104: 00010000:00010000:1.0:1787338846.921273:0:14381:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c400/0x83671231080c2b70 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338846.921577:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338846.922280:0:16493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192192128 00000100:00100000:1.0:1787338846.922288:0:16493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192192128 00010000:00010000:1.0:1787338846.922337:0:16493:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c2b38 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabbec expref: 14 pid: 14382 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338846.922379:0:16493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 17 00000100:00100000:1.0:1787338846.922389:0:16493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee44f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f600308-4919-499d-be82-256c83420e0e+14:2359:x1874160192192128:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787338846.922403:0:16493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787338846.922418:0:16493:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c2b38 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabbec expref: 14 pid: 14382 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338846.922430:0:16493:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c2b38 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabbec expref: 14 pid: 14382 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338846.922452:0:16493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c2b38 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabbec expref: 14 pid: 14382 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338846.922466:0:16493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff90bbc2a93e00) 00010000:00010000:1.0:1787338846.923013:0:16493:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c400/0x83671231080c2b70 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338846.923028:0:16493:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c400/0x83671231080c2b70 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338846.923035:0:16493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c400/0x83671231080c2b70 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338846.923100:0:16493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787338846.923176:0:16493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee44f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f600308-4919-499d-be82-256c83420e0e+13:2359:x1874160192192128:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 786us (1599us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338846.923185:0:16493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 17 00010000:00010000:1.0:1787338846.923188:0:14381:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c400/0x83671231080c2b70 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338846.923195:0:14381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c400/0x83671231080c2b70 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338846.923225:0:14381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c400/0x83671231080c2b70 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338846.923231:0:14381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c400/0x83671231080c2b70 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338846.923238:0:14381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c400/0x83671231080c2b70 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338846.923251:0:14381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbfbe9c400 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:1.0:1787338846.923256:0:14381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c400/0x83671231080c2b70 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338846.923263:0:14381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c400/0x83671231080c2b70 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338846.923278:0:14381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff90bbc2a93e00) 00010000:00010000:1.0:1787338846.923280:0:14381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787338846.923284:0:14381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c400/0x83671231080c2b70 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338846.923290:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c400/0x83671231080c2b70 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338846.923343:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbedcb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f600308-4919-499d-be82-256c83420e0e+12:14577:x1874160192192000:12345-192.168.201.53@tcp:55:lhsmtool_posix.0 Request processed in 5904us (6869us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787338846.923351:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 63 00000100:00100000:3.0:1787338846.928514:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338846.933177:0:15063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192192256 00000100:00100000:0.0:1787338846.933193:0:15063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192192256 00000100:00100000:0.0:1787338846.933268:0:15063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 18 00000100:00100000:0.0:1787338846.933279:0:15063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee083800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f600308-4919-499d-be82-256c83420e0e+7:2356:x1874160192192256:12345-192.168.201.53@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787338846.933347:0:15063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000049f56791/0x83671231080c2b77 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338846.933368:0:15063:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000efba33dc/0x83671231080c2b62 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc08 expref: 7 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338846.933378:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787338846.933382:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787338846.933387:0:15063:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000049f56791/0x83671231080c2b77 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338846.933425:0:15063:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000efba33dc/0x83671231080c2b62 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc08 expref: 7 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338846.933455:0:15063:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000efba33dc/0x83671231080c2b62 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc08 expref: 7 pid: 15063 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338846.933483:0:15063:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf7eace00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:15063:1874160212092288:192.168.201.53@tcp:104: 00000100:00100000:0.0:1787338846.933570:0:15063:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc2b9a180 going to sleep for 11 seconds 00000100:00100000:2.0:1787338846.948044:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338846.950512:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192192384 00000100:00100000:1.0:1787338846.950530:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192192384 00010000:00010000:1.0:1787338846.950584:0:14366:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000efba33dc/0x83671231080c2b62 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc08 expref: 8 pid: 15063 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338846.950636:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 18 00000100:00100000:1.0:1787338846.950647:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbd172bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f600308-4919-499d-be82-256c83420e0e+8:2359:x1874160192192384:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787338846.950662:0:14366:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787338846.950686:0:14366:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000efba33dc/0x83671231080c2b62 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc08 expref: 8 pid: 15063 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338846.950730:0:14366:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000efba33dc/0x83671231080c2b62 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc08 expref: 8 pid: 15063 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338846.950757:0:14366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787338846.950762:0:14366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787338846.950767:0:14366:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000049f56791/0x83671231080c2b77 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338846.950777:0:14366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000049f56791/0x83671231080c2b77 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338846.950801:0:14366:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787338846.950909:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbd172bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f600308-4919-499d-be82-256c83420e0e+8:2359:x1874160192192384:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 263us (2875us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338846.950926:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 18 00010000:00010000:3.0:1787338846.951321:0:15063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000efba33dc/0x83671231080c2b62 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc08 expref: 7 pid: 15063 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338846.951346:0:15063:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf7eace00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:15063:1874160212092288:192.168.201.53@tcp:104: 00010000:00010000:3.0:1787338846.951367:0:15063:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000049f56791/0x83671231080c2b77 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338846.951386:0:15063:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000049f56791/0x83671231080c2b77 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338846.951393:0:15063:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000049f56791/0x83671231080c2b77 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338846.951419:0:15063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000049f56791/0x83671231080c2b77 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338846.951428:0:15063:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000049f56791/0x83671231080c2b77 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338846.951437:0:15063:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000049f56791/0x83671231080c2b77 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338846.951443:0:15063:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbc0031800 already unused, calling callback (ffffffffc1546230) 00010000:00010000:3.0:1787338846.951448:0:15063:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000049f56791/0x83671231080c2b77 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338846.951458:0:15063:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000049f56791/0x83671231080c2b77 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338846.951470:0:15063:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000049f56791/0x83671231080c2b77 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338846.951490:0:15063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000049f56791/0x83671231080c2b77 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338846.951541:0:15063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee083800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f600308-4919-499d-be82-256c83420e0e+6:2356:x1874160192192256:12345-192.168.201.53@tcp:1:lhsmtool_posix.0 Request processed in 18263us (23039us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338846.951549:0:15063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 18 00000100:00100000:0.0:1787338846.961909:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338846.962115:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192192640 00000100:00100000:3.0:1787338846.962126:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192192640 00000100:00100000:3.0:1787338846.962188:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 64 00000100:00100000:3.0:1787338846.962200:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf7eac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f600308-4919-499d-be82-256c83420e0e+12:14577:x1874160192192640:12345-192.168.201.53@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787338846.962284:0:14383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045400/0x83671231080c2b7e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338846.962302:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045400/0x83671231080c2b7e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338846.962314:0:14383:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045400/0x83671231080c2b7e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338846.962607:0:14383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045e00/0x83671231080c2b85 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338846.962619:0:14383:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031a00/0x83671231080c2b46 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabbf3 expref: 13 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338846.962627:0:14383:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045e00/0x83671231080c2b85 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338846.962680:0:14383:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031a00/0x83671231080c2b46 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabbf3 expref: 13 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338846.962694:0:14383:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031a00/0x83671231080c2b46 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabbf3 expref: 13 pid: 14382 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338846.962709:0:14383:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc122680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14383:1874160212092416:192.168.201.53@tcp:104: 00000100:00100000:3.0:1787338846.962813:0:14383:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbedd6b9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787338846.987202:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338846.987253:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192192768 00000100:00100000:0.0:1787338846.987264:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192192768 00010000:00010000:0.0:1787338846.987312:0:14367:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031a00/0x83671231080c2b46 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabbf3 expref: 14 pid: 14382 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338846.987367:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 19 00000100:00100000:0.0:1787338846.987488:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf4705c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f600308-4919-499d-be82-256c83420e0e+14:2359:x1874160192192768:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787338846.987508:0:14367:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787338846.987516:0:14367:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031a00/0x83671231080c2b46 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabbf3 expref: 14 pid: 14382 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338846.987531:0:14367:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031a00/0x83671231080c2b46 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabbf3 expref: 14 pid: 14382 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338846.987553:0:14367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff90bbc2a93e00) 00010000:00010000:0.0:1787338846.987560:0:14367:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045e00/0x83671231080c2b85 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338846.987571:0:14367:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045e00/0x83671231080c2b85 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338846.987579:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045e00/0x83671231080c2b85 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338846.987628:0:14367:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787338846.987695:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf4705c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f600308-4919-499d-be82-256c83420e0e+14:2359:x1874160192192768:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 316us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338846.987704:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 19 00010000:00010000:3.0:1787338846.988131:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031a00/0x83671231080c2b46 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabbf3 expref: 13 pid: 14382 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338846.988151:0:14383:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc122680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14383:1874160212092416:192.168.201.53@tcp:104: 00010000:00010000:3.0:1787338846.988177:0:14383:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045e00/0x83671231080c2b85 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338846.988186:0:14383:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045e00/0x83671231080c2b85 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338846.988191:0:14383:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045e00/0x83671231080c2b85 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787338846.988503:0:14383:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934627 00000001:00080000:3.0:1787338846.989707:0:14383:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934628 00000001:00080000:3.0:1787338846.989770:0:14383:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934629 00000100:00100000:3.0:1787338846.989861:0:14383:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc122680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14383:1874160212092544:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787338846.989962:0:14383:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338846.990002:0:14383:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbedd6bc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787338846.990154:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212092544 00000100:00100000:1.0:1787338846.990162:0:14386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212092544 00000100:00100000:1.0:1787338846.990213:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787338846.990221:0:14386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc123800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:14383:x1874160212092544:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787338846.990305:0:14386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc123800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:14383:x1874160212092544:12345-0@lo:1000:mdt00_002.0 Request processed in 72us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338846.990314:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787338846.992902:0:14383:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934596 gen 2 00000004:00080000:3.0:1787338846.992913:0:14383:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90bbd17ec000, transno 8589934596 00000100:00100000:3.0:1787338846.992933:0:14383:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc122680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14383:1874160212092544:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1787338846.995041:0:14383:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934630 00000100:00100000:3.0:1787338846.995790:0:14383:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc122680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14383:1874160212092672:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787338846.995907:0:14383:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338846.995950:0:14383:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbedd6b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787338846.997536:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212092672 00000100:00100000:0.0:1787338846.997562:0:14386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212092672 00000100:00100000:0.0:1787338846.997621:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787338846.997633:0:14386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc120700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:14383:x1874160212092672:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787338846.997945:0:14386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc120700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14383:x1874160212092672:12345-0@lo:1000:mdt00_002.0 Request processed in 314us (2038us total) trans 8589934598 rc 0/0 00000100:00100000:0.0:1787338846.997954:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787338846.998154:0:14383:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc122680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14383:1874160212092672:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1787338846.998200:0:14383:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045e00/0x83671231080c2b85 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338846.998210:0:14383:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045e00/0x83671231080c2b85 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338846.998218:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045e00/0x83671231080c2b85 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338846.998224:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bc02045e00 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:3.0:1787338846.998229:0:14383:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045e00/0x83671231080c2b85 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338846.998236:0:14383:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045e00/0x83671231080c2b85 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338846.998253:0:14383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff90bbc2a93e00) 00010000:00010000:3.0:1787338846.998256:0:14383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787338846.998261:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045e00/0x83671231080c2b85 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338846.998267:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045e00/0x83671231080c2b85 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338846.998337:0:14383:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c200/0x83671231080c2ac1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338846.998344:0:14383:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c200/0x83671231080c2ac1 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338846.998351:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c200/0x83671231080c2ac1 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338846.998356:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbfbe9c200 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:3.0:1787338846.998360:0:14383:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c200/0x83671231080c2ac1 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338846.998366:0:14383:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c200/0x83671231080c2ac1 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338846.998375:0:14383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90bbc2a93000) 00010000:00010000:3.0:1787338846.998378:0:14383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787338846.998380:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c200/0x83671231080c2ac1 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338846.998387:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c200/0x83671231080c2ac1 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338846.998408:0:14383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02044c00/0x83671231080c2b8c lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338846.998422:0:14383:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031200/0x83671231080c2add lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabbd7 expref: 16 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338846.998431:0:14383:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02044c00/0x83671231080c2b8c lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338846.998469:0:14383:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031200/0x83671231080c2add lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabbd7 expref: 16 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338846.998484:0:14383:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031200/0x83671231080c2add lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabbd7 expref: 16 pid: 14382 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338846.998498:0:14383:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc120a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14383:1874160212092800:192.168.201.53@tcp:104: 00000100:00100000:3.0:1787338846.999762:0:14383:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbedd6b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787338847.005668:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338847.005735:0:14383:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc120a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14383:1874160212092800:192.168.201.53@tcp:104: 00010000:00010000:3.0:1787338847.005799:0:14383:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02044c00/0x83671231080c2b8c lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338847.006022:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192192896 00000100:00100000:1.0:1787338847.006029:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192192896 00010000:00010000:1.0:1787338847.006078:0:14366:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031200/0x83671231080c2add lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabbd7 expref: 17 pid: 14382 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338847.006143:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 20 00000100:00100000:2.0:1787338847.006156:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc120380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f600308-4919-499d-be82-256c83420e0e+17:2358:x1874160192192896:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787338847.006173:0:14368:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787338847.006183:0:14368:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031200/0x83671231080c2add lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabbd7 expref: 17 pid: 14382 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338847.006196:0:14368:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031200/0x83671231080c2add lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabbd7 expref: 17 pid: 14382 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338847.006230:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031200/0x83671231080c2add lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabbd7 expref: 17 pid: 14382 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338847.006246:0:14368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90bbc2a93000) 00010000:00010000:2.0:1787338847.006251:0:14368:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02044c00/0x83671231080c2b8c lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338847.006262:0:14368:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02044c00/0x83671231080c2b8c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338847.006269:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02044c00/0x83671231080c2b8c lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338847.006289:0:14368:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787338847.006357:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc120380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f600308-4919-499d-be82-256c83420e0e+16:2358:x1874160192192896:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 204us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338847.006366:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 20 00010000:00010000:3.0:1787338847.006828:0:14383:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02044c00/0x83671231080c2b8c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338847.006838:0:14383:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02044c00/0x83671231080c2b8c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338847.006850:0:14383:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02044c00/0x83671231080c2b8c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338847.006857:0:14383:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02044c00/0x83671231080c2b8c lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338847.006864:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02044c00/0x83671231080c2b8c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338847.006870:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bc02044c00 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:3.0:1787338847.007253:0:14383:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02044c00/0x83671231080c2b8c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338847.007263:0:14383:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02044c00/0x83671231080c2b8c lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338847.007280:0:14383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90bbc2a93000) 00010000:00010000:3.0:1787338847.007283:0:14383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787338847.007287:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02044c00/0x83671231080c2b8c lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338847.007305:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02044c00/0x83671231080c2b8c lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338847.007332:0:14383:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045400/0x83671231080c2b7e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338847.007339:0:14383:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045400/0x83671231080c2b7e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338847.007345:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045400/0x83671231080c2b7e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338847.007351:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bc02045400 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:3.0:1787338847.007354:0:14383:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045400/0x83671231080c2b7e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338847.007360:0:14383:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045400/0x83671231080c2b7e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338847.007368:0:14383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90bbc2a93000) 00010000:00010000:3.0:1787338847.007370:0:14383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787338847.007382:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045400/0x83671231080c2b7e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338847.007388:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045400/0x83671231080c2b7e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338847.007761:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf7eac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f600308-4919-499d-be82-256c83420e0e+15:14577:x1874160192192640:12345-192.168.201.53@tcp:57:lhsmtool_posix.0 Request processed in 45559us (45895us total) trans 8589934631 rc 0/0 00000100:00100000:2.0:1787338847.007771:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 64 00000020:00080000:2.0:1787338847.007775:0:14383:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1787338847.008034:0:14412:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787338847.008038:0:14412:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787338847.008064:0:14412:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1787338847.008070:0:14412:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1787338847.011935:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338847.021754:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192193152 00000100:00100000:0.0:1787338847.021773:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192193152 00000100:00100000:0.0:1787338847.022020:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 14 00000100:00100000:0.0:1787338847.022033:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc120a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f600308-4919-499d-be82-256c83420e0e+15:14577:x1874160192193152:12345-192.168.201.53@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1787338847.022829:0:14384:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787338847.023097:0:14384:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934632 00010000:00010000:0.0:1787338847.023157:0:14384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c2b93 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338847.023177:0:14384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c2b93 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338847.023202:0:14384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c2b93 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338847.023212:0:14384:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c2b93 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338847.023219:0:14384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c2b93 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338847.023224:0:14384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c2b93 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338847.023250:0:14384:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787338847.024336:0:14369:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787338847.024348:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c2b93 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338847.024357:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbc0030800 already unused, calling callback (ffffffffc1546230) 00010000:00010000:1.0:1787338847.024362:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c2b93 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338847.024370:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c2b93 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338847.024396:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff90bbeb14d100) 00010000:00010000:1.0:1787338847.024400:0:14369:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787338847.024405:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c2b93 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338847.024412:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c2b93 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338847.024437:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338847.024439:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338847.024441:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787338847.030476:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc120a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f600308-4919-499d-be82-256c83420e0e+17:14577:x1874160192193152:12345-192.168.201.53@tcp:35:lhsmtool_posix.0 Request processed in 8430us (18535us total) trans 8589934633 rc 0/0 00000100:00100000:0.0:1787338847.030497:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 14 00000020:00080000:0.0:1787338847.030506:0:14384:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787338847.164363:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787338847.452418:0:16646:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787338847.452429:0:16646:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787338847.452471:0:16646:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1787338847.452478:0:16646:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1787338847.694795:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338847.697951:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192193408 00000100:00100000:3.0:1787338847.697965:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192193408 00000100:00100000:2.0:1787338847.700419:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 65 00000100:00100000:2.0:1787338847.700435:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf7eadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f600308-4919-499d-be82-256c83420e0e+17:14587:x1874160192193408:12345-192.168.201.53@tcp:101:lfs.0 00010000:00010000:2.0:1787338847.700461:0:14381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787338847.700482:0:14381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2e00/0x83671231080c2b9a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadabc0f expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787338847.700767:0:14381:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1787338847.700977:0:14381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2e00/0x83671231080c2b9a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc0f expref: 19 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338847.700993:0:14381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90bbc2a93100) 00010000:00010000:2.0:1787338847.700996:0:14381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787338847.701002:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2e00/0x83671231080c2b9a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc0f expref: 19 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338847.701017:0:14381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf40e2e00, rc 0) 00000100:00100000:2.0:1787338847.701088:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf7eadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f600308-4919-499d-be82-256c83420e0e+18:14587:x1874160192193408:12345-192.168.201.53@tcp:101:lfs.0 Request processed in 657us (6300us total) trans 8589934634 rc 301/301 00000100:00100000:2.0:1787338847.701096:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 65 00000100:00100000:0.0:1787338847.705790:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338847.705841:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192193536 00000100:00100000:2.0:1787338847.705854:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192193536 00000100:00100000:2.0:1787338847.706099:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 66 00000100:00100000:2.0:1787338847.706109:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf7eadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f600308-4919-499d-be82-256c83420e0e+18:14587:x1874160192193536:12345-192.168.201.53@tcp:34:lfs.0 00010000:00010000:2.0:1787338847.706382:0:14383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3600/0x83671231080c2ba8 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338847.706401:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3600/0x83671231080c2ba8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338847.706412:0:14383:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3600/0x83671231080c2ba8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338847.706426:0:14383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2000/0x83671231080c2baf lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338847.706439:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2000/0x83671231080c2baf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338847.706446:0:14383:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2000/0x83671231080c2baf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338847.708075:0:14383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2e00/0x83671231080c2bb6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338847.708090:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2e00/0x83671231080c2bb6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338847.708101:0:14383:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2e00/0x83671231080c2bb6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787338847.708336:0:14383:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2e00/0x83671231080c2bb6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338847.708352:0:14383:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3600/0x83671231080c2ba8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338847.708359:0:14383:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3600/0x83671231080c2ba8 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338847.708366:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3600/0x83671231080c2ba8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338847.708373:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e3600 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:2.0:1787338847.708377:0:14383:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3600/0x83671231080c2ba8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338847.708386:0:14383:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3600/0x83671231080c2ba8 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338847.708408:0:14383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90bbc2a93400) 00010000:00010000:2.0:1787338847.708411:0:14383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787338847.708417:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3600/0x83671231080c2ba8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338847.708423:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3600/0x83671231080c2ba8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338847.708440:0:14383:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2000/0x83671231080c2baf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338847.708446:0:14383:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2000/0x83671231080c2baf lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338847.708452:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2000/0x83671231080c2baf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338847.708457:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e2000 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:2.0:1787338847.708460:0:14383:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2000/0x83671231080c2baf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338847.708465:0:14383:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2000/0x83671231080c2baf lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338847.708473:0:14383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff90bbc8283d00) 00010000:00010000:2.0:1787338847.708475:0:14383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787338847.708478:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2000/0x83671231080c2baf lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338847.708484:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2000/0x83671231080c2baf lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338847.708511:0:14383:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2e00/0x83671231080c2bb6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338847.708517:0:14383:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2e00/0x83671231080c2bb6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338847.708523:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2e00/0x83671231080c2bb6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338847.708529:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e2e00 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:2.0:1787338847.708532:0:14383:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2e00/0x83671231080c2bb6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338847.708538:0:14383:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2e00/0x83671231080c2bb6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338847.708546:0:14383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90bbc8283c00) 00010000:00010000:2.0:1787338847.708548:0:14383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787338847.708551:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2e00/0x83671231080c2bb6 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338847.708557:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2e00/0x83671231080c2bb6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338847.708673:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf7eadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f600308-4919-499d-be82-256c83420e0e+18:14587:x1874160192193536:12345-192.168.201.53@tcp:34:lfs.0 Request processed in 2560us (2886us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338847.708683:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 66 00000100:00100000:1.0:1787338847.711496:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338847.711597:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192193792 00000100:00100000:3.0:1787338847.711607:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192193792 00000100:00100000:3.0:1787338847.711664:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 15 00000100:00100000:3.0:1787338847.711676:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf4706300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f600308-4919-499d-be82-256c83420e0e+18:14587:x1874160192193792:12345-192.168.201.53@tcp:35:lfs.0 00000100:00100000:3.0:1787338847.712415:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf4706300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f600308-4919-499d-be82-256c83420e0e+19:14587:x1874160192193792:12345-192.168.201.53@tcp:35:lfs.0 Request processed in 737us (925us total) trans 8589934635 rc 0/0 00000100:00100000:3.0:1787338847.712426:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 15 00000100:00100000:0.0:1787338847.786825:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338847.786925:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192194048 00000100:00100000:3.0:1787338847.786937:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192194048 00000100:00100000:2.0:1787338847.787739:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 67 00000100:00100000:2.0:1787338847.787753:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf7eaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f600308-4919-499d-be82-256c83420e0e+19:14590:x1874160192194048:12345-192.168.201.53@tcp:101:lfs.0 00010000:00010000:2.0:1787338847.787792:0:14382:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787338847.787811:0:14382:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2e00/0x83671231080c2bbd lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadabc16 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338847.787923:0:14382:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2000/0x83671231080c2bc4 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338847.787938:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2000/0x83671231080c2bc4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338847.787948:0:14382:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2000/0x83671231080c2bc4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338847.787963:0:14382:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3600/0x83671231080c2bcb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338847.787971:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3600/0x83671231080c2bcb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338847.787978:0:14382:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3600/0x83671231080c2bcb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338847.788808:0:14382:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3800/0x83671231080c2bd2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338847.788819:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3800/0x83671231080c2bd2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338847.788827:0:14382:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3800/0x83671231080c2bd2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787338847.788836:0:14382:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 9 00010000:00010000:2.0:1787338847.788997:0:14382:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2000/0x83671231080c2bc4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338847.789005:0:14382:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2000/0x83671231080c2bc4 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338847.789011:0:14382:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2000/0x83671231080c2bc4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338847.789018:0:14382:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e2000 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:2.0:1787338847.789022:0:14382:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2000/0x83671231080c2bc4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338847.789030:0:14382:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2000/0x83671231080c2bc4 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338847.789044:0:14382:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90bbc2a93400) 00010000:00010000:2.0:1787338847.789047:0:14382:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787338847.789052:0:14382:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2000/0x83671231080c2bc4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338847.789057:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2000/0x83671231080c2bc4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338847.789074:0:14382:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3600/0x83671231080c2bcb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338847.789080:0:14382:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3600/0x83671231080c2bcb lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338847.789087:0:14382:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3600/0x83671231080c2bcb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338847.789104:0:14382:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e3600 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:2.0:1787338847.789108:0:14382:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3600/0x83671231080c2bcb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338847.789114:0:14382:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3600/0x83671231080c2bcb lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338847.789123:0:14382:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff90bbc8283c00) 00010000:00010000:2.0:1787338847.789125:0:14382:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787338847.789128:0:14382:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3600/0x83671231080c2bcb lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338847.789134:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3600/0x83671231080c2bcb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338847.789842:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2e00/0x83671231080c2bbd lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc16 expref: 22 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338847.789862:0:14382:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3800/0x83671231080c2bd2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc16 expref: 21 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338847.789869:0:14382:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90bbc8283d00) 00010000:00010000:2.0:1787338847.789927:0:14382:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787338847.789930:0:14382:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf40e3800, rc 0) 00000100:00100000:2.0:1787338847.790005:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf7eaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f600308-4919-499d-be82-256c83420e0e+21:14590:x1874160192194048:12345-192.168.201.53@tcp:101:lfs.0 Request processed in 2255us (3191us total) trans 8589934636 rc 0/0 00000100:00100000:2.0:1787338847.790014:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 67 00000100:00100000:0.0:1787338847.796568:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338847.796665:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192194176 00000100:00100000:2.0:1787338847.796690:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192194176 00000100:00100000:2.0:1787338847.796761:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 68 00000100:00100000:2.0:1787338847.796771:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf7eaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f600308-4919-499d-be82-256c83420e0e+21:14590:x1874160192194176:12345-192.168.201.53@tcp:54:lfs.0 00010000:00010000:2.0:1787338847.796836:0:14383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2e00/0x83671231080c2be0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338847.796852:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2e00/0x83671231080c2be0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338847.796863:0:14383:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2e00/0x83671231080c2be0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338847.796932:0:14383:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2e00/0x83671231080c2be0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338847.796940:0:14383:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2e00/0x83671231080c2be0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338847.796947:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2e00/0x83671231080c2be0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338847.796953:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e2e00 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:2.0:1787338847.796958:0:14383:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2e00/0x83671231080c2be0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338847.796965:0:14383:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2e00/0x83671231080c2be0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338847.796979:0:14383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90bbc8283d00) 00010000:00010000:2.0:1787338847.796982:0:14383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787338847.796986:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2e00/0x83671231080c2be0 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338847.797003:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2e00/0x83671231080c2be0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338847.797084:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf7eaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f600308-4919-499d-be82-256c83420e0e+21:14590:x1874160192194176:12345-192.168.201.53@tcp:54:lfs.0 Request processed in 313us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338847.797090:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 68 00000100:00100000:1.0:1787338847.801995:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338847.802094:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192194432 00000100:00100000:0.0:1787338847.802104:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192194432 00000100:00100000:0.0:1787338847.802250:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 16 00000100:00100000:0.0:1787338847.802262:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbff8f1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f600308-4919-499d-be82-256c83420e0e+21:14590:x1874160192194432:12345-192.168.201.53@tcp:35:lfs.0 00000100:00100000:0.0:1787338847.802557:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbff8f1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f600308-4919-499d-be82-256c83420e0e+22:14590:x1874160192194432:12345-192.168.201.53@tcp:35:lfs.0 Request processed in 295us (570us total) trans 8589934637 rc 0/0 00000100:00100000:0.0:1787338847.802564:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 16 00000100:00100000:0.0:1787338847.853624:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338847.853700:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192194688 00000100:00100000:2.0:1787338847.853709:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192194688 00000100:00100000:2.0:1787338847.853763:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 69 00000100:00100000:2.0:1787338847.853772:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf7eafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f600308-4919-499d-be82-256c83420e0e+22:12118:x1874160192194688:12345-192.168.201.53@tcp:101:bash.0 00010000:00010000:2.0:1787338847.853795:0:14381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787338847.853815:0:14381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2e00/0x83671231080c2be7 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadabc1d expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338847.853948:0:14381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2000/0x83671231080c2bee lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338847.853963:0:14381:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3800/0x83671231080c2bd2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc16 expref: 23 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338847.853972:0:14381:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2000/0x83671231080c2bee lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338847.854005:0:14381:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3800/0x83671231080c2bd2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc16 expref: 23 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338847.854018:0:14381:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3800/0x83671231080c2bd2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc16 expref: 23 pid: 14382 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338847.854051:0:14381:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbd17ec000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14381:1874160212092928:192.168.201.53@tcp:104: 00000100:00100000:2.0:1787338847.854138:0:14381:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbf3c7fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787338847.860595:0:14381:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbd17ec000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14381:1874160212092928:192.168.201.53@tcp:104: 00010000:00010000:0.0:1787338847.860627:0:14381:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2000/0x83671231080c2bee lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338847.861714:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338847.862024:0:16493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192194816 00000100:00100000:1.0:1787338847.862033:0:16493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192194816 00010000:00010000:1.0:1787338847.862077:0:16493:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3800/0x83671231080c2bd2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc16 expref: 24 pid: 14382 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338847.862141:0:16493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 21 00000100:00100000:1.0:1787338847.862165:0:16493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf7eace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f600308-4919-499d-be82-256c83420e0e+24:2359:x1874160192194816:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787338847.862181:0:16493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787338847.862189:0:16493:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3800/0x83671231080c2bd2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc16 expref: 24 pid: 14382 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338847.862203:0:16493:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3800/0x83671231080c2bd2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc16 expref: 24 pid: 14382 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338847.862226:0:16493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3800/0x83671231080c2bd2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc16 expref: 24 pid: 14382 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338847.862246:0:16493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90bbc8283d00) 00010000:00010000:1.0:1787338847.862251:0:16493:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2000/0x83671231080c2bee lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338847.862261:0:16493:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2000/0x83671231080c2bee lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338847.862268:0:16493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2000/0x83671231080c2bee lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338847.862299:0:16493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787338847.862529:0:16493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf7eace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f600308-4919-499d-be82-256c83420e0e+23:2359:x1874160192194816:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 378us (830us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338847.862538:0:16493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 21 00010000:00010000:2.0:1787338847.863522:0:14381:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2000/0x83671231080c2bee lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338847.863534:0:14381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2000/0x83671231080c2bee lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787338847.863554:0:14381:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 9 00010000:00010000:2.0:1787338847.863727:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2e00/0x83671231080c2be7 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc1d expref: 24 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338847.863747:0:14381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2000/0x83671231080c2bee lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc1d expref: 23 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338847.863754:0:14381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90bbc8283d00) 00010000:00010000:2.0:1787338847.863757:0:14381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787338847.863760:0:14381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf40e2000, rc 0) 00000100:00100000:2.0:1787338847.863803:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf7eafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f600308-4919-499d-be82-256c83420e0e+23:12118:x1874160192194688:12345-192.168.201.53@tcp:101:bash.0 Request processed in 10031us (10189us total) trans 8589934638 rc 0/0 00000100:00100000:2.0:1787338847.863810:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 69 00000100:00100000:0.0:1787338847.866982:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338847.867248:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192195072 00000100:00100000:2.0:1787338847.867259:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192195072 00000100:00100000:2.0:1787338847.867331:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 70 00000100:00100000:2.0:1787338847.867345:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf7eac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f600308-4919-499d-be82-256c83420e0e+23:12118:x1874160192195072:12345-192.168.201.53@tcp:36:bash.0 00010000:00010000:2.0:1787338847.867669:0:14382:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c2bfc lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338847.867699:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c2bfc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338847.867709:0:14382:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c2bfc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787338847.867767:0:14382:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934639 00000004:00010000:2.0:1787338847.867793:0:14382:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000090d3d681 reply state 000000008f29c9a0 transno 8589934640 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c2bfc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338847.867801:0:14382:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1787338847.867916:0:14382:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934640 00000100:00100000:2.0:1787338847.868023:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf7eac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f600308-4919-499d-be82-256c83420e0e+27:12118:x1874160192195072:12345-192.168.201.53@tcp:36:bash.0 Request processed in 679us (1048us total) trans 8589934641 rc 0/0 00000100:00100000:2.0:1787338847.868030:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 70 00000020:00080000:2.0:1787338847.868035:0:14382:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1787338847.870854:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c2bfc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338847.870895:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c2bfc lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338847.870904:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c2bfc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338847.870911:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e2c00 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:3.0:1787338847.870916:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c2bfc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338847.870943:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c2bfc lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338847.870960:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90bbc8283d00) 00010000:00010000:3.0:1787338847.870964:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787338847.870969:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c2bfc lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338847.870975:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c2bfc lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338847.871490:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338847.871662:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192195200 00000100:00100000:2.0:1787338847.871673:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192195200 00000100:00100000:2.0:1787338847.871730:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 71 00000100:00100000:2.0:1787338847.871740:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbe8199500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f600308-4919-499d-be82-256c83420e0e+26:12118:x1874160192195200:12345-192.168.201.53@tcp:101:bash.0 00010000:00010000:2.0:1787338847.871763:0:14381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787338847.871781:0:14381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c2c03 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadabc24 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338847.871837:0:14381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c2c03 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc24 expref: 27 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338847.871851:0:14381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c2c03 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc24 expref: 27 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338847.871927:0:14381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90bbc8283d00) 00010000:00010000:2.0:1787338847.871931:0:14381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787338847.871934:0:14381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf40e3200, rc 0) 00000100:00100000:2.0:1787338847.871985:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbe8199500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f600308-4919-499d-be82-256c83420e0e+27:12118:x1874160192195200:12345-192.168.201.53@tcp:101:bash.0 Request processed in 245us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338847.871993:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 71 00000100:00100000:0.0:1787338847.877132:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338847.877270:0:15650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192195328 00000100:00100000:1.0:1787338847.877294:0:15650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192195328 00000100:00100000:1.0:1787338847.877373:0:15650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 19 00000100:00100000:1.0:1787338847.877385:0:15650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbe8198e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f600308-4919-499d-be82-256c83420e0e+6:12118:x1874160192195328:12345-192.168.201.53@tcp:101:bash.0 00010000:00010000:1.0:1787338847.877404:0:15650:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787338847.877427:0:15650:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004ba203ef/0x83671231080c2c0a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadabc2b expref: -99 pid: 15650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787338847.877455:0:15650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 9, mtime: 0x6a88a05d, atime: 0x6a88a05c, ctime: 0x6a88a05d, blocks: 0xb 00010000:00010000:1.0:1787338847.877477:0:15650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=500s v=(0 0) 00010000:00010000:1.0:1787338847.877482:0:15650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787338847.877490:0:15650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004ba203ef/0x83671231080c2c0a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc2b expref: 7 pid: 15650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338847.877508:0:15650:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004ba203ef/0x83671231080c2c0a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc2b expref: 7 pid: 15650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338847.877520:0:15650:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbfbe9d600, rc 0) 00000100:00100000:1.0:1787338847.877579:0:15650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbe8198e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f600308-4919-499d-be82-256c83420e0e+7:12118:x1874160192195328:12345-192.168.201.53@tcp:101:bash.0 Request processed in 196us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338847.877586:0:15650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 19 00000100:00080000:2.0:1787338847.879052:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787338847.886524:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338847.886658:0:15071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192195456 00000100:00100000:2.0:1787338847.886668:0:15071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192195456 00002000:00010000:2.0:1787338847.886705:0:15071:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/34 (0->18446744073709551615) 00002000:00100000:2.0:1787338847.886710:0:15071:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90bbf4705f80 with x1874160192195456 ext(0->18446744073709551615) 00002000:00010000:2.0:1787338847.886722:0:15071:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90bbf4705f80. 00000100:00100000:2.0:1787338847.886755:0:15071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 1 00000100:00100000:2.0:1787338847.886766:0:15071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf4705f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f600308-4919-499d-be82-256c83420e0e+7:2358:x1874160192195456:12345-192.168.201.53@tcp:10:bash.0 00002000:00010000:2.0:1787338847.887164:0:15071:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1787338847.887169:0:15071:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1787338845 -> 1787338847 00002000:00010000:2.0:1787338847.888288:0:15071:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 1787338844 -> 1787338844 00002000:00010000:2.0:1787338847.888291:0:15071:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787338845 -> 1787338847 00002000:00010000:2.0:1787338847.888294:0:15071:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1787338847.888410:0:15071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf4705f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f600308-4919-499d-be82-256c83420e0e+8:2358:x1874160192195456:12345-192.168.201.53@tcp:10:bash.0 Request processed in 1641us (1893us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1787338847.888422:0:15071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 1 00002000:00010000:2.0:1787338847.888428:0:15071:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/34 (0->18446744073709551615) 00002000:00100000:2.0:1787338847.888431:0:15071:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90bbf4705f80 with x1874160192195456 ext(0->18446744073709551615) 00002000:00010000:2.0:1787338847.888452:0:15071:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90bbf4705f80. 00000100:00100000:0.0:1787338847.960716:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338847.960786:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192195712 00000100:00100000:3.0:1787338847.960798:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192195712 00000100:00100000:3.0:1787338847.961041:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 72 00000100:00100000:3.0:1787338847.961053:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbe8198000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f600308-4919-499d-be82-256c83420e0e+27:14604:x1874160192195712:12345-192.168.201.53@tcp:101:lfs.0 00010000:00010000:3.0:1787338847.961074:0:14383:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787338847.961094:0:14383:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045400/0x83671231080c2c11 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadabc32 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338847.961595:0:14383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02044c00/0x83671231080c2c18 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338847.961611:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02044c00/0x83671231080c2c18 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338847.961622:0:14383:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02044c00/0x83671231080c2c18 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787338847.961634:0:14383:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 7680 00010000:00010000:3.0:1787338847.961824:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045400/0x83671231080c2c11 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc32 expref: 30 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338847.961854:0:14383:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02044c00/0x83671231080c2c18 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc32 expref: 29 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338847.961862:0:14383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90bbc2a93400) 00010000:00010000:3.0:1787338847.961865:0:14383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787338847.961868:0:14383:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bc02044c00, rc 0) 00000100:00100000:3.0:1787338847.961980:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbe8198000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f600308-4919-499d-be82-256c83420e0e+29:14604:x1874160192195712:12345-192.168.201.53@tcp:101:lfs.0 Request processed in 928us (1279us total) trans 8589934642 rc 0/0 00000100:00100000:3.0:1787338847.961987:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 72 00000100:00100000:0.0:1787338847.965296:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338847.965529:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192195840 00000100:00100000:2.0:1787338847.965539:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192195840 00000100:00100000:2.0:1787338847.965685:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 73 00000100:00100000:2.0:1787338847.965696:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbe8199c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f600308-4919-499d-be82-256c83420e0e+29:14604:x1874160192195840:12345-192.168.201.53@tcp:34:lfs.0 00010000:00010000:2.0:1787338847.965783:0:14382:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2e00/0x83671231080c2c26 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338847.965801:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2e00/0x83671231080c2c26 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338847.965810:0:14382:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2e00/0x83671231080c2c26 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338847.965820:0:14382:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c2c2d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338847.965825:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c2c2d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338847.965829:0:14382:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c2c2d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338847.966124:0:14382:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c2c34 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338847.966132:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c2c34 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338847.966136:0:14382:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c2c34 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787338847.966417:0:14382:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c2c34 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338847.966430:0:14382:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2e00/0x83671231080c2c26 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338847.966437:0:14382:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2e00/0x83671231080c2c26 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338847.966444:0:14382:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2e00/0x83671231080c2c26 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338847.966450:0:14382:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e2e00 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:2.0:1787338847.966454:0:14382:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2e00/0x83671231080c2c26 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338847.966461:0:14382:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2e00/0x83671231080c2c26 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338847.966473:0:14382:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90bbc2a93400) 00010000:00010000:2.0:1787338847.966476:0:14382:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787338847.966481:0:14382:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2e00/0x83671231080c2c26 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338847.966487:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2e00/0x83671231080c2c26 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338847.966503:0:14382:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c2c2d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338847.966509:0:14382:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c2c2d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338847.966522:0:14382:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c2c2d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338847.966527:0:14382:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e2600 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:2.0:1787338847.966530:0:14382:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c2c2d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338847.966535:0:14382:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c2c2d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338847.966543:0:14382:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff90bbc8283c00) 00010000:00010000:2.0:1787338847.966546:0:14382:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787338847.966549:0:14382:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c2c2d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338847.966554:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c2c2d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338847.966570:0:14382:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c2c34 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338847.966577:0:14382:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c2c34 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338847.966583:0:14382:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c2c34 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338847.966587:0:14382:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e2c00 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:2.0:1787338847.966590:0:14382:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c2c34 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338847.966607:0:14382:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c2c34 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338847.966615:0:14382:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90bbc8283d00) 00010000:00010000:2.0:1787338847.966618:0:14382:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787338847.966621:0:14382:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c2c34 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338847.966626:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2c00/0x83671231080c2c34 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338847.966758:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbe8199c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f600308-4919-499d-be82-256c83420e0e+29:14604:x1874160192195840:12345-192.168.201.53@tcp:34:lfs.0 Request processed in 1063us (1472us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338847.966767:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 73 00000100:00100000:1.0:1787338848.014741:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338848.014902:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192196096 00000100:00100000:3.0:1787338848.014913:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192196096 00000100:00100000:3.0:1787338848.014993:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 74 00000100:00100000:3.0:1787338848.015005:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf4706a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f600308-4919-499d-be82-256c83420e0e+29:14607:x1874160192196096:12345-192.168.201.53@tcp:101:lfs.0 00010000:00010000:3.0:1787338848.015025:0:14383:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787338848.015048:0:14383:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045400/0x83671231080c2c3b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadabc39 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338848.015138:0:14383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045e00/0x83671231080c2c42 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338848.015153:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045e00/0x83671231080c2c42 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338848.015165:0:14383:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045e00/0x83671231080c2c42 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338848.015179:0:14383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02044e00/0x83671231080c2c49 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338848.015197:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02044e00/0x83671231080c2c49 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338848.015204:0:14383:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02044e00/0x83671231080c2c49 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338848.015582:0:14383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045000/0x83671231080c2c50 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338848.015593:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045000/0x83671231080c2c50 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338848.015600:0:14383:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045000/0x83671231080c2c50 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787338848.015611:0:14383:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1787338848.015940:0:14383:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045e00/0x83671231080c2c42 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338848.015947:0:14383:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045e00/0x83671231080c2c42 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338848.015953:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045e00/0x83671231080c2c42 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338848.015958:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bc02045e00 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:3.0:1787338848.015962:0:14383:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045e00/0x83671231080c2c42 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338848.015968:0:14383:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045e00/0x83671231080c2c42 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338848.015990:0:14383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90bbc2a93400) 00010000:00010000:3.0:1787338848.015993:0:14383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787338848.015997:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045e00/0x83671231080c2c42 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338848.016003:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045e00/0x83671231080c2c42 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338848.016015:0:14383:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02044e00/0x83671231080c2c49 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338848.016021:0:14383:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02044e00/0x83671231080c2c49 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338848.016054:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02044e00/0x83671231080c2c49 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338848.016059:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bc02044e00 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:3.0:1787338848.016062:0:14383:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02044e00/0x83671231080c2c49 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338848.016068:0:14383:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02044e00/0x83671231080c2c49 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338848.016075:0:14383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff90bbc9a99f00) 00010000:00010000:3.0:1787338848.016077:0:14383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787338848.016080:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02044e00/0x83671231080c2c49 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338848.016086:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02044e00/0x83671231080c2c49 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338848.016302:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045400/0x83671231080c2c3b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc39 expref: 32 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338848.016329:0:14383:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045000/0x83671231080c2c50 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc39 expref: 31 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338848.016337:0:14383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90bbc8283d00) 00010000:00010000:3.0:1787338848.016340:0:14383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787338848.016342:0:14383:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bc02045000, rc 0) 00000100:00080000:2.0:1787338848.016492:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787338848.016580:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf4706a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f600308-4919-499d-be82-256c83420e0e+31:14607:x1874160192196096:12345-192.168.201.53@tcp:101:lfs.0 Request processed in 1576us (1847us total) trans 8589934643 rc 0/0 00000100:00100000:3.0:1787338848.016589:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 74 00000100:00100000:0.0:1787338848.019925:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338848.020098:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192196224 00000100:00100000:3.0:1787338848.020117:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192196224 00000100:00100000:3.0:1787338848.020168:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 75 00000100:00100000:3.0:1787338848.020178:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbe8199f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f600308-4919-499d-be82-256c83420e0e+31:14607:x1874160192196224:12345-192.168.201.53@tcp:54:lfs.0 00010000:00010000:3.0:1787338848.020246:0:14382:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5a00/0x83671231080c2c5e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338848.020262:0:14382:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2000/0x83671231080c2bee lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc1d expref: 31 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338848.020273:0:14382:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5a00/0x83671231080c2c5e lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338848.020317:0:14382:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2000/0x83671231080c2bee lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc1d expref: 31 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338848.020354:0:14382:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2000/0x83671231080c2bee lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc1d expref: 31 pid: 14381 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338848.020381:0:14382:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc121180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14382:1874160212093056:192.168.201.53@tcp:104: 00000100:00100000:3.0:1787338848.020474:0:14382:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbedd6b480 going to sleep for 11 seconds 00000100:00100000:2.0:1787338848.023169:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338848.023269:0:14382:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc121180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14382:1874160212093056:192.168.201.53@tcp:104: 00010000:00010000:3.0:1787338848.023298:0:14382:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5a00/0x83671231080c2c5e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338848.029145:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192196480 00000100:00100000:0.0:1787338848.029162:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192196480 00000100:00100000:0.0:1787338848.029237:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 17 00000100:00100000:0.0:1787338848.029249:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbd17ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f600308-4919-499d-be82-256c83420e0e+32:13749:x1874160192196480:12345-192.168.201.53@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787338848.029616:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbd17ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f600308-4919-499d-be82-256c83420e0e+33:13749:x1874160192196480:12345-192.168.201.53@tcp:35:ldlm_bl.0 Request processed in 368us (6454us total) trans 8589934644 rc 0/0 00000100:00100000:0.0:1787338848.029625:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 17 00000100:00100000:1.0:1787338848.032847:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338848.032985:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192196608 00000100:00100000:2.0:1787338848.032994:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192196608 00010000:00010000:2.0:1787338848.033026:0:14368:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2000/0x83671231080c2bee lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc1d expref: 33 pid: 14381 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338848.033062:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 22 00000100:00100000:2.0:1787338848.033069:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf4706680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f600308-4919-499d-be82-256c83420e0e+33:2359:x1874160192196608:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787338848.033081:0:14368:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787338848.033086:0:14368:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2000/0x83671231080c2bee lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc1d expref: 33 pid: 14381 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338848.033095:0:14368:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2000/0x83671231080c2bee lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc1d expref: 33 pid: 14381 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338848.033131:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2000/0x83671231080c2bee lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc1d expref: 33 pid: 14381 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338848.033144:0:14368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90bbc8283d00) 00010000:00010000:2.0:1787338848.033149:0:14368:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5a00/0x83671231080c2c5e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338848.033158:0:14368:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5a00/0x83671231080c2c5e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338848.033166:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5a00/0x83671231080c2c5e lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338848.033203:0:14368:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787338848.033256:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf4706680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f600308-4919-499d-be82-256c83420e0e+32:2359:x1874160192196608:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 186us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338848.033264:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 22 00010000:00010000:0.0:1787338848.034294:0:14382:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5a00/0x83671231080c2c5e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338848.034317:0:14382:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5a00/0x83671231080c2c5e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338848.034365:0:14382:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5a00/0x83671231080c2c5e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338848.034370:0:14382:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5a00/0x83671231080c2c5e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338848.034375:0:14382:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5a00/0x83671231080c2c5e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338848.034379:0:14382:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbffef5a00 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:0.0:1787338848.034382:0:14382:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5a00/0x83671231080c2c5e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338848.034386:0:14382:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5a00/0x83671231080c2c5e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338848.034396:0:14382:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90bbc8283d00) 00010000:00010000:0.0:1787338848.034399:0:14382:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787338848.034401:0:14382:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5a00/0x83671231080c2c5e lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338848.034405:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5a00/0x83671231080c2c5e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338848.034461:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbe8199f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f600308-4919-499d-be82-256c83420e0e+31:14607:x1874160192196224:12345-192.168.201.53@tcp:54:lfs.0 Request processed in 14284us (14543us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338848.034467:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 75 00000100:00100000:1.0:1787338848.037293:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338848.037385:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192196864 00000100:00100000:0.0:1787338848.037395:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192196864 00000100:00100000:0.0:1787338848.037451:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 18 00000100:00100000:0.0:1787338848.037473:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf4707b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f600308-4919-499d-be82-256c83420e0e+31:14607:x1874160192196864:12345-192.168.201.53@tcp:35:lfs.0 00000100:00100000:0.0:1787338848.037706:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf4707b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f600308-4919-499d-be82-256c83420e0e+32:14607:x1874160192196864:12345-192.168.201.53@tcp:35:lfs.0 Request processed in 226us (414us total) trans 8589934645 rc 0/0 00000100:00100000:0.0:1787338848.037714:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 18 00000100:00100000:1.0:1787338848.116745:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338848.116852:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192197120 00000100:00100000:0.0:1787338848.116862:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192197120 00000100:00100000:0.0:1787338848.116954:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 76 00000100:00100000:0.0:1787338848.116966:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf4707480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f600308-4919-499d-be82-256c83420e0e+32:14618:x1874160192197120:12345-192.168.201.53@tcp:101:cat.0 00010000:00010000:0.0:1787338848.116991:0:14381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787338848.117012:0:14381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030200/0x83671231080c2c65 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadabc40 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338848.117088:0:14381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c2c6c lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338848.117103:0:14381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c2c6c lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338848.117113:0:14381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c2c6c lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338848.117128:0:14381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031400/0x83671231080c2c73 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338848.117136:0:14381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031400/0x83671231080c2c73 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338848.117155:0:14381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031400/0x83671231080c2c73 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338848.117727:0:14381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030600/0x83671231080c2c7a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338848.117739:0:14381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030600/0x83671231080c2c7a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338848.117747:0:14381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030600/0x83671231080c2c7a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787338848.117759:0:14381:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 8 00010000:00010000:0.0:1787338848.117850:0:14381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c2c6c lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338848.117856:0:14381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c2c6c lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338848.117860:0:14381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c2c6c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338848.117864:0:14381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbc0030a00 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:0.0:1787338848.117867:0:14381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c2c6c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338848.117900:0:14381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c2c6c lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338848.117914:0:14381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90bbc2a93400) 00010000:00010000:0.0:1787338848.117917:0:14381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787338848.117922:0:14381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c2c6c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338848.117938:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c2c6c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338848.117949:0:14381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031400/0x83671231080c2c73 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338848.117952:0:14381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031400/0x83671231080c2c73 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338848.117956:0:14381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031400/0x83671231080c2c73 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338848.117959:0:14381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbc0031400 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:0.0:1787338848.117961:0:14381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031400/0x83671231080c2c73 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338848.117964:0:14381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031400/0x83671231080c2c73 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338848.117969:0:14381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff90bbeb14d600) 00010000:00010000:0.0:1787338848.117970:0:14381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787338848.117972:0:14381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031400/0x83671231080c2c73 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338848.117975:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031400/0x83671231080c2c73 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338848.118019:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030200/0x83671231080c2c65 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc40 expref: 35 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338848.118037:0:14381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030600/0x83671231080c2c7a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc40 expref: 34 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338848.118042:0:14381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90bbc8283d00) 00010000:00010000:0.0:1787338848.118044:0:14381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787338848.118045:0:14381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbc0030600, rc 0) 00000100:00100000:0.0:1787338848.118164:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf4707480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f600308-4919-499d-be82-256c83420e0e+34:14618:x1874160192197120:12345-192.168.201.53@tcp:101:cat.0 Request processed in 1199us (1428us total) trans 8589934646 rc 0/0 00000100:00100000:0.0:1787338848.118171:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 76 00000100:00100000:2.0:1787338848.121735:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338848.121847:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192197376 00000100:00100000:0.0:1787338848.122475:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192197376 00000100:00100000:0.0:1787338848.122562:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 19 00000100:00100000:0.0:1787338848.122571:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbd17ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f600308-4919-499d-be82-256c83420e0e+34:14618:x1874160192197376:12345-192.168.201.53@tcp:35:cat.0 00000100:00100000:0.0:1787338848.122800:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbd17ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f600308-4919-499d-be82-256c83420e0e+35:14618:x1874160192197376:12345-192.168.201.53@tcp:35:cat.0 Request processed in 230us (1072us total) trans 8589934647 rc 0/0 00000100:00100000:0.0:1787338848.122805:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 19 00000100:00100000:1.0:1787338848.142147:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338848.142627:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192197632 00000100:00100000:0.0:1787338848.142635:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192197632 00000100:00100000:0.0:1787338848.142680:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 77 00000100:00100000:0.0:1787338848.142687:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf4706300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f600308-4919-499d-be82-256c83420e0e+35:14619:x1874160192197632:12345-192.168.201.53@tcp:36:rm.0 00010000:00010000:0.0:1787338848.142741:0:14382:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787338848.142768:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030600/0x83671231080c2c7a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc40 expref: 35 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338848.142786:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045000/0x83671231080c2c50 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc39 expref: 34 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338848.142804:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c2c03 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc24 expref: 33 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338848.142813:0:14382:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90bbc8283d00) 00010000:00010000:0.0:1787338848.142820:0:14382:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787338848.142835:0:14382:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030200/0x83671231080c2c88 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338848.142845:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030200/0x83671231080c2c88 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338848.142852:0:14382:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030200/0x83671231080c2c88 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338848.142860:0:14382:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031400/0x83671231080c2c8f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338848.142864:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031400/0x83671231080c2c8f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338848.143035:0:14382:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031400/0x83671231080c2c8f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338848.143330:0:14382:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c2c96 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338848.143343:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c2c96 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338848.143351:0:14382:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c2c96 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787338848.144351:0:14382:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].3, 64 off8408 00000004:00080000:0.0:1787338848.144375:0:14382:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 500985500176ns, next at 501985496835ns, rc = 0 00010000:00010000:0.0:1787338848.144440:0:14382:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c2c9d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338848.144452:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c2c9d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338848.144461:0:14382:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c2c9d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338848.144469:0:14382:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c2c9d lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338848.144475:0:14382:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c2c9d lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338848.144481:0:14382:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c2c9d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338848.144508:0:14382:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787338848.144548:0:14382:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c2c96 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338848.144554:0:14382:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c2c96 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338848.144561:0:14382:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c2c96 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338848.144567:0:14382:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbc0030a00 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:0.0:1787338848.144578:0:14382:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c2c96 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338848.144585:0:14382:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c2c96 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338848.144597:0:14382:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90bbeb14d700) 00010000:00010000:0.0:1787338848.144600:0:14382:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787338848.144604:0:14382:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c2c96 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338848.144610:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c2c96 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338848.144627:0:14382:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030200/0x83671231080c2c88 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338848.144633:0:14382:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030200/0x83671231080c2c88 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338848.144639:0:14382:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030200/0x83671231080c2c88 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338848.144644:0:14382:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbc0030200 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:0.0:1787338848.144646:0:14382:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030200/0x83671231080c2c88 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338848.144652:0:14382:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030200/0x83671231080c2c88 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338848.144660:0:14382:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90bbc2a93400) 00010000:00010000:0.0:1787338848.144662:0:14382:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787338848.144672:0:14382:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030200/0x83671231080c2c88 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338848.144678:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030200/0x83671231080c2c88 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787338848.144689:0:14382:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ecc0a683 reply state 000000001cd6e9fb transno 8589934648 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031400/0x83671231080c2c8f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338848.144699:0:14382:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787338848.144893:0:15652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787338848.144901:0:15652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c2c9d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338848.144908:0:15652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbc0030400 already unused, calling callback (ffffffffc1546230) 00010000:00010000:3.0:1787338848.144911:0:15652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c2c9d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338848.144917:0:15652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c2c9d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338848.144926:0:15652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90bbeb14d700) 00010000:00010000:3.0:1787338848.144928:0:15652:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787338848.144931:0:15652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c2c9d lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338848.144936:0:15652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c2c9d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338848.144961:0:15652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338848.144963:0:15652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338848.144964:0:15652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787338848.145061:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf4706300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f600308-4919-499d-be82-256c83420e0e+34:14619:x1874160192197632:12345-192.168.201.53@tcp:36:rm.0 Request processed in 2369us (2929us total) trans 8589934648 rc 0/0 00000100:00100000:0.0:1787338848.145069:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 77 00010000:00010000:2.0:1787338848.149177:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031400/0x83671231080c2c8f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338848.149195:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031400/0x83671231080c2c8f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338848.149203:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031400/0x83671231080c2c8f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338848.149210:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbc0031400 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:2.0:1787338848.149215:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031400/0x83671231080c2c8f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338848.149238:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031400/0x83671231080c2c8f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338848.149257:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff90bbeb14d600) 00010000:00010000:2.0:1787338848.149261:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787338848.149266:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031400/0x83671231080c2c8f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338848.149272:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031400/0x83671231080c2c8f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338848.186338:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338848.190789:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192197888 00000100:00100000:2.0:1787338848.190805:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192197888 00000100:00100000:2.0:1787338848.191019:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 78 00000100:00100000:2.0:1787338848.191031:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc121180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f600308-4919-499d-be82-256c83420e0e+33:14625:x1874160192197888:12345-192.168.201.53@tcp:101:bash.0 00010000:00010000:2.0:1787338848.191060:0:14381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787338848.191085:0:14381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2000/0x83671231080c2ca4 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadabc47 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338848.191267:0:14381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3800/0x83671231080c2cab lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338848.191282:0:14381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3800/0x83671231080c2cab lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338848.191294:0:14381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3800/0x83671231080c2cab lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338848.191393:0:14381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3600/0x83671231080c2cb2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338848.191417:0:14381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3600/0x83671231080c2cb2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338848.191425:0:14381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3600/0x83671231080c2cb2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338848.192582:0:14381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2200/0x83671231080c2cb9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338848.192596:0:14381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2200/0x83671231080c2cb9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338848.192605:0:14381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2200/0x83671231080c2cb9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787338848.192618:0:14381:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00010000:00010000:2.0:1787338848.192677:0:14381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3800/0x83671231080c2cab lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338848.192678:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787338848.192684:0:14381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3800/0x83671231080c2cab lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338848.192690:0:14381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3800/0x83671231080c2cab lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338848.194853:0:14381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e3800 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:2.0:1787338848.194859:0:14381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3800/0x83671231080c2cab lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338848.194958:0:14381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3800/0x83671231080c2cab lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338848.194993:0:14381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90bbc2a93400) 00010000:00010000:2.0:1787338848.194995:0:14381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787338848.194999:0:14381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3800/0x83671231080c2cab lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338848.195017:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3800/0x83671231080c2cab lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787338848.195044:0:14381:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e32b76d2 reply state 000000003a1a768d transno 8589934649 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3600/0x83671231080c2cb2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338848.195052:0:14381:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787338848.195114:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2000/0x83671231080c2ca4 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc47 expref: 36 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338848.195135:0:14381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2200/0x83671231080c2cb9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc47 expref: 35 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338848.195656:0:14381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff90bbc8283500) 00010000:00010000:2.0:1787338848.195659:0:14381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1787338848.195662:0:14381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf40e2200, rc 0) 00000100:00100000:2.0:1787338848.195805:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc121180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f600308-4919-499d-be82-256c83420e0e+36:14625:x1874160192197888:12345-192.168.201.53@tcp:101:bash.0 Request processed in 4773us (11168us total) trans 8589934649 rc 0/0 00000100:00100000:2.0:1787338848.195815:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 78 00010000:00010000:3.0:1787338848.198062:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3600/0x83671231080c2cb2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338848.198083:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3600/0x83671231080c2cb2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338848.198092:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3600/0x83671231080c2cb2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338848.198098:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e3600 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:3.0:1787338848.198104:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3600/0x83671231080c2cb2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338848.198112:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3600/0x83671231080c2cb2 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338848.198131:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff90bbc8283c00) 00010000:00010000:3.0:1787338848.198135:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787338848.198149:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3600/0x83671231080c2cb2 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338848.198157:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3600/0x83671231080c2cb2 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338848.201186:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338848.201342:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192198016 00000100:00100000:0.0:1787338848.201353:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192198016 00000100:00100000:0.0:1787338848.201412:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 79 00000100:00100000:0.0:1787338848.201424:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc122300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f600308-4919-499d-be82-256c83420e0e+35:14625:x1874160192198016:12345-192.168.201.53@tcp:101:bash.0 00010000:00010000:0.0:1787338848.201451:0:14382:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787338848.201473:0:14382:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030200/0x83671231080c2cc7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadabc4e expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338848.201538:0:14382:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c2cce lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338848.201551:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c2cce lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338848.201562:0:14382:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c2cce lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787338848.201603:0:14382:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00000004:00200000:0.0:1787338848.201617:0:14382:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787338848.201635:0:14382:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c2cce lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338848.201644:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c2cce lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338848.201661:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030200/0x83671231080c2cc7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc4e expref: 37 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338848.201675:0:14382:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c2cce lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc4e expref: 36 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338848.201682:0:14382:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff90bbc8283500) 00010000:00010000:0.0:1787338848.201684:0:14382:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787338848.201686:0:14382:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbc0030a00, rc 0) 00000100:00100000:0.0:1787338848.201743:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc122300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f600308-4919-499d-be82-256c83420e0e+36:14625:x1874160192198016:12345-192.168.201.53@tcp:101:bash.0 Request processed in 321us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338848.201750:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 79 00000100:00100000:1.0:1787338848.203714:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338848.203754:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192198272 00000100:00100000:3.0:1787338848.203775:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192198272 00000100:00100000:3.0:1787338848.203824:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 20 00000100:00100000:3.0:1787338848.203831:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbed9cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f600308-4919-499d-be82-256c83420e0e+36:14625:x1874160192198272:12345-192.168.201.53@tcp:35:bash.0 00000100:00100000:3.0:1787338848.204365:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbed9cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f600308-4919-499d-be82-256c83420e0e+37:14625:x1874160192198272:12345-192.168.201.53@tcp:35:bash.0 Request processed in 532us (656us total) trans 8589934650 rc 0/0 00000100:00100000:3.0:1787338848.204374:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 20 00000100:00100000:1.0:1787338848.293265:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338848.293344:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192198528 00000100:00100000:2.0:1787338848.293357:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192198528 00000100:00100000:2.0:1787338848.293420:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 80 00000100:00100000:2.0:1787338848.293431:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbed9cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f600308-4919-499d-be82-256c83420e0e+37:14638:x1874160192198528:12345-192.168.201.53@tcp:101:lfs.0 00010000:00010000:2.0:1787338848.293467:0:14381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787338848.293490:0:14381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2000/0x83671231080c2cd5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadabc55 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338848.293581:0:14381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3800/0x83671231080c2cdc lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338848.293595:0:14381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3800/0x83671231080c2cdc lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338848.293607:0:14381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3800/0x83671231080c2cdc lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787338848.293619:0:14381:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00010000:00010000:2.0:1787338848.293765:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2000/0x83671231080c2cd5 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc55 expref: 40 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338848.293780:0:14381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3800/0x83671231080c2cdc lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc55 expref: 39 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338848.293786:0:14381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff90bbc8283500) 00010000:00010000:2.0:1787338848.293789:0:14381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787338848.293791:0:14381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf40e3800, rc 0) 00000100:00100000:2.0:1787338848.293840:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbed9cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f600308-4919-499d-be82-256c83420e0e+39:14638:x1874160192198528:12345-192.168.201.53@tcp:101:lfs.0 Request processed in 412us (586us total) trans 8589934651 rc 0/0 00000100:00100000:2.0:1787338848.293847:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 80 00000100:00100000:0.0:1787338848.295650:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338848.295715:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192198656 00000100:00100000:3.0:1787338848.295721:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192198656 00000100:00100000:3.0:1787338848.295822:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 81 00000100:00100000:3.0:1787338848.295830:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbe819bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f600308-4919-499d-be82-256c83420e0e+39:14638:x1874160192198656:12345-192.168.201.53@tcp:54:lfs.0 00010000:00010000:3.0:1787338848.295904:0:14383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4600/0x83671231080c2cea lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338848.295920:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4600/0x83671231080c2cea lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338848.295928:0:14383:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4600/0x83671231080c2cea lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338848.295947:0:14383:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4600/0x83671231080c2cea lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338848.295954:0:14383:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4600/0x83671231080c2cea lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338848.295961:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4600/0x83671231080c2cea lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338848.295967:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbffef4600 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:3.0:1787338848.295971:0:14383:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4600/0x83671231080c2cea lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338848.295990:0:14383:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4600/0x83671231080c2cea lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338848.296002:0:14383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff90bbc8283500) 00010000:00010000:3.0:1787338848.296005:0:14383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787338848.296010:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4600/0x83671231080c2cea lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338848.296014:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4600/0x83671231080c2cea lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338848.296068:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbe819bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f600308-4919-499d-be82-256c83420e0e+39:14638:x1874160192198656:12345-192.168.201.53@tcp:54:lfs.0 Request processed in 239us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338848.296073:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 81 00000100:00100000:1.0:1787338848.346536:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338848.346639:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192198912 00000100:00100000:2.0:1787338848.346650:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192198912 00000100:00100000:2.0:1787338848.346720:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 82 00000100:00100000:2.0:1787338848.346742:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbed9c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f600308-4919-499d-be82-256c83420e0e+39:14648:x1874160192198912:12345-192.168.201.53@tcp:101:bash.0 00010000:00010000:2.0:1787338848.346763:0:14381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787338848.346786:0:14381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2000/0x83671231080c2cf1 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadabc5c expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338848.346917:0:14381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2400/0x83671231080c2cf8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338848.347032:0:14381:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2200/0x83671231080c2cb9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc47 expref: 40 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338848.347042:0:14381:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c2cce lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc4e expref: 40 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338848.347050:0:14381:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2400/0x83671231080c2cf8 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338848.347081:0:14381:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c2cce lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc4e expref: 40 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338848.347094:0:14381:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c2cce lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc4e expref: 40 pid: 14382 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338848.347117:0:14381:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbd17eea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14381:1874160212093184:192.168.201.53@tcp:104: 00010000:00010000:2.0:1787338848.347315:0:14381:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2200/0x83671231080c2cb9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc47 expref: 40 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338848.347326:0:14381:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2200/0x83671231080c2cb9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc47 expref: 40 pid: 14381 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338848.347343:0:14381:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbd17ee300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14381:1874160212093312:192.168.201.53@tcp:104: 00000100:00100000:2.0:1787338848.347366:0:14381:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbf3c7fb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787338848.351984:0:14381:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbd17eea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14381:1874160212093184:192.168.201.53@tcp:104: 00000100:00100000:2.0:1787338848.352001:0:14381:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbd17ee300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14381:1874160212093312:192.168.201.53@tcp:104: 00010000:00010000:2.0:1787338848.352027:0:14381:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2400/0x83671231080c2cf8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338848.352609:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338848.352647:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338848.352715:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192199040 00000100:00100000:0.0:1787338848.352723:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192199040 00010000:00010000:0.0:1787338848.352758:0:14367:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c2cce lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc4e expref: 41 pid: 14382 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338848.352787:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192199168 00000100:00100000:0.0:1787338848.352789:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192199168 00010000:00010000:0.0:1787338848.352799:0:14367:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2200/0x83671231080c2cb9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc47 expref: 42 pid: 14381 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338848.352834:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 23 00000100:00100000:0.0:1787338848.352842:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbed9cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f600308-4919-499d-be82-256c83420e0e+42:2358:x1874160192199040:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787338848.352854:0:14367:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787338848.352859:0:14367:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c2cce lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc4e expref: 42 pid: 14382 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338848.352867:0:14367:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c2cce lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc4e expref: 42 pid: 14382 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338848.352902:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c2cce lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc4e expref: 42 pid: 14382 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338848.352915:0:14367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff90bbc8283500) 00010000:00010000:0.0:1787338848.352919:0:14367:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2400/0x83671231080c2cf8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338848.352925:0:14367:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2400/0x83671231080c2cf8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338848.352929:0:14367:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787338848.352967:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbed9cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f600308-4919-499d-be82-256c83420e0e+41:2358:x1874160192199040:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 126us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338848.352971:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 23 00000100:00100000:0.0:1787338848.352984:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 24 00000100:00100000:0.0:1787338848.352988:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbed9c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f600308-4919-499d-be82-256c83420e0e+40:2358:x1874160192199168:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787338848.352999:0:14367:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787338848.353003:0:14367:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2200/0x83671231080c2cb9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc47 expref: 40 pid: 14381 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338848.353009:0:14367:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2200/0x83671231080c2cb9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc47 expref: 40 pid: 14381 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338848.353017:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2200/0x83671231080c2cb9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc47 expref: 40 pid: 14381 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338848.353026:0:14367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff90bbc8283500) 00010000:00010000:0.0:1787338848.353028:0:14367:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2400/0x83671231080c2cf8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338848.353033:0:14367:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2400/0x83671231080c2cf8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338848.353038:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2400/0x83671231080c2cf8 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338848.353049:0:14367:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787338848.353062:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbed9c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f600308-4919-499d-be82-256c83420e0e+39:2358:x1874160192199168:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 74us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338848.353065:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 24 00010000:00010000:2.0:1787338848.353334:0:14381:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2400/0x83671231080c2cf8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338848.353342:0:14381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2400/0x83671231080c2cf8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787338848.353362:0:14381:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00010000:00010000:2.0:1787338848.353504:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2000/0x83671231080c2cf1 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc5c expref: 40 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338848.353521:0:14381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2400/0x83671231080c2cf8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc5c expref: 39 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338848.353529:0:14381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff90bbc8283500) 00010000:00010000:2.0:1787338848.353532:0:14381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787338848.353534:0:14381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf40e2400, rc 0) 00000100:00100000:2.0:1787338848.353715:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbed9c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f600308-4919-499d-be82-256c83420e0e+39:14648:x1874160192198912:12345-192.168.201.53@tcp:101:bash.0 Request processed in 6975us (7188us total) trans 8589934652 rc 0/0 00000100:00100000:2.0:1787338848.353723:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 82 00000100:00100000:1.0:1787338848.355438:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338848.355513:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192199424 00000100:00100000:3.0:1787338848.355520:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192199424 00000100:00100000:3.0:1787338848.355558:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 83 00000100:00100000:3.0:1787338848.355564:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbed9c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f600308-4919-499d-be82-256c83420e0e+39:14648:x1874160192199424:12345-192.168.201.53@tcp:36:bash.0 00010000:00010000:3.0:1787338848.355774:0:14383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4600/0x83671231080c2d06 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338848.355786:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4600/0x83671231080c2d06 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338848.355793:0:14383:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4600/0x83671231080c2d06 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787338848.355832:0:14383:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934653 00000004:00010000:3.0:1787338848.355849:0:14383:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000317f7845 reply state 000000009330800b transno 8589934654 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4600/0x83671231080c2d06 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338848.355864:0:14383:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787338848.356132:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbed9c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f600308-4919-499d-be82-256c83420e0e+42:14648:x1874160192199424:12345-192.168.201.53@tcp:36:bash.0 Request processed in 565us (698us total) trans 8589934654 rc 0/0 00000100:00100000:3.0:1787338848.356149:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 83 00000020:00080000:3.0:1787338848.356154:0:14383:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787338848.358338:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4600/0x83671231080c2d06 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338848.358353:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4600/0x83671231080c2d06 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338848.358360:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4600/0x83671231080c2d06 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338848.358446:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbffef4600 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:2.0:1787338848.358452:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4600/0x83671231080c2d06 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338848.358460:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4600/0x83671231080c2d06 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338848.358482:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff90bbc8283500) 00010000:00010000:2.0:1787338848.358486:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787338848.358491:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4600/0x83671231080c2d06 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338848.358498:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4600/0x83671231080c2d06 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338848.358850:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338848.359087:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192199552 00000100:00100000:2.0:1787338848.359097:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192199552 00000100:00100000:2.0:1787338848.359259:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 84 00000100:00100000:2.0:1787338848.359268:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee44ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f600308-4919-499d-be82-256c83420e0e+41:14648:x1874160192199552:12345-192.168.201.53@tcp:101:bash.0 00010000:00010000:2.0:1787338848.359287:0:14381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787338848.359315:0:14381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2000/0x83671231080c2d0d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadabc63 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338848.359457:0:14381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3400/0x83671231080c2d14 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338848.359467:0:14381:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2400/0x83671231080c2cf8 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc5c expref: 42 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338848.359473:0:14381:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3400/0x83671231080c2d14 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338848.359497:0:14381:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2400/0x83671231080c2cf8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc5c expref: 42 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338848.359506:0:14381:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2400/0x83671231080c2cf8 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc5c expref: 42 pid: 14381 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338848.359516:0:14381:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbd17ee300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14381:1874160212093440:192.168.201.53@tcp:104: 00000100:00100000:2.0:1787338848.359581:0:14381:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbf3c7fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1787338848.361114:0:14381:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbd17ee300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14381:1874160212093440:192.168.201.53@tcp:104: 00010000:00010000:2.0:1787338848.361333:0:14381:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3400/0x83671231080c2d14 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338848.361750:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338848.361787:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192199680 00000100:00100000:0.0:1787338848.361794:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192199680 00010000:00010000:0.0:1787338848.361819:0:14367:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2400/0x83671231080c2cf8 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc5c expref: 43 pid: 14381 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338848.361862:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 25 00000100:00100000:0.0:1787338848.361904:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbd172a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f600308-4919-499d-be82-256c83420e0e+43:2359:x1874160192199680:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787338848.361919:0:14367:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787338848.361927:0:14367:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2400/0x83671231080c2cf8 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc5c expref: 43 pid: 14381 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338848.361940:0:14367:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2400/0x83671231080c2cf8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc5c expref: 43 pid: 14381 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338848.361962:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2400/0x83671231080c2cf8 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc5c expref: 43 pid: 14381 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338848.361977:0:14367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff90bbc8283500) 00010000:00010000:0.0:1787338848.361982:0:14367:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3400/0x83671231080c2d14 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338848.361989:0:14367:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3400/0x83671231080c2d14 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338848.361996:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3400/0x83671231080c2d14 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338848.362025:0:14367:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787338848.362073:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbd172a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f600308-4919-499d-be82-256c83420e0e+42:2359:x1874160192199680:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 202us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338848.362081:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 25 00010000:00010000:3.0:1787338848.362238:0:14381:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3400/0x83671231080c2d14 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338848.362247:0:14381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3400/0x83671231080c2d14 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787338848.362291:0:14381:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00000004:00200000:3.0:1787338848.362296:0:14381:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787338848.362330:0:14381:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3400/0x83671231080c2d14 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338848.362361:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2000/0x83671231080c2d0d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc63 expref: 42 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338848.362376:0:14381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3400/0x83671231080c2d14 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc63 expref: 41 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338848.362384:0:14381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff90bbc8283500) 00010000:00010000:3.0:1787338848.362387:0:14381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787338848.362389:0:14381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf40e3400, rc 0) 00000100:00100000:3.0:1787338848.362416:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee44ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f600308-4919-499d-be82-256c83420e0e+41:14648:x1874160192199552:12345-192.168.201.53@tcp:101:bash.0 Request processed in 3149us (3570us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338848.362423:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 84 00000100:00100000:1.0:1787338848.366424:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338848.366506:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192199936 00000100:00100000:0.0:1787338848.366531:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192199936 00000100:00100000:0.0:1787338848.366588:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 21 00000100:00100000:0.0:1787338848.366598:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee44c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f600308-4919-499d-be82-256c83420e0e+41:14648:x1874160192199936:12345-192.168.201.53@tcp:35:bash.0 00000100:00100000:0.0:1787338848.366978:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee44c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f600308-4919-499d-be82-256c83420e0e+42:14648:x1874160192199936:12345-192.168.201.53@tcp:35:bash.0 Request processed in 380us (562us total) trans 8589934655 rc 0/0 00000100:00100000:0.0:1787338848.367001:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 21 00000100:00100000:0.0:1787338848.432550:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338848.432649:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192200064 00000100:00100000:3.0:1787338848.432660:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192200064 00000100:00100000:3.0:1787338848.432726:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 85 00000100:00100000:3.0:1787338848.432738:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbe819b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f600308-4919-499d-be82-256c83420e0e+42:14654:x1874160192200064:12345-192.168.201.53@tcp:101:lfs.0 00010000:00010000:3.0:1787338848.432762:0:14383:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787338848.432784:0:14383:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5200/0x83671231080c2d1b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadabc6a expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338848.432850:0:14383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4600/0x83671231080c2d22 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338848.432865:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4600/0x83671231080c2d22 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338848.432919:0:14383:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4600/0x83671231080c2d22 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787338848.432990:0:14383:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787338848.432994:0:14383:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787338848.433017:0:14383:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4600/0x83671231080c2d22 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338848.433046:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5200/0x83671231080c2d1b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc6a expref: 44 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338848.433066:0:14383:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4600/0x83671231080c2d22 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc6a expref: 43 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338848.433074:0:14383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90bbc2a93400) 00010000:00010000:3.0:1787338848.433077:0:14383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787338848.433094:0:14383:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbffef4600, rc 0) 00000100:00100000:2.0:1787338848.433787:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbe819b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f600308-4919-499d-be82-256c83420e0e+43:14654:x1874160192200064:12345-192.168.201.53@tcp:101:lfs.0 Request processed in 1048us (1244us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338848.433796:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 85 00000100:00100000:1.0:1787338848.439338:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338848.439418:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192200192 00000100:00100000:3.0:1787338848.439429:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192200192 00000100:00100000:3.0:1787338848.439501:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 86 00000100:00100000:3.0:1787338848.439513:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee44f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f600308-4919-499d-be82-256c83420e0e+43:14654:x1874160192200192:12345-192.168.201.53@tcp:101:lfs.0 00010000:00010000:3.0:1787338848.439533:0:14381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787338848.439556:0:14381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5a00/0x83671231080c2d29 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadabc71 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338848.439625:0:14381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045000/0x83671231080c2d30 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338848.439639:0:14381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045000/0x83671231080c2d30 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338848.439650:0:14381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045000/0x83671231080c2d30 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338848.439665:0:14381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045400/0x83671231080c2d37 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338848.439672:0:14381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045400/0x83671231080c2d37 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338848.439678:0:14381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045400/0x83671231080c2d37 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338848.439780:0:14381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02044e00/0x83671231080c2d3e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338848.439789:0:14381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02044e00/0x83671231080c2d3e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338848.439815:0:14381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02044e00/0x83671231080c2d3e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787338848.439849:0:14381:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00000004:00200000:3.0:1787338848.439853:0:14381:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787338848.440459:0:14381:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02044e00/0x83671231080c2d3e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338848.440483:0:14381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02044e00/0x83671231080c2d3e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338848.440491:0:14381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045000/0x83671231080c2d30 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338848.440498:0:14381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045000/0x83671231080c2d30 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338848.440504:0:14381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045000/0x83671231080c2d30 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338848.440510:0:14381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bc02045000 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:2.0:1787338848.440514:0:14381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045000/0x83671231080c2d30 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338848.440521:0:14381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045000/0x83671231080c2d30 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338848.440532:0:14381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90bbc2a93400) 00010000:00010000:2.0:1787338848.440536:0:14381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787338848.440541:0:14381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045000/0x83671231080c2d30 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338848.440547:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045000/0x83671231080c2d30 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338848.440563:0:14381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045400/0x83671231080c2d37 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338848.440569:0:14381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045400/0x83671231080c2d37 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338848.440581:0:14381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045400/0x83671231080c2d37 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338848.440587:0:14381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bc02045400 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:2.0:1787338848.440590:0:14381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045400/0x83671231080c2d37 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338848.440595:0:14381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045400/0x83671231080c2d37 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338848.440603:0:14381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff90bbc9a99f00) 00010000:00010000:2.0:1787338848.440606:0:14381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787338848.440608:0:14381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045400/0x83671231080c2d37 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338848.440614:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045400/0x83671231080c2d37 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338848.440648:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5a00/0x83671231080c2d29 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc71 expref: 45 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338848.440662:0:14381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02044e00/0x83671231080c2d3e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc71 expref: 44 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338848.440669:0:14381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff90bbc8283500) 00010000:00010000:2.0:1787338848.440671:0:14381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787338848.440673:0:14381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bc02044e00, rc 0) 00000100:00100000:2.0:1787338848.440758:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee44f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f600308-4919-499d-be82-256c83420e0e+44:14654:x1874160192200192:12345-192.168.201.53@tcp:101:lfs.0 Request processed in 1246us (1429us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338848.440774:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 86 00000100:00100000:1.0:1787338848.447327:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338848.447408:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338848.447517:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192200576 00000100:00100000:0.0:1787338848.447529:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192200576 00000100:00100000:0.0:1787338848.447601:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 87 00000100:00100000:0.0:1787338848.447613:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f600308-4919-499d-be82-256c83420e0e+44:14654:x1874160192200576:12345-192.168.201.53@tcp:101:lfs.0 00010000:00010000:0.0:1787338848.447638:0:14383:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787338848.447661:0:14383:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c2d45 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadabc78 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338848.447767:0:14383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031200/0x83671231080c2d4c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338848.447782:0:14383:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3400/0x83671231080c2d14 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc63 expref: 45 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338848.447791:0:14383:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02044e00/0x83671231080c2d3e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc71 expref: 45 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338848.447798:0:14383:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031200/0x83671231080c2d4c lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338848.447831:0:14383:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02044e00/0x83671231080c2d3e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc71 expref: 45 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338848.447857:0:14383:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02044e00/0x83671231080c2d3e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc71 expref: 45 pid: 14381 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338848.447900:0:14383:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbe819ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14383:1874160212093568:192.168.201.53@tcp:104: 00010000:00010000:0.0:1787338848.448291:0:14383:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3400/0x83671231080c2d14 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc63 expref: 45 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338848.448312:0:14383:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3400/0x83671231080c2d14 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc63 expref: 45 pid: 14381 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338848.448322:0:14383:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbe8198a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14383:1874160212093696:192.168.201.53@tcp:104: 00000100:00100000:0.0:1787338848.448348:0:14383:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbde22d780 going to sleep for 11 seconds 00000100:00100000:2.0:1787338848.455203:0:16493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192200320 00000100:00100000:2.0:1787338848.455218:0:16493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192200320 00010000:00010000:2.0:1787338848.455272:0:16493:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02044e00/0x83671231080c2d3e lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc71 expref: 46 pid: 14381 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338848.455323:0:16493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 26 00000100:00100000:2.0:1787338848.455338:0:16493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4095880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f600308-4919-499d-be82-256c83420e0e+46:2359:x1874160192200320:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787338848.455374:0:16493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787338848.455383:0:16493:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02044e00/0x83671231080c2d3e lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc71 expref: 46 pid: 14381 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338848.455398:0:16493:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02044e00/0x83671231080c2d3e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc71 expref: 46 pid: 14381 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338848.455421:0:16493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff90bbc8283500) 00010000:00010000:2.0:1787338848.455427:0:16493:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031200/0x83671231080c2d4c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338848.455444:0:16493:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031200/0x83671231080c2d4c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338848.455451:0:16493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787338848.455504:0:16493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4095880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f600308-4919-499d-be82-256c83420e0e+46:2359:x1874160192200320:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 171us (8188us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338848.455513:0:16493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 26 00010000:00010000:2.0:1787338848.460383:0:14383:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.201.53@tcp) returned -22 from blocking AST (req@00000000d50df590 x1874160212093568) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02044e00/0x83671231080c2d3e lrc: 1/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc71 expref: 45 pid: 14381 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338848.460424:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02044e00/0x83671231080c2d3e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc71 expref: 45 pid: 14381 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338848.460445:0:14383:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbe819ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14383:1874160212093568:192.168.201.53@tcp:104: 00000100:00100000:1.0:1787338848.464062:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338848.464081:0:14383:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbe8198a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14383:1874160212093696:192.168.201.53@tcp:104: 00010000:00010000:2.0:1787338848.464115:0:14383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff90bbc8283500) 00010000:00010000:2.0:1787338848.464122:0:14383:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031200/0x83671231080c2d4c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338848.464133:0:14383:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031200/0x83671231080c2d4c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338848.464154:0:14383:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031200/0x83671231080c2d4c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338848.464227:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192200704 00000100:00100000:0.0:1787338848.464234:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192200704 00010000:00010000:0.0:1787338848.464274:0:14367:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3400/0x83671231080c2d14 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc63 expref: 45 pid: 14381 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338848.464325:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 27 00000100:00100000:0.0:1787338848.464336:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa4b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f600308-4919-499d-be82-256c83420e0e+45:2358:x1874160192200704:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787338848.464353:0:14367:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787338848.464361:0:14367:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3400/0x83671231080c2d14 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc63 expref: 45 pid: 14381 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338848.464375:0:14367:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3400/0x83671231080c2d14 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc63 expref: 45 pid: 14381 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338848.464420:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3400/0x83671231080c2d14 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc63 expref: 45 pid: 14381 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338848.464437:0:14367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff90bbc8283500) 00010000:00010000:0.0:1787338848.464441:0:14367:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031200/0x83671231080c2d4c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338848.464448:0:14367:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031200/0x83671231080c2d4c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338848.464455:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031200/0x83671231080c2d4c lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338848.464517:0:14367:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787338848.464583:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa4b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f600308-4919-499d-be82-256c83420e0e+44:2358:x1874160192200704:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 247us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338848.464591:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 27 00010000:00010000:2.0:1787338848.465243:0:14383:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031200/0x83671231080c2d4c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338848.465253:0:14383:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031200/0x83671231080c2d4c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787338848.465271:0:14383:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00010000:00010000:3.0:1787338848.465643:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030800/0x83671231080c2d45 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc78 expref: 45 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338848.465673:0:14383:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031200/0x83671231080c2d4c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc78 expref: 44 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338848.465682:0:14383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff90bbc8283500) 00010000:00010000:3.0:1787338848.465685:0:14383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787338848.465687:0:14383:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbc0031200, rc 0) 00000100:00100000:3.0:1787338848.465734:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f600308-4919-499d-be82-256c83420e0e+44:14654:x1874160192200576:12345-192.168.201.53@tcp:101:lfs.0 Request processed in 18124us (18325us total) trans 8589934656 rc 0/0 00000100:00100000:3.0:1787338848.465741:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 87 00000100:00100000:1.0:1787338848.467397:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338848.467442:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192201088 00000100:00100000:3.0:1787338848.467451:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192201088 00000100:00100000:3.0:1787338848.467535:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 22 00000100:00100000:3.0:1787338848.467546:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbff8f3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f600308-4919-499d-be82-256c83420e0e+44:14654:x1874160192201088:12345-192.168.201.53@tcp:35:lfs.0 00000100:00100000:3.0:1787338848.467762:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbff8f3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f600308-4919-499d-be82-256c83420e0e+45:14654:x1874160192201088:12345-192.168.201.53@tcp:35:lfs.0 Request processed in 217us (370us total) trans 8589934657 rc 0/0 00000100:00100000:3.0:1787338848.467771:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 22 00000100:00100000:0.0:1787338848.470335:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338848.470422:0:16493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192201216 00000100:00100000:2.0:1787338848.470431:0:16493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192201216 00000100:00100000:2.0:1787338848.470487:0:16493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 2 00000100:00100000:2.0:1787338848.470497:0:16493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbe8198380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f600308-4919-499d-be82-256c83420e0e+45:14654:x1874160192201216:12345-192.168.201.53@tcp:103:lfs.0 00010000:00010000:2.0:1787338848.470525:0:16493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787338848.470549:0:16493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3800/0x83671231080c2cdc lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc55 expref: 45 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338848.470570:0:16493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff90bbc8283500) 00010000:00010000:2.0:1787338848.470575:0:16493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787338848.470628:0:16493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbe8198380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f600308-4919-499d-be82-256c83420e0e+44:14654:x1874160192201216:12345-192.168.201.53@tcp:103:lfs.0 Request processed in 132us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338848.470635:0:16493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 2 00000100:00100000:1.0:1787338848.474461:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338848.475983:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192201344 00000100:00100000:2.0:1787338848.475996:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192201344 00000100:00100000:2.0:1787338848.476114:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 88 00000100:00100000:2.0:1787338848.476124:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f600308-4919-499d-be82-256c83420e0e+44:14654:x1874160192201344:12345-192.168.201.53@tcp:58:lfs.0 00010000:00010000:2.0:1787338848.476232:0:14381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c2d5a lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338848.476249:0:14381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c2d5a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338848.476260:0:14381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c2d5a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787338848.476574:0:14381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].2, 136 off8464 00000100:00100000:2.0:1787338848.476668:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f600308-4919-499d-be82-256c83420e0e+44:14654:x1874160192201344:12345-192.168.201.53@tcp:58:lfs.0 Request processed in 544us (2215us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338848.476676:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 88 00000100:00100000:1.0:1787338848.484058:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338848.484145:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192201472 00000100:00100000:3.0:1787338848.484155:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192201472 00000100:00100000:3.0:1787338848.484227:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 89 00000100:00100000:3.0:1787338848.484237:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf3e91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f600308-4919-499d-be82-256c83420e0e+44:14654:x1874160192201472:12345-192.168.201.53@tcp:101:lfs.0 00010000:00010000:3.0:1787338848.484255:0:14383:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787338848.484274:0:14383:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045e00/0x83671231080c2d61 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadabc7f expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338848.484340:0:14383:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c2d5a lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338848.484351:0:14383:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045e00/0x83671231080c2d61 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc7f expref: 45 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338848.484369:0:14383:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c2d5a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338848.484381:0:14383:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045e00/0x83671231080c2d61 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc7f expref: 45 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338848.484394:0:14383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff90bbc8283500) 00010000:00010000:3.0:1787338848.484397:0:14383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787338848.484401:0:14383:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045e00/0x83671231080c2d61 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc7f expref: 45 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338848.484409:0:14383:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bc02045e00, rc 0) 00000100:00100000:3.0:1787338848.484463:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf3e91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f600308-4919-499d-be82-256c83420e0e+45:14654:x1874160192201472:12345-192.168.201.53@tcp:101:lfs.0 Request processed in 227us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338848.484470:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 89 00000040:00080000:0.0:1787338849.078155:0:14412:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787338849.078165:0:14412:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787338849.078207:0:14412:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:0.0:1787338849.078214:0:14412:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1787338849.078360:0:14412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbe8199180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14412:1874160212093824:192.168.201.53@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787338849.078777:0:14412:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbde22d3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787338849.086813:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338849.086977:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192201600 00000100:00100000:2.0:1787338849.086986:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192201600 00000100:00100000:2.0:1787338849.087063:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 90 00000100:00100000:2.0:1787338849.087074:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf3e91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f600308-4919-499d-be82-256c83420e0e+46:14655:x1874160192201600:12345-192.168.201.53@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787338849.087107:0:14381:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787338849.087228:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf3e91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f600308-4919-499d-be82-256c83420e0e+46:14655:x1874160192201600:12345-192.168.201.53@tcp:53:lhsmtool_posix.0 Request processed in 155us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338849.087236:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 90 00000100:00100000:0.0:1787338849.087418:0:14412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbe8199180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14412:1874160212093824:192.168.201.53@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787338849.098338:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338849.098516:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192201728 00000100:00100000:0.0:1787338849.098527:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192201728 00000100:00100000:0.0:1787338849.098598:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 91 00000100:00100000:0.0:1787338849.098609:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbd17ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f600308-4919-499d-be82-256c83420e0e+45:14655:x1874160192201728:12345-192.168.201.53@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787338849.098695:0:14382:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031a00/0x83671231080c2d68 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338849.098713:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031a00/0x83671231080c2d68 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338849.098726:0:14382:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031a00/0x83671231080c2d68 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338849.098761:0:14382:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031800/0x83671231080c2d6f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338849.098770:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031800/0x83671231080c2d6f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338849.098777:0:14382:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031800/0x83671231080c2d6f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338849.098800:0:14382:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c2d76 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338849.098810:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c2d76 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338849.098816:0:14382:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c2d76 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787338849.098862:0:14382:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00000004:00200000:0.0:1787338849.098866:0:14382:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787338849.098940:0:14382:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c2d76 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338849.098958:0:14382:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031a00/0x83671231080c2d68 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338849.098965:0:14382:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031a00/0x83671231080c2d68 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338849.098972:0:14382:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031a00/0x83671231080c2d68 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338849.098978:0:14382:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbc0031a00 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:0.0:1787338849.098983:0:14382:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031a00/0x83671231080c2d68 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338849.098991:0:14382:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031a00/0x83671231080c2d68 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338849.099004:0:14382:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90bbc2a93900) 00010000:00010000:0.0:1787338849.099007:0:14382:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787338849.099010:0:14382:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031a00/0x83671231080c2d68 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338849.099017:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031a00/0x83671231080c2d68 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338849.099037:0:14382:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031800/0x83671231080c2d6f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338849.099044:0:14382:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031800/0x83671231080c2d6f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338849.099050:0:14382:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031800/0x83671231080c2d6f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338849.099061:0:14382:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbc0031800 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:0.0:1787338849.099064:0:14382:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031800/0x83671231080c2d6f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338849.099071:0:14382:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031800/0x83671231080c2d6f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338849.099078:0:14382:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdfbec3e4 (ffff90bbeb14de00) 00010000:00010000:0.0:1787338849.099081:0:14382:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787338849.099084:0:14382:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031800/0x83671231080c2d6f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338849.099091:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031800/0x83671231080c2d6f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338849.099108:0:14382:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c2d76 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338849.099115:0:14382:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c2d76 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338849.099121:0:14382:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c2d76 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338849.099127:0:14382:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbc0030a00 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:0.0:1787338849.099129:0:14382:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c2d76 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338849.099135:0:14382:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c2d76 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338849.099154:0:14382:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff90bbc8283500) 00010000:00010000:0.0:1787338849.099156:0:14382:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787338849.099160:0:14382:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c2d76 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338849.099166:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030a00/0x83671231080c2d76 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338849.099619:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbd17ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f600308-4919-499d-be82-256c83420e0e+45:14655:x1874160192201728:12345-192.168.201.53@tcp:34:lhsmtool_posix.0 Request processed in 1009us (1302us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338849.099629:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 91 00000100:00100000:1.0:1787338849.110498:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338849.110556:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192201984 00000100:00100000:3.0:1787338849.110584:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192201984 00000100:00100000:3.0:1787338849.110639:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 92 00000100:00100000:3.0:1787338849.110651:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf3e92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f600308-4919-499d-be82-256c83420e0e+45:14655:x1874160192201984:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787338849.110672:0:14383:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787338849.110694:0:14383:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02044e00/0x83671231080c2d7d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadabc86 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338849.111003:0:14383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045400/0x83671231080c2d84 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338849.111018:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045400/0x83671231080c2d84 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338849.111030:0:14383:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045400/0x83671231080c2d84 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787338849.111163:0:14383:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00010000:00010000:3.0:1787338849.111259:0:14383:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045400/0x83671231080c2d84 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338849.111268:0:14383:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045400/0x83671231080c2d84 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338849.111276:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045400/0x83671231080c2d84 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338849.111282:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bc02045400 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:3.0:1787338849.111299:0:14383:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045400/0x83671231080c2d84 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338849.111307:0:14383:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045400/0x83671231080c2d84 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338849.111328:0:14383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff90bbc8283500) 00010000:00010000:3.0:1787338849.111331:0:14383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787338849.111335:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045400/0x83671231080c2d84 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338849.111341:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045400/0x83671231080c2d84 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338849.111384:0:14383:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02044e00/0x83671231080c2d7d lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc86 expref: 47 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338849.111395:0:14383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90bbc2a93900) 00010000:00010000:3.0:1787338849.111398:0:14383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787338849.111401:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02044e00/0x83671231080c2d7d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc86 expref: 47 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338849.111412:0:14383:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bc02044e00, rc 0) 00000100:00100000:3.0:1787338849.111469:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf3e92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f600308-4919-499d-be82-256c83420e0e+46:14655:x1874160192201984:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 Request processed in 820us (980us total) trans 8589934658 rc 301/301 00000100:00100000:3.0:1787338849.111477:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 92 00000100:00100000:1.0:1787338849.115314:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338849.115427:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192202112 00000100:00100000:0.0:1787338849.115436:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192202112 00000100:00100000:0.0:1787338849.115494:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 93 00000100:00100000:0.0:1787338849.115504:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf3e90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f600308-4919-499d-be82-256c83420e0e+46:14655:x1874160192202112:12345-192.168.201.53@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787338849.115537:0:14382:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787338849.115634:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf3e90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f600308-4919-499d-be82-256c83420e0e+46:14655:x1874160192202112:12345-192.168.201.53@tcp:53:lhsmtool_posix.0 Request processed in 132us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338849.115642:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 93 00000100:00100000:2.0:1787338849.118771:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338849.119313:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192202368 00000100:00100000:3.0:1787338849.119324:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192202368 00000100:00100000:3.0:1787338849.119375:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 94 00000100:00100000:3.0:1787338849.119386:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbd17eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f600308-4919-499d-be82-256c83420e0e+46:14655:x1874160192202368:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787338849.119406:0:14383:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787338849.119409:0:14383:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787338849.119435:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4600/0x83671231080c2d22 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc6a expref: 46 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338849.119473:0:14383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90bbc2a93400) 00010000:00010000:3.0:1787338849.119478:0:14383:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787338849.119493:0:14383:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02044e00/0x83671231080c2d92 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadabc8d expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787338849.120164:0:14383:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x6:0x0], count =28 00000004:00080000:3.0:1787338849.120170:0:14383:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x6:0x0]+28 in llog 00000004:00080000:3.0:1787338849.120223:0:14383:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:3.0:1787338849.120410:0:14383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045400/0x83671231080c2d99 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338849.120424:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045400/0x83671231080c2d99 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338849.120434:0:14383:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045400/0x83671231080c2d99 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338849.120481:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02044e00/0x83671231080c2d92 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc8d expref: 48 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338849.120496:0:14383:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045400/0x83671231080c2d99 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc8d expref: 47 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338849.120505:0:14383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff90bbc9a99a00) 00010000:00010000:3.0:1787338849.120508:0:14383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787338849.120511:0:14383:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bc02045400, rc 0) 00000100:00100000:3.0:1787338849.120581:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbd17eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f600308-4919-499d-be82-256c83420e0e+47:14655:x1874160192202368:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 Request processed in 1197us (1819us total) trans 8589934659 rc 0/0 00000100:00100000:3.0:1787338849.120599:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 94 00000100:00100000:1.0:1787338849.129565:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338849.130426:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192202624 00000100:00100000:2.0:1787338849.130436:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192202624 00000100:00100000:2.0:1787338849.130496:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 95 00000100:00100000:2.0:1787338849.130506:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf3e92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f600308-4919-499d-be82-256c83420e0e+47:14655:x1874160192202624:12345-192.168.201.53@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787338849.130724:0:14381:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787338849.130751:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045400/0x83671231080c2d99 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc8d expref: 47 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338849.130774:0:14381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff90bbc9a99a00) 00010000:00010000:2.0:1787338849.130785:0:14381:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787338849.130806:0:14381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2800/0x83671231080c2da7 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338849.130819:0:14381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2800/0x83671231080c2da7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338849.130829:0:14381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2800/0x83671231080c2da7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338849.130842:0:14381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3800/0x83671231080c2dae lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xa6bc00e0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338849.131013:0:14381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3800/0x83671231080c2dae lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xa6bc00e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338849.131020:0:14381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3800/0x83671231080c2dae lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xa6bc00e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338849.131091:0:14381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2800/0x83671231080c2da7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338849.131098:0:14381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2800/0x83671231080c2da7 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338849.131105:0:14381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2800/0x83671231080c2da7 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338849.131202:0:14381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e2800 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:2.0:1787338849.131206:0:14381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2800/0x83671231080c2da7 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338849.131213:0:14381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2800/0x83671231080c2da7 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338849.131221:0:14381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90bbc2a93400) 00010000:00010000:2.0:1787338849.131223:0:14381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787338849.131227:0:14381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2800/0x83671231080c2da7 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338849.131232:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2800/0x83671231080c2da7 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338849.131244:0:14381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3800/0x83671231080c2dae lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xa6bc00e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338849.131255:0:14381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3800/0x83671231080c2dae lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xa6bc00e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338849.131260:0:14381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3800/0x83671231080c2dae lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xa6bc00e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338849.131265:0:14381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e3800 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:2.0:1787338849.131267:0:14381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3800/0x83671231080c2dae lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xa6bc00e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338849.131271:0:14381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3800/0x83671231080c2dae lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xa6bc00e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338849.131279:0:14381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xa6bc00e0 (ffff90bbc8283900) 00010000:00010000:2.0:1787338849.131281:0:14381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787338849.131294:0:14381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3800/0x83671231080c2dae lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xa6bc00e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338849.131301:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3800/0x83671231080c2dae lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xa6bc00e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338849.131390:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf3e92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f600308-4919-499d-be82-256c83420e0e+46:14655:x1874160192202624:12345-192.168.201.53@tcp:36:lhsmtool_posix.0 Request processed in 884us (1834us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787338849.131398:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 95 00000100:00100000:1.0:1787338849.134818:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338849.135278:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192202752 00000100:00100000:3.0:1787338849.135296:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192202752 00000100:00100000:3.0:1787338849.135468:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 96 00000100:00100000:3.0:1787338849.135480:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf3e90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f600308-4919-499d-be82-256c83420e0e+46:14655:x1874160192202752:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787338849.135499:0:14383:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787338849.135519:0:14383:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02044e00/0x83671231080c2db5 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadabc94 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338849.135565:0:14383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045000/0x83671231080c2dbc lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338849.135578:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045000/0x83671231080c2dbc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338849.135588:0:14383:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045000/0x83671231080c2dbc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338849.135693:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02044e00/0x83671231080c2db5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc94 expref: 48 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338849.135712:0:14383:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045000/0x83671231080c2dbc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc94 expref: 47 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338849.135721:0:14383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff90bbc9a99600) 00010000:00010000:3.0:1787338849.135724:0:14383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787338849.135727:0:14383:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bc02045000, rc 0) 00000100:00100000:3.0:1787338849.135785:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf3e90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f600308-4919-499d-be82-256c83420e0e+47:14655:x1874160192202752:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 Request processed in 307us (977us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338849.135798:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 96 00000100:00100000:2.0:1787338849.138946:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338849.139183:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192203008 00000100:00100000:3.0:1787338849.139193:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192203008 00000100:00100000:3.0:1787338849.139239:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 97 00000100:00100000:3.0:1787338849.139249:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbd17ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f600308-4919-499d-be82-256c83420e0e+47:14655:x1874160192203008:12345-192.168.201.53@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787338849.139365:0:14381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4600/0x83671231080c2dc3 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338849.139384:0:14381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4600/0x83671231080c2dc3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338849.139396:0:14381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4600/0x83671231080c2dc3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787338849.139812:0:14381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:3.0:1787338849.139822:0:14381:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 501980947402ns, next at 502980945141ns, rc = 0 00000004:00010000:3.0:1787338849.139940:0:14381:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000080c11d5a reply state 000000005c188a56 transno 8589934660 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4600/0x83671231080c2dc3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338849.139950:0:14381:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787338849.140037:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbd17ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f600308-4919-499d-be82-256c83420e0e+49:14655:x1874160192203008:12345-192.168.201.53@tcp:36:lhsmtool_posix.0 Request processed in 788us (1099us total) trans 8589934660 rc 0/0 00000100:00100000:3.0:1787338849.140044:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 97 00000100:00100000:1.0:1787338849.147782:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338849.148136:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192203136 00000100:00100000:3.0:1787338849.148146:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192203136 00000100:00100000:3.0:1787338849.148247:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 98 00000100:00100000:3.0:1787338849.148352:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf3e91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f600308-4919-499d-be82-256c83420e0e+49:14655:x1874160192203136:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787338849.148378:0:14383:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787338849.148424:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4600/0x83671231080c2dc3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338849.148437:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4600/0x83671231080c2dc3 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338849.148445:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4600/0x83671231080c2dc3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338849.148462:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbffef4600 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:0.0:1787338849.148468:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4600/0x83671231080c2dc3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338849.148476:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4600/0x83671231080c2dc3 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338849.148492:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff90bbc9a99600) 00010000:00010000:0.0:1787338849.148495:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787338849.148499:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4600/0x83671231080c2dc3 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338849.148506:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4600/0x83671231080c2dc3 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338849.148661:0:14383:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c400/0x83671231080c2dca lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadabc9b expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338849.148716:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c400/0x83671231080c2dca lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc9b expref: 49 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338849.148739:0:14383:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c400/0x83671231080c2dca lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc9b expref: 49 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338849.148758:0:14383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff90bbc9a99600) 00010000:00010000:1.0:1787338849.148761:0:14383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787338849.148764:0:14383:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbfbe9c400, rc 0) 00000100:00100000:1.0:1787338849.148836:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf3e91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f600308-4919-499d-be82-256c83420e0e+49:14655:x1874160192203136:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 Request processed in 488us (1066us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338849.148844:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 98 00000100:00100000:2.0:1787338849.152974:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338849.153031:0:15066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192203264 00000100:00100000:0.0:1787338849.153051:0:15066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192203264 00000100:00080000:2.0:1787338849.153103:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787338849.153127:0:15066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 20 00000100:00100000:0.0:1787338849.153138:0:15066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbd17ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f600308-4919-499d-be82-256c83420e0e+5:2358:x1874160192203264:12345-192.168.201.53@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1787338849.153494:0:15066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbd17ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f600308-4919-499d-be82-256c83420e0e+6:2358:x1874160192203264:12345-192.168.201.53@tcp:2:lhsmtool_posix.0 Request processed in 357us (649us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1787338849.153502:0:15066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 20 00000100:00100000:0.0:1787338849.157059:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338849.157231:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192203520 00000100:00100000:1.0:1787338849.157241:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192203520 00000100:00100000:1.0:1787338849.157314:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 23 00000100:00100000:1.0:1787338849.157324:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbe8199180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f600308-4919-499d-be82-256c83420e0e+49:14655:x1874160192203520:12345-192.168.201.53@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787338849.157769:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbe8199180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f600308-4919-499d-be82-256c83420e0e+50:14655:x1874160192203520:12345-192.168.201.53@tcp:35:lhsmtool_posix.0 Request processed in 444us (717us total) trans 8589934661 rc 0/0 00000100:00100000:1.0:1787338849.157778:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 23 00000100:00100000:2.0:1787338849.168107:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338849.168210:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192203776 00000100:00100000:1.0:1787338849.168224:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192203776 00000100:00100000:1.0:1787338849.168303:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 99 00000100:00100000:1.0:1787338849.168315:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbd17edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f600308-4919-499d-be82-256c83420e0e+50:14655:x1874160192203776:12345-192.168.201.53@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787338849.168427:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbd17edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f600308-4919-499d-be82-256c83420e0e+50:14655:x1874160192203776:12345-192.168.201.53@tcp:57:lhsmtool_posix.0 Request processed in 114us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338849.168436:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 99 00000100:00100000:2.0:1787338849.173128:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338849.173302:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192203904 00000100:00100000:1.0:1787338849.173317:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192203904 00000100:00100000:1.0:1787338849.173381:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 100 00000100:00100000:1.0:1787338849.173391:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbd17eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f600308-4919-499d-be82-256c83420e0e+50:14655:x1874160192203904:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787338849.173410:0:14383:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787338849.173429:0:14383:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c200/0x83671231080c2dd1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadabca2 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338849.173491:0:14383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ca00/0x83671231080c2dd8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338849.173505:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ca00/0x83671231080c2dd8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338849.173518:0:14383:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ca00/0x83671231080c2dd8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787338849.173550:0:14383:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787338849.173567:0:14383:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ca00/0x83671231080c2dd8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338849.173589:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c200/0x83671231080c2dd1 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabca2 expref: 52 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338849.173608:0:14383:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ca00/0x83671231080c2dd8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabca2 expref: 51 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338849.173617:0:14383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff90bbc9a99600) 00010000:00010000:1.0:1787338849.173619:0:14383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787338849.173623:0:14383:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbfbe9ca00, rc 0) 00000100:00100000:1.0:1787338849.173676:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbd17eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f600308-4919-499d-be82-256c83420e0e+51:14655:x1874160192203904:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 Request processed in 287us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338849.173688:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 100 00000100:00100000:0.0:1787338849.181496:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338849.181594:0:15650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192204032 00000100:00100000:1.0:1787338849.181604:0:15650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192204032 00000100:00100000:1.0:1787338849.181700:0:15650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 21 00000100:00100000:1.0:1787338849.181712:0:15650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbe819b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f600308-4919-499d-be82-256c83420e0e+6:2359:x1874160192204032:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787338849.181733:0:15650:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787338849.181767:0:15650:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a810f1fd/0x83671231080c2ddf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadabca9 expref: -99 pid: 15650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787338849.181797:0:15650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a88a061, blocks: 0x1 00010000:00010000:1.0:1787338849.181815:0:15650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=502s v=(0 0) 00010000:00010000:1.0:1787338849.181820:0:15650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787338849.181830:0:15650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a810f1fd/0x83671231080c2ddf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabca9 expref: 7 pid: 15650 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338849.181859:0:15650:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a810f1fd/0x83671231080c2ddf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabca9 expref: 7 pid: 15650 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338849.182162:0:15650:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbfbe9d800, rc 0) 00000100:00100000:1.0:1787338849.182215:0:15650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbe819b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f600308-4919-499d-be82-256c83420e0e+7:2359:x1874160192204032:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 Request processed in 505us (728us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338849.182222:0:15650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 21 00000100:00100000:2.0:1787338849.191167:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338849.191480:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192204288 00000100:00100000:3.0:1787338849.191491:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192204288 00000100:00100000:3.0:1787338849.191540:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 101 00000100:00100000:3.0:1787338849.191550:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbd17ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f600308-4919-499d-be82-256c83420e0e+51:14655:x1874160192204288:12345-192.168.201.53@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787338849.191651:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbd17ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f600308-4919-499d-be82-256c83420e0e+51:14655:x1874160192204288:12345-192.168.201.53@tcp:57:lhsmtool_posix.0 Request processed in 102us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338849.191659:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 101 00000100:00100000:2.0:1787338849.195299:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338849.195376:0:15066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192204416 00000100:00100000:1.0:1787338849.195386:0:15066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192204416 00000100:00100000:1.0:1787338849.195439:0:15066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 22 00000100:00100000:1.0:1787338849.195450:0:15066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbd17ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f600308-4919-499d-be82-256c83420e0e+7:14655:x1874160192204416:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787338849.195485:0:15066:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787338849.195504:0:15066:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb7e3e45/0x83671231080c2de6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadabcb0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338849.195537:0:15066:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a810f1fd/0x83671231080c2ddf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabca9 expref: 8 pid: 15650 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338849.195547:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787338849.195551:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787338849.195556:0:15066:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb7e3e45/0x83671231080c2de6 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabcb0 expref: 8 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338849.195592:0:15066:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a810f1fd/0x83671231080c2ddf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabca9 expref: 8 pid: 15650 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338849.195606:0:15066:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a810f1fd/0x83671231080c2ddf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabca9 expref: 8 pid: 15650 timeout: 602 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338849.195622:0:15066:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf3e93100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:15066:1874160212093952:192.168.201.53@tcp:104: 00000100:00100000:1.0:1787338849.195727:0:15066:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc674cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787338849.200087:0:15066:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf3e93100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:15066:1874160212093952:192.168.201.53@tcp:104: 00010000:00010000:1.0:1787338849.200138:0:15066:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fb7e3e45/0x83671231080c2de6 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabcb0 expref: 8 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338849.200163:0:15066:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbfbe9dc00, rc 0) 00000100:00100000:1.0:1787338849.200242:0:15066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbd17ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f600308-4919-499d-be82-256c83420e0e+8:14655:x1874160192204416:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 Request processed in 4793us (4962us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338849.200251:0:15066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 22 00000100:00100000:3.0:1787338849.200557:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338849.201539:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192204544 00000100:00100000:1.0:1787338849.201548:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192204544 00010000:00010000:1.0:1787338849.201579:0:14366:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a810f1fd/0x83671231080c2ddf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabca9 expref: 8 pid: 15650 timeout: 602 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338849.201609:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 28 00000100:00100000:1.0:1787338849.201617:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc122a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f600308-4919-499d-be82-256c83420e0e+8:2358:x1874160192204544:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787338849.201631:0:14366:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787338849.201651:0:14366:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a810f1fd/0x83671231080c2ddf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabca9 expref: 8 pid: 15650 timeout: 602 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338849.201663:0:14366:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a810f1fd/0x83671231080c2ddf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabca9 expref: 8 pid: 15650 timeout: 602 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338849.201696:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a810f1fd/0x83671231080c2ddf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabca9 expref: 8 pid: 15650 timeout: 602 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338849.201710:0:14366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787338849.201715:0:14366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787338849.201723:0:14366:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fb7e3e45/0x83671231080c2de6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabcb0 expref: 7 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338849.201733:0:14366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb7e3e45/0x83671231080c2de6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabcb0 expref: 7 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338849.201780:0:14366:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000fb7e3e45/0x83671231080c2de6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabcb0 expref: 7 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338849.201794:0:14366:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf3e93100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:14366:1874160212094080:192.168.201.53@tcp:105: 00000100:00100000:1.0:1787338849.201886:0:14366:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc674cd80 going to sleep for 11 seconds 00010000:00010000:3.0:1787338849.206184:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787338849.206608:0:14366:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf3e93100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:14366:1874160212094080:192.168.201.53@tcp:105: 00010000:00010000:1.0:1787338849.206633:0:14366:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787338849.206732:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc122a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f600308-4919-499d-be82-256c83420e0e+7:2358:x1874160192204544:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 5113us (6174us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338849.206742:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 28 00000100:00100000:3.0:1787338849.210618:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338849.210732:0:15070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192204672 00000100:00100000:0.0:1787338849.210741:0:15070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192204672 00002000:00100000:0.0:1787338849.210797:0:15070:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x22:0x0] (0->12) req@ffff90bbfc121500 x1874160192204672/t0(0) o4->4f600308-4919-499d-be82-256c83420e0e@192.168.201.53@tcp:180/0 lens 504/0 e 0 to 0 dl 1787338860 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:100 00002000:00100000:0.0:1787338849.210827:0:15070:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90bbfc121500 with x1874160192204672 ext(0->12) 00002000:00010000:0.0:1787338849.210832:0:15070:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90bbfc121500 00000100:00100000:0.0:1787338849.210869:0:15070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 2 00000100:00100000:0.0:1787338849.210910:0:15070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc121500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f600308-4919-499d-be82-256c83420e0e+7:2358:x1874160192204672:12345-192.168.201.53@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1787338849.211343:0:15070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc121500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f600308-4919-499d-be82-256c83420e0e+9:2358:x1874160192204672:12345-192.168.201.53@tcp:4:lhsmtool_posix.0 Request processed in 434us (733us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1787338849.211351:0:15070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 2 00002000:00100000:0.0:1787338849.211358:0:15070:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x22:0x0] (0->12) req@ffff90bbfc121500 x1874160192204672/t8589934595(0) o4->4f600308-4919-499d-be82-256c83420e0e@192.168.201.53@tcp:180/0 lens 504/448 e 0 to 0 dl 1787338860 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:100 00002000:00100000:0.0:1787338849.211367:0:15070:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90bbfc121500 with x1874160192204672 ext(0->12) 00002000:00010000:0.0:1787338849.211371:0:15070:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90bbfc121500 00000100:00100000:2.0:1787338849.214749:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338849.215144:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192204800 00000100:00100000:0.0:1787338849.215155:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192204800 00000100:00100000:0.0:1787338849.215218:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 102 00000100:00100000:0.0:1787338849.215229:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbd17efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f600308-4919-499d-be82-256c83420e0e+51:14655:x1874160192204800:12345-192.168.201.53@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1787338849.297425:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934655 is committed 00000004:00080000:2.0:1787338849.297438:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:2.0:1787338849.297468:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934661 is committed 00000004:00080000:2.0:1787338849.297502:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:2.0:1787338849.297535:0:5861:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90bbedd6bc00 refcount 2 committed 0 result 0 batchid 4294967527 00000020:00080000:2.0:1787338849.297540:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90bbc952b500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90bbedd6bb40 00000020:00080000:2.0:1787338849.297544:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90bbc952bc00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90bbf7df5400 00000020:00080000:2.0:1787338849.297660:0:14418:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967527 committed batchid 8 00000020:00080000:2.0:1787338849.297827:0:14418:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:2.0:1787338849.297846:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbd17ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874160212094208:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1787338849.297940:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338849.298360:0:15065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212094208 00000100:00100000:3.0:1787338849.298367:0:15065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212094208 00000100:00100000:3.0:1787338849.298427:0:15065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787338849.298437:0:15065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbd17ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1874160212094208:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1787338849.298564:0:15065:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1787338849.298568:0:15065:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1787338849 00002000:00010000:3.0:1787338849.298570:0:15065:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787338849.298573:0:15065:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787338849 -> 1787338849 00002000:00010000:3.0:1787338849.298575:0:15065:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1787338849.298610:0:15065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbd17ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3316:x1874160212094208:12345-0@lo:2:osp-syn-1-0.0 Request processed in 175us (669us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1787338849.298617:0:15065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:3.0:1787338849.298638:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1787338849.298662:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90bbd17ef480/2, rc 0, transno 8589934596 00000100:00100000:3.0:1787338849.298791:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbd17ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874160212094208:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787338849.298802:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787338849.298808:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc120000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874160212094336:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787338849.298856:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338849.298904:0:15063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212094336 00000100:00100000:3.0:1787338849.298908:0:15063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212094336 00000100:00100000:3.0:1787338849.298936:0:15063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787338849.298943:0:15063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc121f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3316:x1874160212094336:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1787338849.298957:0:15063:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:34 count 1 00010000:00010000:3.0:1787338849.298975:0:15063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdd98e68/0x83671231080c2ded lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338849.298996:0:15063:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004ba203ef/0x83671231080c2c0a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc2b expref: 7 pid: 15650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338849.299005:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x22:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1787338849.299009:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787338849.299014:0:15063:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdd98e68/0x83671231080c2ded lrc: 4/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338849.299038:0:15063:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004ba203ef/0x83671231080c2c0a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc2b expref: 7 pid: 15650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338849.299052:0:15063:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004ba203ef/0x83671231080c2c0a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc2b expref: 7 pid: 15650 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338849.299065:0:15063:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc123b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:15063:1874160212094464:192.168.201.53@tcp:104: 00000100:00100000:3.0:1787338849.299223:0:15063:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbedd6b9c0 going to sleep for 11 seconds 00000100:00080000:3.0:1787338849.299338:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787338849.302077:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338849.302144:0:15063:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc123b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:15063:1874160212094464:192.168.201.53@tcp:104: 00010000:00010000:3.0:1787338849.302172:0:15063:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fdd98e68/0x83671231080c2ded lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338849.302202:0:16493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192204928 00000100:00100000:3.0:1787338849.302207:0:16493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192204928 00010000:00010000:3.0:1787338849.302243:0:16493:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004ba203ef/0x83671231080c2c0a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc2b expref: 8 pid: 15650 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338849.302277:0:16493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 29 00000100:00100000:3.0:1787338849.302298:0:16493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc123480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f600308-4919-499d-be82-256c83420e0e+8:2359:x1874160192204928:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787338849.302312:0:16493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787338849.302317:0:16493:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004ba203ef/0x83671231080c2c0a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc2b expref: 8 pid: 15650 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338849.302329:0:16493:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004ba203ef/0x83671231080c2c0a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc2b expref: 8 pid: 15650 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338849.302350:0:16493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004ba203ef/0x83671231080c2c0a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc2b expref: 8 pid: 15650 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338849.302365:0:16493:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787338849.302370:0:16493:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787338849.302376:0:16493:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdd98e68/0x83671231080c2ded lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338849.302401:0:16493:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdd98e68/0x83671231080c2ded lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338849.302434:0:16493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787338849.302473:0:16493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc123480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f600308-4919-499d-be82-256c83420e0e+7:2359:x1874160192204928:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 176us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338849.302481:0:16493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 29 00000100:00080000:3.0:1787338849.302502:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787338849.302511:0:15063:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fdd98e68/0x83671231080c2ded lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338849.302520:0:15063:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdd98e68/0x83671231080c2ded lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338849.302529:0:15063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdd98e68/0x83671231080c2ded lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338849.302538:0:15063:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fdd98e68/0x83671231080c2ded lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338849.302552:0:15063:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787338849.303895:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbd17efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f600308-4919-499d-be82-256c83420e0e+15:14655:x1874160192204800:12345-192.168.201.53@tcp:44:lhsmtool_posix.0 Request processed in 88645us (89132us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338849.303906:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 102 00000100:00100000:3.0:1787338849.304056:0:15063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc121f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3316:x1874160212094336:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5112us (5208us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1787338849.304065:0:15063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:3.0:1787338849.304083:0:15652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787338849.304096:0:15652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fdd98e68/0x83671231080c2ded lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338849.304495:0:15652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbffef5200 already unused, calling callback (ffffffffc1546230) 00010000:00010000:3.0:1787338849.304501:0:15652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdd98e68/0x83671231080c2ded lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338849.304512:0:15652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdd98e68/0x83671231080c2ded lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338849.304529:0:15652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fdd98e68/0x83671231080c2ded lrc: 1/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338849.304536:0:15652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdd98e68/0x83671231080c2ded lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338849.304556:0:15652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338849.304558:0:15652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338849.304560:0:15652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787338849.308572:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000004:00080000:0.0:1787338849.309357:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90bbfc120000/2, rc 0, transno 8589934600 00000100:00100000:0.0:1787338849.309369:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc120000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874160212094336:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787338849.310133:0:15065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192205056 00000100:00100000:2.0:1787338849.310142:0:15065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192205056 00000100:00100000:0.0:1787338849.310300:0:15065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 25 00000100:00100000:0.0:1787338849.310318:0:15065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc123b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f600308-4919-499d-be82-256c83420e0e+9:2358:x1874160192205056:12345-192.168.201.53@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1787338849.399137:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787338849.399159:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbe8199880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874160212094592:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787338849.399237:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338849.399979:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf3e90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1874160212094976:0@lo:400:kworker.0 00000100:00100000:2.0:1787338849.400017:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338849.400046:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787338849.400051:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf3e91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874160212094848:0@lo:400:kworker.0 00000100:00100000:2.0:1787338849.400070:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338849.400092:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf3e92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1874160212095104:0@lo:400:kworker.0 00000100:00100000:2.0:1787338849.400135:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338849.400151:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787338849.400157:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf3e93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c0e6575-df80-419a-8cc7-cbad06c93254:3314:1874160212094720:0@lo:400:kworker.0 00000100:00100000:2.0:1787338849.400184:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338849.400259:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212094976 00000100:00100000:1.0:1787338849.400267:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212094976 00000100:00100000:1.0:1787338849.400435:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212094848 00000100:00100000:1.0:1787338849.400438:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212094848 00000100:00100000:1.0:1787338849.400448:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212095104 00000100:00100000:1.0:1787338849.400450:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212095104 00000100:00100000:0.0:1787338849.400504:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787338849.400516:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbd17ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874160212094976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787338849.400567:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbd17ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874160212094976:12345-0@lo:400:kworker.0 Request processed in 54us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338849.400574:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787338849.400592:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787338849.400597:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbd17ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874160212094848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787338849.400622:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbd17ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874160212094848:12345-0@lo:400:kworker.0 Request processed in 25us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338849.400628:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787338849.400820:0:15068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212094592 00000100:00100000:3.0:1787338849.400825:0:15068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212094592 00000100:00100000:3.0:1787338849.400869:0:15068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787338849.400890:0:15068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbe819a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1874160212094592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787338849.400906:0:15068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787338849.400942:0:15068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbe819a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1874160212094592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (1705us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338849.400958:0:15068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787338849.400978:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212094720 00000100:00100000:3.0:1787338849.400981:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212094720 00000100:00100000:3.0:1787338849.401001:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1787338849.401007:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee099050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c0e6575-df80-419a-8cc7-cbad06c93254+19:3314:x1874160212094720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787338849.401038:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee099050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c0e6575-df80-419a-8cc7-cbad06c93254+19:3314:x1874160212094720:12345-0@lo:400:kworker.0 Request processed in 31us (853us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338849.401045:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1787338849.401160:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf3e93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c0e6575-df80-419a-8cc7-cbad06c93254:3314:1874160212094720:0@lo:400:kworker.0 00000100:00100000:3.0:1787338849.401197:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbe8199880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874160212094592:0@lo:13:osp-pre-1-0.0 00000001:00080000:0.0:1787338849.401924:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934595 is committed 00000001:00080000:0.0:1787338849.401956:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934596 is committed 00000100:00100000:0.0:1787338849.402041:0:15065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc123b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f600308-4919-499d-be82-256c83420e0e+6:2358:x1874160192205056:12345-192.168.201.53@tcp:16:lhsmtool_posix.0 Request processed in 91720us (93475us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338849.402050:0:15065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 25 00000100:00100000:3.0:1787338849.403057:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf3e91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874160212094848:0@lo:400:kworker.0 00000100:00100000:3.0:1787338849.403070:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf3e90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1874160212094976:0@lo:400:kworker.0 00000100:00100000:3.0:1787338849.404805:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338849.405713:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192205312 00000100:00100000:0.0:1787338849.405725:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192205312 00000100:00100000:0.0:1787338849.405783:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 103 00000100:00100000:0.0:1787338849.405793:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc121880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f600308-4919-499d-be82-256c83420e0e+15:14655:x1874160192205312:12345-192.168.201.53@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787338849.405842:0:14382:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787338849.405901:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ca00/0x83671231080c2dd8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabca2 expref: 15 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338849.405939:0:14382:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff90bbc9a99600) 00010000:00010000:0.0:1787338849.405945:0:14382:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787338849.405974:0:14382:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c2df4 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338849.405988:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c2df4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338849.405997:0:14382:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c2df4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787338849.406177:0:14382:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a1eeaad9 reply state 0000000084b7242b transno 8589934662 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c2df4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338849.406187:0:14382:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787338849.406324:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc121880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f600308-4919-499d-be82-256c83420e0e+16:14655:x1874160192205312:12345-192.168.201.53@tcp:36:lhsmtool_posix.0 Request processed in 531us (1523us total) trans 8589934662 rc 0/0 00000100:00100000:0.0:1787338849.406332:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 103 00000100:00100000:0.0:1787338849.410311:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00010000:00010000:0.0:1787338849.410343:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c2df4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338849.410355:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c2df4 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338849.410363:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c2df4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338849.410369:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbc0031000 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:0.0:1787338849.410387:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c2df4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338849.410395:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c2df4 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338849.410972:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff90bbc9a99600) 00010000:00010000:0.0:1787338849.410976:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787338849.410982:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c2df4 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338849.410989:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c2df4 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338849.411022:0:15066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192205440 00000100:00100000:0.0:1787338849.411030:0:15066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192205440 00000100:00100000:0.0:1787338849.411116:0:15066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 26 00000100:00100000:0.0:1787338849.411126:0:15066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbefa41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f600308-4919-499d-be82-256c83420e0e+6:2358:x1874160192205440:12345-192.168.201.53@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787338849.411365:0:15066:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1787338849.411369:0:15066:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1787338849 -> 1787338848 00002000:00010000:0.0:1787338849.411371:0:15066:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1787338848 00002000:00010000:0.0:1787338849.411373:0:15066:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787338849 -> 1787338848 00002000:00010000:0.0:1787338849.411375:0:15066:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1787338849.412520:0:15066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbefa41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f600308-4919-499d-be82-256c83420e0e+7:2358:x1874160192205440:12345-192.168.201.53@tcp:2:lhsmtool_posix.0 Request processed in 1384us (2206us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1787338849.412530:0:15066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 26 00000100:00080000:2.0:1787338849.412713:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787338849.413028:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787338849.413039:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbe8272300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874160212095104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787338849.413113:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbe8272300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874160212095104:12345-0@lo:400:kworker.0 Request processed in 77us (12977us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338849.413119:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787338849.414188:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf3e92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1874160212095104:0@lo:400:kworker.0 00000100:00100000:0.0:1787338849.419233:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338849.419658:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192205696 00000100:00100000:3.0:1787338849.419669:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192205696 00000100:00100000:3.0:1787338849.419734:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 104 00000100:00100000:3.0:1787338849.419744:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbe8198e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f600308-4919-499d-be82-256c83420e0e+15:14655:x1874160192205696:12345-192.168.201.53@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787338849.419825:0:14381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5200/0x83671231080c2dfb lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338849.419847:0:14381:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045000/0x83671231080c2dbc lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc94 expref: 15 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338849.420013:0:14381:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5200/0x83671231080c2dfb lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338849.420051:0:14381:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045000/0x83671231080c2dbc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc94 expref: 15 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338849.420066:0:14381:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045000/0x83671231080c2dbc lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc94 expref: 15 pid: 14383 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338849.420081:0:14381:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc121c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14381:1874160212095232:192.168.201.53@tcp:104: 00000100:00100000:3.0:1787338849.420195:0:14381:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbedd6b480 going to sleep for 11 seconds 00000100:00100000:3.0:1787338849.423951:0:14381:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc121c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14381:1874160212095232:192.168.201.53@tcp:104: 00000100:00100000:1.0:1787338849.423971:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00010000:00010000:3.0:1787338849.423986:0:14381:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5200/0x83671231080c2dfb lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338849.424111:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192205824 00000100:00100000:2.0:1787338849.424119:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192205824 00010000:00010000:2.0:1787338849.424153:0:14367:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045000/0x83671231080c2dbc lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc94 expref: 16 pid: 14383 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338849.424196:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 30 00000100:00100000:2.0:1787338849.424205:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf3e92a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f600308-4919-499d-be82-256c83420e0e+16:2358:x1874160192205824:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787338849.424219:0:14367:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787338849.424225:0:14367:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045000/0x83671231080c2dbc lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc94 expref: 16 pid: 14383 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338849.424238:0:14367:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045000/0x83671231080c2dbc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc94 expref: 16 pid: 14383 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338849.424260:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045000/0x83671231080c2dbc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc94 expref: 16 pid: 14383 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338849.424276:0:14367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff90bbc9a99600) 00010000:00010000:2.0:1787338849.424291:0:14367:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5200/0x83671231080c2dfb lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338849.424301:0:14367:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5200/0x83671231080c2dfb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338849.424309:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5200/0x83671231080c2dfb lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338849.424343:0:14367:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787338849.424393:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf3e92a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f600308-4919-499d-be82-256c83420e0e+15:2358:x1874160192205824:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 189us (424us total) trans 0 rc 0/0 00010000:00010000:3.0:1787338849.424401:0:14381:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5200/0x83671231080c2dfb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338849.424411:0:14381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5200/0x83671231080c2dfb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338849.424439:0:14381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5200/0x83671231080c2dfb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338849.424446:0:14381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5200/0x83671231080c2dfb lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338849.424453:0:14381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5200/0x83671231080c2dfb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338849.424468:0:14381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbffef5200 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:3.0:1787338849.424473:0:14381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5200/0x83671231080c2dfb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338849.424480:0:14381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5200/0x83671231080c2dfb lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338849.424491:0:14381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff90bbc9a99600) 00010000:00010000:3.0:1787338849.424494:0:14381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1787338849.424498:0:14381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5200/0x83671231080c2dfb lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338849.424508:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 30 00010000:00010000:3.0:1787338849.424509:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5200/0x83671231080c2dfb lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338849.424554:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbe8198e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f600308-4919-499d-be82-256c83420e0e+14:14655:x1874160192205696:12345-192.168.201.53@tcp:55:lhsmtool_posix.0 Request processed in 4810us (5329us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787338849.424563:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 104 00000100:00100000:0.0:1787338849.426236:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338849.426310:0:15650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192205952 00000100:00100000:3.0:1787338849.426318:0:15650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192205952 00000100:00100000:3.0:1787338849.426420:0:15650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 27 00000100:00100000:3.0:1787338849.426429:0:15650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbe819b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f600308-4919-499d-be82-256c83420e0e+7:2357:x1874160192205952:12345-192.168.201.53@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787338849.426469:0:15650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e6452a34/0x83671231080c2e02 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338849.426489:0:15650:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fb7e3e45/0x83671231080c2de6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabcb0 expref: 7 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338849.426513:0:15650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787338849.426518:0:15650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787338849.426523:0:15650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e6452a34/0x83671231080c2e02 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338849.426568:0:15650:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fb7e3e45/0x83671231080c2de6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabcb0 expref: 7 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338849.426583:0:15650:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fb7e3e45/0x83671231080c2de6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabcb0 expref: 7 pid: 15066 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338849.426597:0:15650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc121c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15650:1874160212095360:192.168.201.53@tcp:104: 00000100:00100000:3.0:1787338849.426670:0:15650:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbedd6b480 going to sleep for 11 seconds 00000100:00100000:0.0:1787338849.436569:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338849.436655:0:16493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192206080 00000100:00100000:2.0:1787338849.436665:0:16493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192206080 00010000:00010000:2.0:1787338849.436716:0:16493:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fb7e3e45/0x83671231080c2de6 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabcb0 expref: 8 pid: 15066 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338849.436763:0:16493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 31 00000100:00100000:2.0:1787338849.436772:0:16493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbd1728850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f600308-4919-499d-be82-256c83420e0e+8:2359:x1874160192206080:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787338849.436787:0:16493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787338849.436808:0:16493:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fb7e3e45/0x83671231080c2de6 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabcb0 expref: 8 pid: 15066 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338849.436823:0:16493:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fb7e3e45/0x83671231080c2de6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabcb0 expref: 8 pid: 15066 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338849.436847:0:16493:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787338849.436852:0:16493:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787338849.436858:0:16493:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e6452a34/0x83671231080c2e02 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338849.436869:0:16493:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e6452a34/0x83671231080c2e02 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338849.436922:0:16493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787338849.436935:0:15650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb7e3e45/0x83671231080c2de6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabcb0 expref: 8 pid: 15066 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338849.436955:0:15650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc121c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15650:1874160212095360:192.168.201.53@tcp:104: 00000100:00100000:2.0:1787338849.436973:0:16493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbd1728850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f600308-4919-499d-be82-256c83420e0e+7:2359:x1874160192206080:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 200us (414us total) trans 0 rc 0/0 00010000:00010000:3.0:1787338849.436982:0:15650:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e6452a34/0x83671231080c2e02 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338849.437000:0:16493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 31 00010000:00010000:3.0:1787338849.437004:0:15650:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e6452a34/0x83671231080c2e02 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338849.437014:0:15650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e6452a34/0x83671231080c2e02 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338849.437047:0:15650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e6452a34/0x83671231080c2e02 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338849.437057:0:15650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e6452a34/0x83671231080c2e02 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338849.437065:0:15650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e6452a34/0x83671231080c2e02 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338849.437073:0:15650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbffef5a00 already unused, calling callback (ffffffffc1546230) 00010000:00010000:3.0:1787338849.437077:0:15650:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6452a34/0x83671231080c2e02 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338849.437086:0:15650:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6452a34/0x83671231080c2e02 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338849.437099:0:15650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e6452a34/0x83671231080c2e02 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338849.437107:0:15650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e6452a34/0x83671231080c2e02 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338849.437158:0:15650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbe819b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f600308-4919-499d-be82-256c83420e0e+6:2357:x1874160192205952:12345-192.168.201.53@tcp:1:lhsmtool_posix.0 Request processed in 10729us (10927us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338849.437175:0:15650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 27 00000100:00100000:1.0:1787338849.443484:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338849.443559:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192206336 00000100:00100000:0.0:1787338849.443627:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192206336 00000100:00100000:0.0:1787338849.443691:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 105 00000100:00100000:0.0:1787338849.443702:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf3e90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f600308-4919-499d-be82-256c83420e0e+14:14655:x1874160192206336:12345-192.168.201.53@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787338849.443774:0:14382:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030600/0x83671231080c2e09 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338849.443792:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030600/0x83671231080c2e09 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338849.443804:0:14382:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030600/0x83671231080c2e09 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338849.444964:0:14382:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ca00/0x83671231080c2e10 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338849.444999:0:14382:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c400/0x83671231080c2dca lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc9b expref: 15 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338849.445009:0:14382:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ca00/0x83671231080c2e10 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338849.445044:0:14382:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c400/0x83671231080c2dca lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc9b expref: 15 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338849.445060:0:14382:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c400/0x83671231080c2dca lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc9b expref: 15 pid: 14383 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338849.445075:0:14382:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf3e93b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14382:1874160212095488:192.168.201.53@tcp:104: 00000100:00100000:1.0:1787338849.445158:0:14382:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbfaccc900 going to sleep for 11 seconds 00000100:00100000:0.0:1787338849.450125:0:14382:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf3e93b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14382:1874160212095488:192.168.201.53@tcp:104: 00000100:00100000:1.0:1787338849.450126:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00010000:00010000:0.0:1787338849.450159:0:14382:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ca00/0x83671231080c2e10 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338849.450456:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192206464 00000100:00100000:3.0:1787338849.450465:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192206464 00010000:00010000:3.0:1787338849.450503:0:14366:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c400/0x83671231080c2dca lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc9b expref: 16 pid: 14383 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338849.450681:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 32 00000100:00100000:3.0:1787338849.450691:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf3e90380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f600308-4919-499d-be82-256c83420e0e+16:2359:x1874160192206464:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787338849.450705:0:14366:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787338849.450712:0:14366:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c400/0x83671231080c2dca lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc9b expref: 16 pid: 14383 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338849.450726:0:14366:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c400/0x83671231080c2dca lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc9b expref: 16 pid: 14383 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338849.450747:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c400/0x83671231080c2dca lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc9b expref: 16 pid: 14383 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338849.450773:0:14366:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff90bbc9a99600) 00010000:00010000:3.0:1787338849.450778:0:14366:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ca00/0x83671231080c2e10 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338849.450788:0:14366:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ca00/0x83671231080c2e10 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338849.450796:0:14366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ca00/0x83671231080c2e10 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338849.450841:0:14366:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787338849.450953:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf3e90380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f600308-4919-499d-be82-256c83420e0e+15:2359:x1874160192206464:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 261us (831us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338849.450961:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 32 00010000:00010000:0.0:1787338849.451016:0:14382:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ca00/0x83671231080c2e10 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338849.451023:0:14382:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ca00/0x83671231080c2e10 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787338849.451199:0:14382:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934663 00000001:00080000:0.0:1787338849.451417:0:14382:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934664 00000001:00080000:0.0:1787338849.451465:0:14382:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934665 00000100:00100000:0.0:1787338849.451555:0:14382:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbe8198700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14382:1874160212095616:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787338849.451633:0:14382:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338849.451673:0:14382:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbd1649540 going to sleep for 11 seconds 00000100:00100000:1.0:1787338849.451771:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212095616 00000100:00100000:1.0:1787338849.451778:0:14386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212095616 00000100:00100000:1.0:1787338849.451821:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787338849.451830:0:14386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbe819b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:14382:x1874160212095616:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787338849.451992:0:14386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbe819b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:14382:x1874160212095616:12345-0@lo:1000:mdt00_001.0 Request processed in 163us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338849.452000:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787338849.452078:0:14382:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934596 gen 2 00000004:00080000:0.0:1787338849.452089:0:14382:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90bbd17ef480, transno 8589934596 00000100:00100000:0.0:1787338849.452110:0:14382:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbe8198700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14382:1874160212095616:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1787338849.453077:0:14382:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934666 00000100:00100000:0.0:1787338849.453133:0:14382:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbe8198700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14382:1874160212095744:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787338849.453175:0:14382:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338849.453193:0:14382:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbd1649e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787338849.453679:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212095744 00000100:00100000:1.0:1787338849.453686:0:14386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212095744 00000100:00100000:1.0:1787338849.453726:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787338849.453735:0:14386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbe819a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:14382:x1874160212095744:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787338849.453941:0:14386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbe819a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14382:x1874160212095744:12345-0@lo:1000:mdt00_001.0 Request processed in 206us (765us total) trans 8589934598 rc 0/0 00000100:00100000:1.0:1787338849.453948:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787338849.453999:0:14382:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbe8198700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14382:1874160212095744:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1787338849.454036:0:14382:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ca00/0x83671231080c2e10 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338849.454048:0:14382:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ca00/0x83671231080c2e10 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338849.454056:0:14382:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ca00/0x83671231080c2e10 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338849.454063:0:14382:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbfbe9ca00 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:0.0:1787338849.454067:0:14382:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ca00/0x83671231080c2e10 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338849.454075:0:14382:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ca00/0x83671231080c2e10 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338849.454090:0:14382:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff90bbc9a99600) 00010000:00010000:0.0:1787338849.454093:0:14382:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787338849.454097:0:14382:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ca00/0x83671231080c2e10 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338849.454104:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ca00/0x83671231080c2e10 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338849.454148:0:14382:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c2d5a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338849.454154:0:14382:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c2d5a lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338849.454162:0:14382:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c2d5a lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338849.454167:0:14382:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e2a00 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:0.0:1787338849.454170:0:14382:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c2d5a lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338849.454176:0:14382:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c2d5a lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338849.454184:0:14382:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff90bbc8283500) 00010000:00010000:0.0:1787338849.454187:0:14382:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787338849.454193:0:14382:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045e00/0x83671231080c2d61 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc7f expref: 18 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338849.454205:0:14382:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045e00/0x83671231080c2d61 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc7f expref: 18 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338849.454215:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045e00/0x83671231080c2d61 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc7f expref: 18 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338849.454241:0:14382:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045e00/0x83671231080c2d61 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc7f expref: 18 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338849.454264:0:14382:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbe819aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14382:1874160212095872:192.168.201.53@tcp:105: 00000100:00100000:0.0:1787338849.454332:0:14382:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbd1649e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787338849.459556:0:14382:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbe819aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14382:1874160212095872:192.168.201.53@tcp:105: 00010000:00010000:2.0:1787338849.459604:0:14382:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c2d5a lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338849.459616:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c2d5a lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338849.459666:0:14382:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c2e17 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338849.459694:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c2e17 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338849.459705:0:14382:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c2e17 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338849.459716:0:14382:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c2e17 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338849.459723:0:14382:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c2e17 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338849.459735:0:14382:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c2e17 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338849.459741:0:14382:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e2600 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:2.0:1787338849.459745:0:14382:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c2e17 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338849.459752:0:14382:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c2e17 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338849.460110:0:14382:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff90bbc8283500) 00010000:00010000:2.0:1787338849.460113:0:14382:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787338849.460117:0:14382:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c2e17 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338849.460123:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c2e17 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338849.460134:0:14382:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030600/0x83671231080c2e09 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338849.460140:0:14382:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030600/0x83671231080c2e09 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338849.460146:0:14382:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030600/0x83671231080c2e09 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338849.460152:0:14382:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbc0030600 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:2.0:1787338849.460155:0:14382:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030600/0x83671231080c2e09 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338849.460161:0:14382:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030600/0x83671231080c2e09 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338849.460167:0:14382:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff90bbc8283500) 00010000:00010000:2.0:1787338849.460170:0:14382:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787338849.460173:0:14382:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030600/0x83671231080c2e09 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338849.460179:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030600/0x83671231080c2e09 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338849.460491:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf3e90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f600308-4919-499d-be82-256c83420e0e+18:14655:x1874160192206336:12345-192.168.201.53@tcp:57:lhsmtool_posix.0 Request processed in 16788us (17014us total) trans 8589934667 rc 0/0 00000100:00100000:2.0:1787338849.460502:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 105 00000020:00080000:2.0:1787338849.460507:0:14382:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1787338849.467128:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338849.470155:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192206592 00000100:00100000:3.0:1787338849.470171:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192206592 00000100:00100000:3.0:1787338849.470270:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 24 00000100:00100000:3.0:1787338849.470293:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbe8272a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f600308-4919-499d-be82-256c83420e0e+18:14654:x1874160192206592:12345-192.168.201.53@tcp:49:lfs.0 00000100:00100000:3.0:1787338849.470553:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbe8272a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f600308-4919-499d-be82-256c83420e0e+18:14654:x1874160192206592:12345-192.168.201.53@tcp:49:lfs.0 Request processed in 272us (3435us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338849.470561:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 24 00000100:00100000:1.0:1787338849.471216:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000040:00080000:0.0:1787338849.473313:0:14412:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787338849.473324:0:14412:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787338849.473363:0:14412:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:0.0:1787338849.473369:0:14412:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1787338849.476031:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192206848 00000100:00100000:3.0:1787338849.476046:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192206848 00000100:00100000:3.0:1787338849.476160:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 25 00000100:00100000:3.0:1787338849.476171:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf3e91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f600308-4919-499d-be82-256c83420e0e+18:14655:x1874160192206848:12345-192.168.201.53@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787338849.477416:0:14384:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787338849.477529:0:14384:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934668 00010000:00010000:3.0:1787338849.479207:0:14384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5a00/0x83671231080c2e1e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338849.479229:0:14384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5a00/0x83671231080c2e1e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338849.479242:0:14384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5a00/0x83671231080c2e1e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338849.479253:0:14384:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5a00/0x83671231080c2e1e lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338849.479276:0:14384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5a00/0x83671231080c2e1e lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338849.479298:0:14384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5a00/0x83671231080c2e1e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338849.479322:0:14384:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787338849.479471:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf3e91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f600308-4919-499d-be82-256c83420e0e+20:14655:x1874160192206848:12345-192.168.201.53@tcp:35:lhsmtool_posix.0 Request processed in 3295us (8249us total) trans 8589934669 rc 0/0 00000100:00100000:3.0:1787338849.479484:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 25 00000020:00080000:3.0:1787338849.479492:0:14384:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787338849.480263:0:14369:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787338849.480272:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5a00/0x83671231080c2e1e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338849.480295:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbffef5a00 already unused, calling callback (ffffffffc1546230) 00010000:00010000:0.0:1787338849.480301:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5a00/0x83671231080c2e1e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338849.480311:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5a00/0x83671231080c2e1e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338849.480341:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff90bbc9a99a00) 00010000:00010000:0.0:1787338849.480345:0:14369:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787338849.480350:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5a00/0x83671231080c2e1e lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338849.480356:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef5a00/0x83671231080c2e1e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338849.480379:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787338849.480381:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787338849.480383:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787338849.485981:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338849.486216:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192207104 00000100:00100000:3.0:1787338849.486227:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192207104 00000100:00100000:3.0:1787338849.486300:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 106 00000100:00100000:3.0:1787338849.486312:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbe8271500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f600308-4919-499d-be82-256c83420e0e+20:14654:x1874160192207104:12345-192.168.201.53@tcp:58:lfs.0 00000040:00080000:3.0:1787338849.487056:0:14381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].3, 136 off8600 00000100:00100000:3.0:1787338849.487201:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbe8271500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f600308-4919-499d-be82-256c83420e0e+20:14654:x1874160192207104:12345-192.168.201.53@tcp:58:lfs.0 Request processed in 890us (1227us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338849.487210:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 106 00000100:00100000:2.0:1787338849.524717:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338849.524818:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192207232 00000100:00100000:0.0:1787338849.524840:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192207232 00000100:00100000:0.0:1787338849.524931:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 107 00000100:00100000:0.0:1787338849.524941:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbe8270e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f600308-4919-499d-be82-256c83420e0e+20:14657:x1874160192207232:12345-192.168.201.53@tcp:101:lfs.0 00010000:00010000:0.0:1787338849.524964:0:14382:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787338849.524983:0:14382:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c2e25 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadabcb7 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338849.525046:0:14382:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030600/0x83671231080c2e2c lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338849.525061:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030600/0x83671231080c2e2c lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338849.525071:0:14382:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030600/0x83671231080c2e2c lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338849.525086:0:14382:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031400/0x83671231080c2e33 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338849.525094:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031400/0x83671231080c2e33 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338849.525100:0:14382:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031400/0x83671231080c2e33 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338849.525572:0:14382:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c2e3a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338849.525584:0:14382:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031200/0x83671231080c2d4c lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc78 expref: 21 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338849.525593:0:14382:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c2e3a lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338849.525632:0:14382:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031200/0x83671231080c2d4c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc78 expref: 21 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338849.525646:0:14382:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031200/0x83671231080c2d4c lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc78 expref: 21 pid: 14383 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338849.525660:0:14382:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbe819aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14382:1874160212096000:192.168.201.53@tcp:104: 00000100:00100000:0.0:1787338849.525748:0:14382:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbd1649240 going to sleep for 11 seconds 00000100:00100000:1.0:1787338849.528986:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338849.529092:0:14382:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbe819aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14382:1874160212096000:192.168.201.53@tcp:104: 00010000:00010000:0.0:1787338849.529130:0:14382:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c2e3a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338849.529579:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192207488 00000100:00100000:3.0:1787338849.529587:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192207488 00000100:00100000:3.0:1787338849.529642:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 26 00000100:00100000:3.0:1787338849.529651:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf3e93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f600308-4919-499d-be82-256c83420e0e+22:13750:x1874160192207488:12345-192.168.201.53@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787338849.529906:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf3e93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f600308-4919-499d-be82-256c83420e0e+23:13750:x1874160192207488:12345-192.168.201.53@tcp:35:ldlm_bl.0 Request processed in 223us (898us total) trans 8589934670 rc 0/0 00000100:00100000:3.0:1787338849.529914:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 26 00000100:00100000:2.0:1787338849.535063:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338849.535229:0:16493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192207616 00000100:00100000:3.0:1787338849.535239:0:16493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192207616 00010000:00010000:3.0:1787338849.535287:0:16493:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031200/0x83671231080c2d4c lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc78 expref: 23 pid: 14383 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338849.535333:0:16493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 33 00000100:00100000:3.0:1787338849.535343:0:16493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbe8270000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f600308-4919-499d-be82-256c83420e0e+23:2359:x1874160192207616:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787338849.535357:0:16493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787338849.535363:0:16493:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031200/0x83671231080c2d4c lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc78 expref: 23 pid: 14383 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338849.535377:0:16493:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031200/0x83671231080c2d4c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc78 expref: 23 pid: 14383 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338849.535398:0:16493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031200/0x83671231080c2d4c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc78 expref: 23 pid: 14383 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338849.535417:0:16493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff90bbc8283500) 00010000:00010000:3.0:1787338849.535422:0:16493:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c2e3a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338849.535432:0:16493:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c2e3a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338849.535440:0:16493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c2e3a lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338849.535470:0:16493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787338849.535520:0:16493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbe8270000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f600308-4919-499d-be82-256c83420e0e+22:2359:x1874160192207616:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 178us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338849.535541:0:16493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 33 00010000:00010000:2.0:1787338849.536189:0:14382:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c2e3a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338849.536200:0:14382:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c2e3a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787338849.536254:0:14382:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00000004:00200000:2.0:1787338849.536260:0:14382:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787338849.536290:0:14382:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c2e3a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338849.536302:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c2e3a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338849.536312:0:14382:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030600/0x83671231080c2e2c lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338849.536327:0:14382:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030600/0x83671231080c2e2c lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338849.536334:0:14382:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030600/0x83671231080c2e2c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338849.536351:0:14382:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbc0030600 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:2.0:1787338849.536356:0:14382:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030600/0x83671231080c2e2c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338849.536363:0:14382:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030600/0x83671231080c2e2c lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338849.536374:0:14382:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90bbc2a93400) 00010000:00010000:2.0:1787338849.536377:0:14382:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787338849.536381:0:14382:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030600/0x83671231080c2e2c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338849.536387:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030600/0x83671231080c2e2c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338849.536400:0:14382:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031400/0x83671231080c2e33 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338849.536406:0:14382:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031400/0x83671231080c2e33 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338849.536412:0:14382:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031400/0x83671231080c2e33 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338849.536417:0:14382:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbc0031400 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:2.0:1787338849.536420:0:14382:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031400/0x83671231080c2e33 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338849.536426:0:14382:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031400/0x83671231080c2e33 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338849.536451:0:14382:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff90bbeb14de00) 00010000:00010000:2.0:1787338849.536454:0:14382:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787338849.536457:0:14382:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031400/0x83671231080c2e33 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338849.536463:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031400/0x83671231080c2e33 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338849.536500:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030400/0x83671231080c2e25 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabcb7 expref: 22 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338849.536514:0:14382:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c2e3a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabcb7 expref: 21 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338849.536521:0:14382:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff90bbc8283500) 00010000:00010000:2.0:1787338849.536524:0:14382:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787338849.536526:0:14382:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbc0031000, rc 0) 00000100:00100000:2.0:1787338849.536571:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbe8270e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f600308-4919-499d-be82-256c83420e0e+21:14657:x1874160192207232:12345-192.168.201.53@tcp:101:lfs.0 Request processed in 11631us (11864us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338849.536578:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 107 00000100:00100000:2.0:1787338850.121093:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338850.121129:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338850.121169:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338850.121212:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338850.121243:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192207744 00000100:00100000:2.0:1787338850.121255:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192207744 00000100:00100000:2.0:1787338850.121317:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 123 00000100:00100000:2.0:1787338850.121328:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee09ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1770da5-776a-45c2-a341-2fca212f2072+13:2357:x1874160192207744:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:2.0:1787338850.121410:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee09ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1770da5-776a-45c2-a341-2fca212f2072+13:2357:x1874160192207744:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 85us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338850.121418:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 123 00000100:00100000:0.0:1787338850.121569:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192207872 00000100:00100000:0.0:1787338850.121575:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192207872 00000100:00100000:0.0:1787338850.121628:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 28 00000100:00100000:0.0:1787338850.121636:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbe8271c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0bebf184-ca0d-4db5-82d4-d664d446db69+6:2357:x1874160192207872:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:0.0:1787338850.121685:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbe8271c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0bebf184-ca0d-4db5-82d4-d664d446db69+6:2357:x1874160192207872:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 50us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338850.121693:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 28 00000100:00100000:0.0:1787338850.121712:0:15066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192208128 00000100:00100000:0.0:1787338850.121716:0:15066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192208128 00000100:00100000:0.0:1787338850.121740:0:15066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192208000 00000100:00100000:0.0:1787338850.121743:0:15066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192208000 00000100:00100000:0.0:1787338850.121766:0:15066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 16 00000100:00100000:0.0:1787338850.121772:0:15066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbe8271f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0bebf184-ca0d-4db5-82d4-d664d446db69+5:2357:x1874160192208128:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:0.0:1787338850.121806:0:15066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbe8271f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0bebf184-ca0d-4db5-82d4-d664d446db69+5:2357:x1874160192208128:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 34us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338850.121812:0:15066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 16 00000100:00100000:0.0:1787338850.121823:0:15066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 17 00000100:00100000:0.0:1787338850.121829:0:15066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbe8273b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0bebf184-ca0d-4db5-82d4-d664d446db69+5:2357:x1874160192208000:12345-192.168.201.53@tcp:400:kworker.0 00000100:00080000:2.0:1787338850.121840:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787338850.121846:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787338850.121850:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787338850.121866:0:15066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbe8273b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0bebf184-ca0d-4db5-82d4-d664d446db69+5:2357:x1874160192208000:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 36us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338850.121894:0:15066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 17 00010000:00010000:3.0:1787338850.231537:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787338850.305013:0:16699:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787338850.305023:0:16699:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787338850.305065:0:16699:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 4 count 4 00000040:00080000:1.0:1787338850.305072:0:16699:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000040:00080000:2.0:1787338850.490315:0:14412:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787338850.490325:0:14412:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787338850.490367:0:14412:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 4 count 4 00000040:00080000:2.0:1787338850.490374:0:14412:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1787338850.490498:0:14412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbe8273800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14412:1874160212096128:192.168.201.53@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787338850.490592:0:14412:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbf3c7f180 going to sleep for 11 seconds 00000100:00100000:1.0:1787338850.500397:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338850.500428:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192208256 00000100:00100000:1.0:1787338850.500437:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192208256 00000100:00100000:1.0:1787338850.500490:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 108 00000100:00100000:1.0:1787338850.500500:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf3e93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f600308-4919-499d-be82-256c83420e0e+22:14670:x1874160192208256:12345-192.168.201.53@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787338850.500541:0:14382:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787338850.500637:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf3e93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f600308-4919-499d-be82-256c83420e0e+22:14670:x1874160192208256:12345-192.168.201.53@tcp:53:lhsmtool_posix.0 Request processed in 138us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338850.500644:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 108 00000100:00080000:1.0:1787338850.500664:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787338850.501382:0:14412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbe8273800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14412:1874160212096128:192.168.201.53@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787338850.510727:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338850.510910:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192208512 00000100:00100000:2.0:1787338850.510921:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192208512 00000100:00100000:2.0:1787338850.510973:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 109 00000100:00100000:2.0:1787338850.510984:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf3e93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f600308-4919-499d-be82-256c83420e0e+21:14670:x1874160192208512:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787338850.511004:0:14383:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787338850.511025:0:14383:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c2e41 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadabcbe expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338850.511130:0:14383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c2e48 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338850.511145:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c2e48 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338850.511157:0:14383:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c2e48 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787338850.511187:0:14383:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00010000:00010000:2.0:1787338850.511321:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c2e41 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabcbe expref: 24 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338850.511342:0:14383:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c2e48 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabcbe expref: 23 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338850.511351:0:14383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff90bbc8283500) 00010000:00010000:2.0:1787338850.511354:0:14383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787338850.511357:0:14383:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf40e2600, rc 0) 00000100:00100000:2.0:1787338850.511413:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf3e93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f600308-4919-499d-be82-256c83420e0e+23:14670:x1874160192208512:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 Request processed in 431us (697us total) trans 8589934671 rc 0/0 00000100:00100000:2.0:1787338850.511420:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 109 00000100:00100000:0.0:1787338850.523735:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338850.523771:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192208768 00000100:00100000:0.0:1787338850.523779:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192208768 00000100:00100000:0.0:1787338850.523825:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 110 00000100:00100000:0.0:1787338850.523834:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbe819aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f600308-4919-499d-be82-256c83420e0e+23:14670:x1874160192208768:12345-192.168.201.53@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787338850.523931:0:14381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030200/0x83671231080c2e56 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338850.523948:0:14381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030200/0x83671231080c2e56 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338850.523959:0:14381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030200/0x83671231080c2e56 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338850.524182:0:14381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030200/0x83671231080c2e56 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338850.524190:0:14381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030200/0x83671231080c2e56 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338850.524208:0:14381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030200/0x83671231080c2e56 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338850.524214:0:14381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbc0030200 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:0.0:1787338850.524218:0:14381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030200/0x83671231080c2e56 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338850.524227:0:14381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030200/0x83671231080c2e56 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338850.524239:0:14381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff90bbc8283500) 00010000:00010000:0.0:1787338850.524242:0:14381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787338850.524246:0:14381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030200/0x83671231080c2e56 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338850.524252:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0030200/0x83671231080c2e56 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338850.524387:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbe819aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f600308-4919-499d-be82-256c83420e0e+24:14670:x1874160192208768:12345-192.168.201.53@tcp:57:lhsmtool_posix.0 Request processed in 553us (657us total) trans 8589934672 rc 0/0 00000100:00100000:0.0:1787338850.524395:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 110 00000040:00080000:2.0:1787338850.526515:0:14412:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787338850.526524:0:14412:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787338850.528412:0:14412:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 4 00000040:00080000:2.0:1787338850.528428:0:14412:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1787338850.529452:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338850.529487:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192208896 00000100:00100000:2.0:1787338850.529496:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192208896 00000100:00100000:2.0:1787338850.529549:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 3 00000100:00100000:2.0:1787338850.529558:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbe8272d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f600308-4919-499d-be82-256c83420e0e+24:2359:x1874160192208896:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787338850.529572:0:14367:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787338850.529595:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2600/0x83671231080c2e48 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabcbe expref: 24 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338850.529638:0:14367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff90bbc8283500) 00010000:00010000:2.0:1787338850.529643:0:14367:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787338850.532444:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbe8272d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f600308-4919-499d-be82-256c83420e0e+23:2359:x1874160192208896:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 2875us (2988us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338850.532456:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 3 00000100:00100000:1.0:1787338850.542615:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338850.542680:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192209152 00000100:00100000:3.0:1787338850.542689:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192209152 00000100:00100000:3.0:1787338850.542739:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 27 00000100:00100000:3.0:1787338850.542750:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf3e92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f600308-4919-499d-be82-256c83420e0e+23:14670:x1874160192209152:12345-192.168.201.53@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787338850.543012:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf3e92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f600308-4919-499d-be82-256c83420e0e+24:14670:x1874160192209152:12345-192.168.201.53@tcp:35:lhsmtool_posix.0 Request processed in 263us (406us total) trans 8589934673 rc 0/0 00000100:00100000:3.0:1787338850.543020:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 27 00010000:00010000:3.0:1787338851.254070:0:15652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787338851.975980:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbe8270a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874160212096256:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787338851.976081:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338851.985258:0:15068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212096256 00000100:00100000:2.0:1787338851.985278:0:15068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212096256 00000100:00100000:2.0:1787338851.985348:0:15068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787338851.985373:0:15068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbe8198380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3315:x1874160212096256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787338851.985823:0:15068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787338851.985928:0:15068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbe8198380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3315:x1874160212096256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 570us (9846us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338851.985936:0:15068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787338851.985988:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbe8270a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874160212096256:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787338852.005752:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1787338852.080733:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00000001:00080000:2.0:1787338852.080750:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00000001:00080000:2.0:1787338852.080756:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00000001:00080000:2.0:1787338852.080762:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00010000:00010000:0.0:1787338852.278002:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787338852.535549:0:16750:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787338852.535561:0:16750:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787338852.535606:0:16750:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 4 count 4 00000040:00080000:2.0:1787338852.535612:0:16750:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1787338852.945216:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338852.952424:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192209408 00000100:00100000:1.0:1787338852.952442:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192209408 00000100:00100000:1.0:1787338852.952514:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 111 00000100:00100000:1.0:1787338852.952527:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbe8270a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f600308-4919-499d-be82-256c83420e0e+24:14690:x1874160192209408:12345-192.168.201.53@tcp:101:lfs.0 00010000:00010000:1.0:1787338852.952553:0:14382:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787338852.952586:0:14382:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c200/0x83671231080c2e5d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadabcc5 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338852.952706:0:14382:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9dc00/0x83671231080c2e64 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338852.952721:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9dc00/0x83671231080c2e64 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338852.952733:0:14382:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9dc00/0x83671231080c2e64 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787338852.952746:0:14382:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00010000:00010000:1.0:1787338852.952890:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c200/0x83671231080c2e5d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabcc5 expref: 27 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338852.952910:0:14382:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9dc00/0x83671231080c2e64 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabcc5 expref: 26 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338852.952919:0:14382:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff90bbc8283500) 00010000:00010000:1.0:1787338852.952923:0:14382:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787338852.952927:0:14382:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbfbe9dc00, rc 0) 00000100:00100000:1.0:1787338852.952999:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbe8270a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f600308-4919-499d-be82-256c83420e0e+26:14690:x1874160192209408:12345-192.168.201.53@tcp:101:lfs.0 Request processed in 475us (7795us total) trans 8589934674 rc 0/0 00000100:00100000:1.0:1787338852.953006:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 111 00000100:00080000:1.0:1787338852.953025:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787338852.970308:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338852.970381:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192209536 00000100:00100000:2.0:1787338852.970391:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192209536 00000100:00100000:2.0:1787338852.970448:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 112 00000100:00100000:2.0:1787338852.970476:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf3e92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f600308-4919-499d-be82-256c83420e0e+26:14690:x1874160192209536:12345-192.168.201.53@tcp:54:lfs.0 00010000:00010000:2.0:1787338852.970543:0:14383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c2e72 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338852.970561:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c2e72 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338852.970573:0:14383:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c2e72 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338852.970597:0:14383:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c2e72 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338852.970603:0:14383:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c2e72 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338852.970621:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c2e72 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338852.970627:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e2a00 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:2.0:1787338852.970632:0:14383:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c2e72 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338852.970640:0:14383:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c2e72 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338852.970650:0:14383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff90bbc8283500) 00010000:00010000:2.0:1787338852.970653:0:14383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787338852.970657:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c2e72 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338852.970663:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c2e72 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338852.970732:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf3e92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f600308-4919-499d-be82-256c83420e0e+26:14690:x1874160192209536:12345-192.168.201.53@tcp:54:lfs.0 Request processed in 258us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338852.970740:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 112 00000100:00100000:1.0:1787338853.108669:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338853.115571:0:15066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192209664 00000100:00100000:0.0:1787338853.115589:0:15066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192209664 00000100:00100000:0.0:1787338853.115709:0:15066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 28 00000100:00100000:0.0:1787338853.115724:0:15066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf3e90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f600308-4919-499d-be82-256c83420e0e+6:2358:x1874160192209664:12345-192.168.201.53@tcp:101:cat.0 00010000:00010000:0.0:1787338853.115762:0:15066:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787338853.115784:0:15066:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000085548f5e/0x83671231080c2e79 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadabccc expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787338853.115816:0:15066:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 13, mtime: 0x6a88a060, atime: 0x6a88a060, ctime: 0x6a88a060, blocks: 0xb 00010000:00010000:0.0:1787338853.115835:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=505s v=(0 0) 00010000:00010000:0.0:1787338853.115840:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787338853.115850:0:15066:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000085548f5e/0x83671231080c2e79 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabccc expref: 7 pid: 15066 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338853.115869:0:15066:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000085548f5e/0x83671231080c2e79 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabccc expref: 7 pid: 15066 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338853.115901:0:15066:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbc0030800, rc 0) 00000100:00100000:0.0:1787338853.116001:0:15066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf3e90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f600308-4919-499d-be82-256c83420e0e+7:2358:x1874160192209664:12345-192.168.201.53@tcp:101:cat.0 Request processed in 282us (7353us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338853.116008:0:15066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 28 00000100:00080000:1.0:1787338853.117982:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787338853.122733:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338853.122927:0:15069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192209792 00000100:00100000:3.0:1787338853.122939:0:15069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192209792 00002000:00100000:3.0:1787338853.123000:0:15069:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x22:0x0] (0->4095) req@ffff90bbe8270380 x1874160192209792/t0(0) o3->4f600308-4919-499d-be82-256c83420e0e@192.168.201.53@tcp:184/0 lens 488/0 e 0 to 0 dl 1787338864 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:100 00002000:00100000:3.0:1787338853.123013:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90bbe8270380 with x1874160192209792 ext(0->4095) 00002000:00010000:3.0:1787338853.123020:0:15069:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90bbe8270380 00000100:00100000:3.0:1787338853.123069:0:15069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 3 00000100:00100000:3.0:1787338853.123082:0:15069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbe8270380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f600308-4919-499d-be82-256c83420e0e+7:2356:x1874160192209792:12345-192.168.201.53@tcp:3:cat.0 00000100:00100000:3.0:1787338853.123392:0:15069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbe8270380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f600308-4919-499d-be82-256c83420e0e+7:2356:x1874160192209792:12345-192.168.201.53@tcp:3:cat.0 Request processed in 311us (669us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787338853.123404:0:15069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 3 00002000:00100000:3.0:1787338853.123412:0:15069:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x22:0x0] (0->4095) req@ffff90bbe8270380 x1874160192209792/t0(0) o3->4f600308-4919-499d-be82-256c83420e0e@192.168.201.53@tcp:184/0 lens 488/4536 e 0 to 0 dl 1787338864 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:100 00002000:00100000:3.0:1787338853.123448:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90bbe8270380 with x1874160192209792 ext(0->4095) 00002000:00010000:3.0:1787338853.123452:0:15069:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90bbe8270380 00010000:00010000:2.0:1787338853.305026:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338854.326107:0:15652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787338854.520033:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbe8199880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874160212096384:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787338854.520123:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338854.523505:0:15068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212096384 00000100:00100000:1.0:1787338854.523525:0:15068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212096384 00000100:00080000:1.0:1787338854.527516:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787338854.527549:0:15067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787338854.527567:0:15067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbe8198a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3316:x1874160212096384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787338854.528351:0:15067:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787338854.528446:0:15067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbe8198a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3316:x1874160212096384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 886us (8337us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338854.528455:0:15067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787338854.528521:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbe8199880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874160212096384:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787338854.536040:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbe8271180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c0e6575-df80-419a-8cc7-cbad06c93254:3317:1874160212096512:0@lo:400:kworker.0 00000100:00100000:2.0:1787338854.536127:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338854.536200:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212096512 00000100:00100000:2.0:1787338854.536208:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212096512 00000100:00100000:2.0:1787338854.536250:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1787338854.536259:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee099450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c0e6575-df80-419a-8cc7-cbad06c93254+19:3317:x1874160212096512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787338854.536300:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee099450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c0e6575-df80-419a-8cc7-cbad06c93254+19:3317:x1874160212096512:12345-0@lo:400:kworker.0 Request processed in 42us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338854.536306:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1787338854.536350:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbe8271180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c0e6575-df80-419a-8cc7-cbad06c93254:3317:1874160212096512:0@lo:400:kworker.0 00000100:00100000:2.0:1787338854.536385:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbe8271180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874160212096640:0@lo:400:kworker.0 00000100:00100000:2.0:1787338854.536408:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338854.536437:0:15650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212096640 00000100:00100000:2.0:1787338854.536440:0:15650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212096640 00000100:00100000:2.0:1787338854.536470:0:15650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787338854.536476:0:15650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbe8273480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1874160212096640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787338854.536505:0:15650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbe8273480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1874160212096640:12345-0@lo:400:kworker.0 Request processed in 29us (97us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338854.536511:0:15650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1787338854.536536:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787338854.536552:0:3314:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934600 gen 2 00000004:00080000:2.0:1787338854.536557:0:3314:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934600 00000004:00080000:2.0:1787338854.536574:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90bbfc120000, transno 8589934600 00000100:00100000:2.0:1787338854.536788:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbe8271180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874160212096640:0@lo:400:kworker.0 00000100:00100000:2.0:1787338854.537093:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbe8271180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874160212096768:0@lo:400:kworker.0 00000100:00100000:2.0:1787338854.537714:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338854.537760:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212096768 00000100:00100000:2.0:1787338854.537765:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212096768 00000100:00100000:2.0:1787338854.537794:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787338854.537803:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbe8271880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874160212096768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787338854.537841:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbe8271880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874160212096768:12345-0@lo:400:kworker.0 Request processed in 39us (127us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338854.537848:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787338854.537897:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbe8271180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874160212096768:0@lo:400:kworker.0 00000100:00100000:2.0:1787338854.537929:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787338854.537936:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbe8271180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1874160212096896:0@lo:400:kworker.0 00000100:00100000:2.0:1787338854.537961:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338854.537988:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212096896 00000100:00100000:2.0:1787338854.537992:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212096896 00000100:00100000:2.0:1787338854.538021:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787338854.538027:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbe8272680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874160212096896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787338854.538061:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbe8272680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874160212096896:12345-0@lo:400:kworker.0 Request processed in 35us (100us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338854.538067:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1787338854.538083:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787338854.539814:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbe8271180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1874160212096896:0@lo:400:kworker.0 00000100:00100000:2.0:1787338854.539898:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbe8271180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1874160212097024:0@lo:400:kworker.0 00000100:00100000:2.0:1787338854.540279:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338854.540326:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212097024 00000100:00100000:2.0:1787338854.540333:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212097024 00000100:00100000:2.0:1787338854.540380:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787338854.540389:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbe8270700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1874160212097024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787338854.540434:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbe8270700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1874160212097024:12345-0@lo:400:kworker.0 Request processed in 46us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338854.540441:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:2.0:1787338854.540473:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787338854.540494:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbe8271180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1874160212097024:0@lo:400:kworker.0 00000001:00080000:2.0:1787338854.586834:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00000001:00080000:2.0:1787338854.586855:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00000001:00080000:2.0:1787338854.635600:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934672 is committed 00000020:00080000:2.0:1787338854.635616:0:5861:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90bbd1649540 refcount 2 committed 0 result 0 batchid 4294967528 00000020:00080000:2.0:1787338854.635621:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90bbf7ce9000 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90bbd1649900 00000020:00080000:2.0:1787338854.635625:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90bbf7ce9200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90bac3456400 00000001:00080000:2.0:1787338854.635661:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934674 is committed 00000020:00080000:2.0:1787338854.635678:0:5861:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967527 batchid updated 00000020:00080000:3.0:1787338854.635838:0:14418:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967528 committed batchid 4294967527 00000020:00080000:3.0:1787338854.636057:0:14418:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967527 00000100:00100000:1.0:1787338855.248526:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338855.248581:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338855.248621:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338855.248653:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338855.248685:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338855.248719:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192210432 00000100:00100000:1.0:1787338855.248728:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192210432 00000100:00100000:1.0:1787338855.248798:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192210048 00000100:00100000:1.0:1787338855.248802:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192210048 00000100:00100000:1.0:1787338855.248822:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 32 00000100:00100000:0.0:1787338855.248828:0:15066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192210176 00000100:00100000:1.0:1787338855.248832:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf3e93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0bebf184-ca0d-4db5-82d4-d664d446db69+6:2357:x1874160192210432:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:0.0:1787338855.248832:0:15066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192210176 00000100:00100000:0.0:1787338855.248860:0:15066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192210304 00000100:00100000:0.0:1787338855.248862:0:15066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192210304 00000100:00100000:0.0:1787338855.248900:0:15066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 19 00000100:00100000:0.0:1787338855.248908:0:15066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf3e91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f600308-4919-499d-be82-256c83420e0e+5:2357:x1874160192210176:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:1.0:1787338855.248916:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf3e93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0bebf184-ca0d-4db5-82d4-d664d446db69+6:2357:x1874160192210432:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 86us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338855.248924:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 32 00000100:00100000:0.0:1787338855.248934:0:15066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf3e91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f600308-4919-499d-be82-256c83420e0e+5:2357:x1874160192210176:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 28us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338855.248940:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 33 00000100:00100000:1.0:1787338855.248945:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf7ed7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f600308-4919-499d-be82-256c83420e0e+13:2357:x1874160192210048:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:0.0:1787338855.248950:0:15066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 19 00000100:00100000:0.0:1787338855.248962:0:15066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 20 00000100:00100000:1.0:1787338855.248966:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf7ed7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f600308-4919-499d-be82-256c83420e0e+13:2357:x1874160192210048:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 21us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338855.248968:0:15066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf7ed6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f600308-4919-499d-be82-256c83420e0e+6:2357:x1874160192210304:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:1.0:1787338855.248977:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 33 00000100:00100000:0.0:1787338855.248989:0:15066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf7ed6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f600308-4919-499d-be82-256c83420e0e+6:2357:x1874160192210304:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 21us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338855.248995:0:15066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 20 00000100:00080000:1.0:1787338855.248999:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787338855.249003:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787338855.249006:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787338855.250685:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192209920 00000100:00100000:2.0:1787338855.250695:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192209920 00000100:00100000:2.0:1787338855.250761:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 125 00000100:00100000:2.0:1787338855.250771:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee09a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1770da5-776a-45c2-a341-2fca212f2072+13:2357:x1874160192209920:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:2.0:1787338855.250832:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee09a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1770da5-776a-45c2-a341-2fca212f2072+13:2357:x1874160192209920:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 63us (2315us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338855.250852:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 125 00000100:00100000:0.0:1787338855.266052:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338855.266676:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338855.276755:0:15066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192210560 00000100:00100000:0.0:1787338855.276771:0:15066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192210560 00000100:00100000:0.0:1787338855.276832:0:15066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192210688 00000100:00100000:0.0:1787338855.276836:0:15066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192210688 00000100:00100000:0.0:1787338855.276865:0:15066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 29 00000100:00100000:0.0:1787338855.276898:0:15066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbe819ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0bebf184-ca0d-4db5-82d4-d664d446db69+5:2355:x1874160192210560:12345-192.168.201.53@tcp:9:kworker.0 00000020:00000080:0.0:1787338855.276930:0:15066:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x83671231080c2828 00000100:00080000:0.0:1787338855.276948:0:15066:0:(import.c:65:import_set_state_nolock()) ffff90bac2b39800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787338855.276989:0:15066:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:0.0:1787338855.277307:0:15066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbe819ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0bebf184-ca0d-4db5-82d4-d664d446db69+2:2355:x1874160192210560:12345-192.168.201.53@tcp:9:kworker.0 Request processed in 433us (11267us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338855.277316:0:15066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 29 00000100:00100000:0.0:1787338855.277332:0:15066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 30 00000100:00100000:0.0:1787338855.277339:0:15066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbe8199880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0bebf184-ca0d-4db5-82d4-d664d446db69+5:2355:x1874160192210688:12345-192.168.201.53@tcp:9:kworker.0 00000020:00000080:0.0:1787338855.277351:0:15066:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x83671231080c282f 00000100:00080000:0.0:1787338855.277358:0:15066:0:(import.c:65:import_set_state_nolock()) ffff90bbc96a9000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787338855.277381:0:15066:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934598 00000100:00100000:0.0:1787338855.277523:0:15066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbe8199880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0bebf184-ca0d-4db5-82d4-d664d446db69+2:2355:x1874160192210688:12345-192.168.201.53@tcp:9:kworker.0 Request processed in 184us (10848us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338855.277530:0:15066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 30 00000100:00080000:0.0:1787338855.277549:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787338855.277552:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787338855.277812:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787338855.281999:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787338855.355688:0:15652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338856.381379:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787338857.079096:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787338857.079117:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc121c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874160212097152:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787338857.079200:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338857.079265:0:15067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212097152 00000100:00100000:3.0:1787338857.079273:0:15067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212097152 00000100:00100000:3.0:1787338857.079324:0:15067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787338857.079345:0:15067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc120e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874160212097152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787338857.079377:0:15067:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787338857.079419:0:15067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc120e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874160212097152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338857.079425:0:15067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1787338857.079444:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787338857.079494:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc121c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874160212097152:0@lo:13:osp-pre-0-0.0 00000001:00100000:3.0:1787338857.188143:0:6714:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0bebf184-ca0d-4db5-82d4-d664d446db69 00000020:00000080:3.0:1787338857.188161:0:6714:0:(genops.c:885:class_export_put()) final put ffff90bac2b3c800/0bebf184-ca0d-4db5-82d4-d664d446db69 00000020:00000080:0.0:1787338857.188936:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff90bac2b3c800/0bebf184-ca0d-4db5-82d4-d664d446db69 for lustre-OST0000 00000020:00000080:0.0:1787338857.188990:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90bac2b39800 for lustre-OST0000 00010000:00010000:0.0:1787338857.399240:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787338857.718373:0:14412:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787338857.718384:0:14412:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787338857.718442:0:14412:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 4 count 4 00000040:00080000:1.0:1787338857.718450:0:14412:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1787338858.428485:0:15652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338859.447094:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787338859.518137:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338859.519046:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192210816 00000100:00100000:3.0:1787338859.519057:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192210816 00000100:00100000:3.0:1787338859.519138:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 113 00000100:00100000:3.0:1787338859.519152:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf7ed4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f600308-4919-499d-be82-256c83420e0e+13:14411:x1874160192210816:12345-192.168.201.53@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1787338859.519282:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf7ed4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f600308-4919-499d-be82-256c83420e0e+13:14411:x1874160192210816:12345-192.168.201.53@tcp:60:lhsmtool_posix.0 Request processed in 134us (1153us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338859.519306:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 113 00000100:00080000:0.0:1787338859.519758:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787338859.524601:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338859.524906:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192211072 00000100:00100000:1.0:1787338859.524918:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192211072 00000100:00100000:1.0:1787338859.524980:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 28 00000100:00100000:1.0:1787338859.524991:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbff8f2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f600308-4919-499d-be82-256c83420e0e+13:14411:x1874160192211072:12345-192.168.201.53@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787338859.525451:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbff8f2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f600308-4919-499d-be82-256c83420e0e+14:14411:x1874160192211072:12345-192.168.201.53@tcp:35:lhsmtool_posix.0 Request processed in 461us (857us total) trans 8589934675 rc 0/0 00000100:00100000:1.0:1787338859.525460:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 28 00000100:00100000:3.0:1787338859.638512:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbe8199180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c0e6575-df80-419a-8cc7-cbad06c93254:3315:1874160212097280:0@lo:400:kworker.0 00000100:00100000:3.0:1787338859.638588:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338859.638642:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbedcb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1874160212097792:0@lo:400:kworker.0 00000100:00100000:3.0:1787338859.638667:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338859.638695:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787338859.638701:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbedcb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874160212097664:0@lo:400:kworker.0 00000100:00100000:3.0:1787338859.638722:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338859.638752:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212097792 00000100:00100000:3.0:1787338859.638759:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212097792 00000100:00100000:3.0:1787338859.638810:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212097664 00000100:00100000:3.0:1787338859.638813:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212097664 00000100:00100000:3.0:1787338859.638829:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787338859.638838:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc121c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874160212097792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787338859.638905:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc121c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874160212097792:12345-0@lo:400:kworker.0 Request processed in 67us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338859.638913:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787338859.638943:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787338859.638949:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc123100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874160212097664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787338859.638974:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc123100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874160212097664:12345-0@lo:400:kworker.0 Request processed in 26us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338859.638979:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:3.0:1787338859.638997:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787338859.639029:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbedcb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874160212097664:0@lo:400:kworker.0 00000100:00100000:3.0:1787338859.639038:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbedcb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1874160212097792:0@lo:400:kworker.0 00000100:00100000:0.0:1787338859.639194:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212097280 00000100:00100000:0.0:1787338859.639198:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212097280 00000100:00100000:0.0:1787338859.639235:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1787338859.639243:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee098c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c0e6575-df80-419a-8cc7-cbad06c93254+19:3315:x1874160212097280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787338859.639279:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee098c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c0e6575-df80-419a-8cc7-cbad06c93254+19:3315:x1874160212097280:12345-0@lo:400:kworker.0 Request processed in 38us (692us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338859.639285:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1787338859.639605:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbedcb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874160212097536:0@lo:400:kworker.0 00000100:00100000:2.0:1787338859.639641:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338859.639665:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787338859.639671:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbedcb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874160212097408:0@lo:400:kworker.0 00000100:00100000:2.0:1787338859.639694:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338859.639709:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc01fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1874160212097920:0@lo:400:kworker.0 00000100:00100000:2.0:1787338859.639729:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338859.639811:0:15065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212097536 00000100:00100000:2.0:1787338859.639815:0:15065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212097536 00000100:00100000:2.0:1787338859.639847:0:15065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212097408 00000100:00100000:2.0:1787338859.639850:0:15065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212097408 00000100:00100000:2.0:1787338859.639867:0:15065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787338859.639894:0:15065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbe8271180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1874160212097536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787338859.641141:0:15065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbe8271180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1874160212097536:12345-0@lo:400:kworker.0 Request processed in 1258us (1489us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338859.641153:0:15065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787338859.641215:0:15066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787338859.641227:0:15066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbe8273100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1874160212097408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787338859.641283:0:15066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbe8273100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1874160212097408:12345-0@lo:400:kworker.0 Request processed in 60us (1588us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338859.641289:0:15066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787338859.641389:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787338859.641402:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc01d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874160212098048:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787338859.641444:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338859.642148:0:15067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212098048 00000100:00100000:3.0:1787338859.642156:0:15067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212098048 00000100:00100000:2.0:1787338859.642375:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbedcb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874160212097408:0@lo:400:kworker.0 00000100:00100000:2.0:1787338859.642386:0:3317:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000004:00080000:2.0:1787338859.642391:0:3317:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:2.0:1787338859.642409:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbedcb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874160212097536:0@lo:400:kworker.0 00000100:00100000:3.0:1787338859.642448:0:15067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00080000:2.0:1787338859.642456:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787338859.642457:0:15067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874160212098048:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1787338859.642461:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787338859.642473:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212097920 00000100:00100000:2.0:1787338859.642476:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212097920 00002000:00000024:3.0:1787338859.642487:0:15067:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1787338859.645375:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787338859.645440:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbe8199180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c0e6575-df80-419a-8cc7-cbad06c93254:3315:1874160212097280:0@lo:400:kworker.0 00000100:00100000:2.0:1787338859.645482:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787338859.645496:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbe8272a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1874160212097920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787338859.645582:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbe8272a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1874160212097920:12345-0@lo:400:kworker.0 Request processed in 91us (5851us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338859.645590:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787338859.645628:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc01fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1874160212097920:0@lo:400:kworker.0 00000100:00100000:3.0:1787338859.645784:0:15067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874160212098048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3326us (4337us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338859.645793:0:15067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787338859.645842:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc01d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874160212098048:0@lo:13:osp-pre-1-0.0 00000001:00100000:2.0:1787338859.708954:0:7651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0bebf184-ca0d-4db5-82d4-d664d446db69 00000020:00000080:2.0:1787338859.708966:0:7651:0:(genops.c:885:class_export_put()) final put ffff90bac1c34000/0bebf184-ca0d-4db5-82d4-d664d446db69 00000020:00000080:0.0:1787338859.709173:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90bac1c34000/0bebf184-ca0d-4db5-82d4-d664d446db69 for lustre-OST0001 00000020:00000080:0.0:1787338859.709224:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90bbc96a9000 for lustre-OST0001 00000001:00080000:3.0:1787338859.719242:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934675 is committed 00000020:00080000:3.0:1787338859.719274:0:5861:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967528 batchid updated 00000020:00080000:2.0:1787338859.719313:0:14418:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967528 00000020:00080000:2.0:1787338859.719323:0:14418:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967528 00000100:00100000:0.0:1787338860.360030:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338860.360075:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338860.360118:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338860.360144:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338860.360167:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338860.360201:0:15650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192211456 00000100:00100000:0.0:1787338860.360212:0:15650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192211456 00000100:00100000:1.0:1787338860.360329:0:15066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192211584 00000100:00100000:1.0:1787338860.360333:0:15066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192211584 00000100:00100000:1.0:1787338860.360380:0:15066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 23 00000100:00100000:1.0:1787338860.360390:0:15066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4095880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f600308-4919-499d-be82-256c83420e0e+6:2356:x1874160192211584:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:1.0:1787338860.360467:0:15066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4095880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f600308-4919-499d-be82-256c83420e0e+6:2356:x1874160192211584:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 78us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338860.360474:0:15066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 23 00000100:00100000:2.0:1787338860.361200:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192211200 00000100:00100000:2.0:1787338860.361206:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192211200 00000100:00100000:2.0:1787338860.361261:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 127 00000100:00100000:2.0:1787338860.361270:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee099c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1770da5-776a-45c2-a341-2fca212f2072+13:2356:x1874160192211200:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:2.0:1787338860.361312:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee099c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1770da5-776a-45c2-a341-2fca212f2072+13:2356:x1874160192211200:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 44us (1293us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338860.361319:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 127 00000100:00100000:2.0:1787338860.361348:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192211712 00000100:00100000:2.0:1787338860.361352:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192211712 00000100:00100000:2.0:1787338860.361379:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192211328 00000100:00100000:2.0:1787338860.361381:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192211328 00000100:00100000:2.0:1787338860.361393:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 37 00000100:00100000:2.0:1787338860.361399:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0bebf184-ca0d-4db5-82d4-d664d446db69+6:2356:x1874160192211712:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:2.0:1787338860.361426:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0bebf184-ca0d-4db5-82d4-d664d446db69+6:2356:x1874160192211712:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 27us (1308us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338860.361446:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 37 00000100:00100000:2.0:1787338860.361458:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 38 00000100:00100000:2.0:1787338860.361464:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f600308-4919-499d-be82-256c83420e0e+13:2356:x1874160192211328:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:2.0:1787338860.361508:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f600308-4919-499d-be82-256c83420e0e+13:2356:x1874160192211328:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 44us (1363us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338860.361513:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 38 00000100:00080000:2.0:1787338860.361531:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787338860.361534:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787338860.361536:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787338860.362071:0:15650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 24 00000100:00100000:0.0:1787338860.362081:0:15650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f600308-4919-499d-be82-256c83420e0e+5:2356:x1874160192211456:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:0.0:1787338860.362138:0:15650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f600308-4919-499d-be82-256c83420e0e+5:2356:x1874160192211456:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 59us (2062us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338860.362144:0:15650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 24 00010000:00010000:0.0:1787338860.475387:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787338861.494113:0:15652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787338862.198137:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787338862.198159:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbe8273800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874160212098176:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787338862.198250:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338862.198474:0:15067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212098176 00000100:00100000:2.0:1787338862.198494:0:15067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212098176 00000100:00100000:2.0:1787338862.198567:0:15067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787338862.198577:0:15067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc122d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874160212098176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787338862.198611:0:15067:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787338862.198658:0:15067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc122d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874160212098176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338862.198665:0:15067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787338862.198715:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbe8273800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874160212098176:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787338862.198903:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787338862.521175:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787338863.542135:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787338864.566868:0:15652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787338864.758943:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbe8273800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c0e6575-df80-419a-8cc7-cbad06c93254:3315:1874160212098304:0@lo:400:kworker.0 00000100:00100000:3.0:1787338864.758956:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc01d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874160212098432:0@lo:400:kworker.0 00000100:00100000:2.0:1787338864.759026:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338864.759071:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbe8198700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1874160212098816:0@lo:400:kworker.0 00000100:00100000:2.0:1787338864.759098:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338864.759124:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787338864.759130:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbe8199180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874160212098688:0@lo:400:kworker.0 00000100:00100000:2.0:1787338864.759163:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338864.759191:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc01fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874160212098560:0@lo:400:kworker.0 00000100:00100000:2.0:1787338864.759219:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338864.759243:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212098304 00000100:00100000:2.0:1787338864.759246:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212098816 00000100:00100000:3.0:1787338864.759250:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212098304 00000100:00100000:2.0:1787338864.759250:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212098816 00000100:00100000:2.0:1787338864.759283:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212098688 00000100:00100000:2.0:1787338864.759285:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212098688 00000100:00100000:3.0:1787338864.759287:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1787338864.759294:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbff826450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c0e6575-df80-419a-8cc7-cbad06c93254+19:3315:x1874160212098304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787338864.759297:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787338864.759302:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf5b70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874160212098816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787338864.759441:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc4094a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874160212099072:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787338864.759471:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338864.759502:0:15067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212099072 00000100:00100000:0.0:1787338864.759506:0:15067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212099072 00000100:00100000:3.0:1787338864.759541:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbff826450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c0e6575-df80-419a-8cc7-cbad06c93254+19:3315:x1874160212098304:12345-0@lo:400:kworker.0 Request processed in 246us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338864.759549:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1787338864.759551:0:15067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787338864.759558:0:15067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4095f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874160212099072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787338864.759582:0:15067:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787338864.759590:0:14381:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1787338864.759619:0:15067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4095f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874160212099072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338864.759632:0:15067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787338864.759683:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc4094a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874160212099072:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787338864.759756:0:14381:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1787338864.759773:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf5b70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874160212098816:12345-0@lo:400:kworker.0 Request processed in 469us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338864.759780:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:3.0:1787338864.759781:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787338864.759791:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787338864.759794:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787338864.759800:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf5b71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874160212098688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787338864.759829:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf5b71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874160212098688:12345-0@lo:400:kworker.0 Request processed in 30us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338864.759835:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787338864.759851:0:15066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212098560 00000100:00100000:2.0:1787338864.759855:0:15066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212098560 00000100:00100000:2.0:1787338864.759900:0:15066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787338864.759907:0:15066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf5b73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1874160212098560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787338864.759939:0:15066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf5b73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1874160212098560:12345-0@lo:400:kworker.0 Request processed in 33us (720us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338864.759945:0:15066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787338864.759973:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbe8199180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874160212098688:0@lo:400:kworker.0 00000100:00100000:2.0:1787338864.759983:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbe8273800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c0e6575-df80-419a-8cc7-cbad06c93254:3315:1874160212098304:0@lo:400:kworker.0 00000100:00100000:2.0:1787338864.760002:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbe8198700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1874160212098816:0@lo:400:kworker.0 00000100:00100000:3.0:1787338864.760010:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338864.760039:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf5b70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1874160212098944:0@lo:400:kworker.0 00000100:00100000:3.0:1787338864.760062:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338864.760084:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212098944 00000100:00100000:2.0:1787338864.760088:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212098944 00000100:00100000:2.0:1787338864.760126:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787338864.760132:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc122680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874160212098944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787338864.760167:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc122680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874160212098944:12345-0@lo:400:kworker.0 Request processed in 34us (103us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338864.760172:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:3.0:1787338864.760254:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787338864.760277:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf5b70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1874160212098944:0@lo:400:kworker.0 00000100:00100000:0.0:1787338864.761072:0:15650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212098432 00000100:00100000:0.0:1787338864.761078:0:15650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212098432 00000100:00100000:0.0:1787338864.761115:0:15650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787338864.761124:0:15650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc120000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1874160212098432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787338864.761179:0:15650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc120000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1874160212098432:12345-0@lo:400:kworker.0 Request processed in 57us (1168us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338864.761185:0:15650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:0.0:1787338864.761204:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787338864.761227:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc01fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874160212098560:0@lo:400:kworker.0 00000100:00100000:0.0:1787338864.762331:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc01d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874160212098432:0@lo:400:kworker.0 00000001:02000400:1.0:1787338865.230409:0:16967:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 15:01:03 (1787338863) 00000100:00100000:0.0:1787338865.479828:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338865.479868:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338865.479923:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338865.479943:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338865.479964:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338865.479992:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192211840 00000100:00100000:0.0:1787338865.480010:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192211840 00000100:00100000:0.0:1787338865.480066:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 129 00000100:00100000:0.0:1787338865.480075:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbff824050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1770da5-776a-45c2-a341-2fca212f2072+13:2358:x1874160192211840:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:0.0:1787338865.480135:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbff824050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1770da5-776a-45c2-a341-2fca212f2072+13:2358:x1874160192211840:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 61us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338865.480142:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 129 00000100:00100000:0.0:1787338865.483553:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192212352 00000100:00100000:0.0:1787338865.483588:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192212352 00000100:00100000:0.0:1787338865.483665:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192211968 00000100:00100000:0.0:1787338865.483678:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192211968 00000100:00100000:0.0:1787338865.483707:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 42 00000100:00100000:0.0:1787338865.483717:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4097b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0bebf184-ca0d-4db5-82d4-d664d446db69+6:2358:x1874160192212352:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:0.0:1787338865.483803:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4097b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0bebf184-ca0d-4db5-82d4-d664d446db69+6:2358:x1874160192212352:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 87us (3879us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338865.483812:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 42 00000100:00100000:0.0:1787338865.483831:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 43 00000100:00100000:0.0:1787338865.483837:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4096d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f600308-4919-499d-be82-256c83420e0e+13:2358:x1874160192211968:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:0.0:1787338865.483862:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4096d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f600308-4919-499d-be82-256c83420e0e+13:2358:x1874160192211968:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 25us (3918us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338865.483869:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 43 00000100:00100000:0.0:1787338865.483906:0:15066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192212096 00000100:00100000:0.0:1787338865.483910:0:15066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192212096 00000100:00100000:0.0:1787338865.483934:0:15066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192212224 00000100:00100000:0.0:1787338865.483937:0:15066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192212224 00000100:00100000:0.0:1787338865.483956:0:15066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 27 00000100:00100000:0.0:1787338865.483963:0:15066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4094a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f600308-4919-499d-be82-256c83420e0e+5:2358:x1874160192212096:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:0.0:1787338865.483991:0:15066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4094a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f600308-4919-499d-be82-256c83420e0e+5:2358:x1874160192212096:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 29us (4123us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338865.483997:0:15066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 27 00000100:00100000:0.0:1787338865.484021:0:15066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 28 00000100:00100000:0.0:1787338865.484027:0:15066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4096680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f600308-4919-499d-be82-256c83420e0e+6:2358:x1874160192212224:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:0.0:1787338865.484048:0:15066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4096680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f600308-4919-499d-be82-256c83420e0e+6:2358:x1874160192212224:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 22us (4084us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338865.484472:0:15066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 28 00000100:00080000:0.0:1787338865.484493:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787338865.484498:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787338865.484501:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787338865.597212:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338866.614213:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787338867.322337:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787338867.322370:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf7ed4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874160212099200:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787338867.322442:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338867.322506:0:15067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212099200 00000100:00100000:1.0:1787338867.322514:0:15067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212099200 00000100:00100000:1.0:1787338867.322579:0:15067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787338867.322589:0:15067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf7ed5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874160212099200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787338867.322623:0:15067:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787338867.322665:0:15067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf7ed5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874160212099200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338867.322672:0:15067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:1.0:1787338867.322693:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787338867.322725:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf7ed4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874160212099200:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787338867.638085:0:15652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787338867.960172:0:14412:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787338867.960181:0:14412:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787338867.960215:0:14412:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 4 count 4 00000040:00080000:2.0:1787338867.960221:0:14412:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1787338868.662190:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338869.688994:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787338869.850803:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338869.851301:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192212608 00000100:00100000:2.0:1787338869.851321:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192212608 00000100:00100000:2.0:1787338869.851448:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 29 00000100:00100000:2.0:1787338869.851459:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4094e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f600308-4919-499d-be82-256c83420e0e+13:15375:x1874160192212608:12345-192.168.201.53@tcp:35:umount.0 00000100:00100000:2.0:1787338869.852944:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4094e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f600308-4919-499d-be82-256c83420e0e+14:15375:x1874160192212608:12345-192.168.201.53@tcp:35:umount.0 Request processed in 1478us (2143us total) trans 8589934676 rc 0/0 00000100:00100000:2.0:1787338869.852956:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 29 00000100:00080000:1.0:1787338869.857402:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787338869.858675:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338869.858914:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192212864 00000100:00100000:3.0:1787338869.858938:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192212864 00000100:00100000:3.0:1787338869.859003:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 30 00000100:00100000:3.0:1787338869.859014:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf5b71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f600308-4919-499d-be82-256c83420e0e+14:15375:x1874160192212864:12345-192.168.201.53@tcp:35:umount.0 00000100:00100000:3.0:1787338869.859399:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf5b71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f600308-4919-499d-be82-256c83420e0e+15:15375:x1874160192212864:12345-192.168.201.53@tcp:35:umount.0 Request processed in 385us (731us total) trans 8589934677 rc 0/0 00000100:00100000:3.0:1787338869.859408:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 30 00000100:00100000:0.0:1787338869.869950:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338869.870015:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338869.870185:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192212992 00000100:00100000:3.0:1787338869.870197:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192212992 00000100:00100000:3.0:1787338869.870264:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192213120 00000100:00100000:3.0:1787338869.870268:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192213120 00000100:00100000:3.0:1787338869.870300:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 4 00000100:00100000:3.0:1787338869.870311:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4095c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a1770da5-776a-45c2-a341-2fca212f2072+14:2357:x1874160192212992:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787338869.870336:0:14368:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787338869.870356:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90bbf40e3e00/0x83671231080c27d4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadaba64 expref: 14 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338869.870374:0:14368:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787338869.870431:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4095c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a1770da5-776a-45c2-a341-2fca212f2072+13:2357:x1874160192212992:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 121us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338869.870439:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 4 00000100:00100000:3.0:1787338869.870474:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 5 00000100:00100000:3.0:1787338869.870480:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc01d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a1770da5-776a-45c2-a341-2fca212f2072+12:2357:x1874160192213120:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787338869.870488:0:14368:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787338869.871251:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90bbffef5800/0x83671231080c27db lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadaba8e expref: 12 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338869.871265:0:14368:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787338869.871300:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc01d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a1770da5-776a-45c2-a341-2fca212f2072+11:2357:x1874160192213120:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 819us (1284us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338869.871307:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 5 00000100:00100000:0.0:1787338869.875067:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338869.875325:0:16493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192213248 00000100:00100000:2.0:1787338869.875342:0:16493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192213248 00000100:00100000:2.0:1787338869.875411:0:16493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 6 00000100:00100000:2.0:1787338869.875422:0:16493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc01fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a1770da5-776a-45c2-a341-2fca212f2072+11:2357:x1874160192213248:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787338869.875437:0:16493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787338869.875460:0:16493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90bc02044a00/0x83671231080c287c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabb2f expref: 11 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338869.876015:0:16493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787338869.876075:0:16493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc01fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a1770da5-776a-45c2-a341-2fca212f2072+10:2357:x1874160192213248:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 653us (1016us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338869.876083:0:16493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 6 00000100:00100000:0.0:1787338869.883448:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338869.883482:0:15066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192213504 00000100:00100000:0.0:1787338869.883503:0:15066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192213504 00000100:00100000:0.0:1787338869.883568:0:15066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 31 00000100:00100000:0.0:1787338869.883579:0:15066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee082680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f600308-4919-499d-be82-256c83420e0e+6:2355:x1874160192213504:12345-192.168.201.53@tcp:9:umount.0 00000020:00000080:0.0:1787338869.883610:0:15066:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x83671231080c27f7 00000020:00010000:0.0:1787338869.883619:0:15066:0:(genops.c:1921:obd_stale_export_put()) Put export ffff90bac1c30800: total 0 00000100:00080000:0.0:1787338869.883624:0:15066:0:(import.c:65:import_set_state_nolock()) ffff90bac1c32000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787338869.883666:0:15066:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934598 00000100:00100000:0.0:1787338869.883975:0:15066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee082680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f600308-4919-499d-be82-256c83420e0e+4:2355:x1874160192213504:12345-192.168.201.53@tcp:9:umount.0 Request processed in 397us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338869.883995:0:15066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 31 00000020:00010000:0.0:1787338869.884021:0:15652:0:(genops.c:1907:obd_stale_export_get()) Get export ffff90bac1c30800: total 0 00010000:00010000:0.0:1787338869.884025:0:15652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787338869.884043:0:15652:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff90bac1c30800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1787338869.884091:0:15652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000085548f5e/0x83671231080c2e79 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabccc expref: 3 pid: 15066 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338869.884145:0:15652:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff90bac1c30800, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1787338869.884155:0:15652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787338869.884157:0:15652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787338869.884159:0:15652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787338869.884941:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee083b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874160212099328:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787338869.885006:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338869.885071:0:15067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212099328 00000100:00100000:1.0:1787338869.885077:0:15067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212099328 00000100:00100000:1.0:1787338869.885133:0:15067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787338869.885142:0:15067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf7ed4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874160212099328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787338869.885181:0:15067:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787338869.885221:0:15067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf7ed4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874160212099328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338869.885237:0:15067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:1.0:1787338869.885260:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787338869.885294:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee083b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874160212099328:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787338869.888262:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc123480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874160212099584:0@lo:400:kworker.0 00000100:00100000:3.0:1787338869.888521:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338869.888573:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787338869.888579:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc122a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c0e6575-df80-419a-8cc7-cbad06c93254:3317:1874160212099456:0@lo:400:kworker.0 00000100:00100000:3.0:1787338869.888606:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338869.888626:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc120380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1874160212099968:0@lo:400:kworker.0 00000100:00100000:3.0:1787338869.888650:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338869.888678:0:15065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212099584 00000100:00100000:3.0:1787338869.888696:0:15065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212099584 00000100:00100000:3.0:1787338869.888759:0:15065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787338869.888768:0:15065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc120a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1874160212099584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787338869.888820:0:15065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc120a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1874160212099584:12345-0@lo:400:kworker.0 Request processed in 52us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338869.888827:0:15065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787338869.888848:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212099456 00000100:00100000:3.0:1787338869.888851:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212099456 00000100:00100000:3.0:1787338869.888913:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1787338869.888920:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbff824450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c0e6575-df80-419a-8cc7-cbad06c93254+19:3317:x1874160212099456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787338869.888963:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbff824450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c0e6575-df80-419a-8cc7-cbad06c93254+19:3317:x1874160212099456:12345-0@lo:400:kworker.0 Request processed in 44us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338869.888969:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1787338869.889272:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212099968 00000100:00100000:0.0:1787338869.889277:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212099968 00000100:00100000:0.0:1787338869.889309:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787338869.889508:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc122a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c0e6575-df80-419a-8cc7-cbad06c93254:3317:1874160212099456:0@lo:400:kworker.0 00000100:00100000:2.0:1787338869.889526:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc123480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874160212099584:0@lo:400:kworker.0 00000100:00100000:2.0:1787338869.889558:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc121f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874160212099712:0@lo:400:kworker.0 00000100:00100000:2.0:1787338869.889590:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338869.889615:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787338869.889621:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbfc123b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1874160212099840:0@lo:400:kworker.0 00000100:00100000:2.0:1787338869.889642:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338869.889665:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212099712 00000100:00100000:2.0:1787338869.889669:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212099712 00000100:00100000:2.0:1787338869.889700:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212099840 00000100:00100000:2.0:1787338869.889702:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212099840 00000100:00100000:2.0:1787338869.889718:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787338869.889725:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf5b72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874160212099712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787338869.889765:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf5b72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874160212099712:12345-0@lo:400:kworker.0 Request processed in 41us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338869.889772:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787338869.889785:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787338869.889791:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf5b70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874160212099840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787338869.889816:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf5b70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874160212099840:12345-0@lo:400:kworker.0 Request processed in 25us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338869.889835:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787338869.889863:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc123b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1874160212099840:0@lo:400:kworker.0 00000100:00100000:2.0:1787338869.889892:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc121f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874160212099712:0@lo:400:kworker.0 00000100:00080000:1.0:1787338869.890555:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787338869.890561:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787338869.891429:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbedcb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1874160212099968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787338869.891512:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbedcb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1874160212099968:12345-0@lo:400:kworker.0 Request processed in 2196us (2861us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338869.891522:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787338869.891585:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbfc120380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1874160212099968:0@lo:400:kworker.0 00000100:00100000:0.0:1787338869.899595:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338869.899676:0:15066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192213632 00000100:00100000:3.0:1787338869.899685:0:15066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192213632 00000100:00100000:3.0:1787338869.899807:0:15066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 32 00000100:00100000:3.0:1787338869.899818:0:15066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee080700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f600308-4919-499d-be82-256c83420e0e+5:2355:x1874160192213632:12345-192.168.201.53@tcp:9:umount.0 00000020:00000080:3.0:1787338869.899855:0:15066:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x83671231080c27f0 00000100:00080000:3.0:1787338869.899864:0:15066:0:(import.c:65:import_set_state_nolock()) ffff90bac1c33000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787338869.900065:0:15066:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:3.0:1787338869.900574:0:15066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee080700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f600308-4919-499d-be82-256c83420e0e+2:2355:x1874160192213632:12345-192.168.201.53@tcp:9:umount.0 Request processed in 755us (985us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338869.900583:0:15066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 32 00010000:00010000:3.0:1787338869.900756:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787338869.901818:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787338869.917122:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338869.917164:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192214400 00000100:00100000:2.0:1787338869.917417:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192214400 00000100:00100000:2.0:1787338869.917481:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 114 00000100:00100000:2.0:1787338869.917492:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf5b73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f600308-4919-499d-be82-256c83420e0e+15:2355:x1874160192214400:12345-192.168.201.53@tcp:39:umount.0 00000020:00000080:2.0:1787338869.917525:0:14381:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x83671231080c27e9 00000020:00010000:2.0:1787338869.917541:0:14381:0:(genops.c:1921:obd_stale_export_put()) Put export ffff90bac1c32800: total 0 00000100:00080000:2.0:1787338869.917547:0:14381:0:(import.c:65:import_set_state_nolock()) ffff90bbffd11000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787338869.917571:0:14381:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934677 00000020:00010000:1.0:1787338869.917589:0:14370:0:(genops.c:1907:obd_stale_export_get()) Get export ffff90bac1c32800: total 0 00010000:00010000:1.0:1787338869.917635:0:14370:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff90bac1c32800, canceled 0 locks, left on hash table 8. 00010000:00010000:1.0:1787338869.917667:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff90bbc8283500) 00010000:00010000:1.0:1787338869.917671:0:14370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00000100:00100000:2.0:1787338869.917959:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf5b73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f600308-4919-499d-be82-256c83420e0e+14:2355:x1874160192214400:12345-192.168.201.53@tcp:39:umount.0 Request processed in 466us (857us total) trans 8589934678 rc 0/0 00000100:00100000:2.0:1787338869.917968:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 114 00010000:00010000:1.0:1787338869.918164:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9dc00/0x83671231080c2e64 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabcc5 expref: 14 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338869.918274:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff90bbc2a93700) 00010000:00010000:1.0:1787338869.918278:0:14370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787338869.918283:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9ce00/0x83671231080c2898 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabb36 expref: 12 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338869.918303:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90bbc2a93400) 00010000:00010000:1.0:1787338869.918306:0:14370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787338869.918310:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbffef4400/0x83671231080c2971 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabb75 expref: 11 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338869.918323:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90bbc2a93400) 00010000:00010000:1.0:1787338869.918326:0:14370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787338869.918330:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02044c00/0x83671231080c2c18 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc32 expref: 10 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338869.918417:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff90bbc8283500) 00010000:00010000:1.0:1787338869.918427:0:14370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787338869.918432:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bc02045e00/0x83671231080c2d61 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabc7f expref: 9 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338869.918450:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90bbc2a93900) 00010000:00010000:1.0:1787338869.918452:0:14370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787338869.918455:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d200/0x83671231080c28b4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabb3d expref: 8 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338869.918469:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90bbc2a93100) 00010000:00010000:1.0:1787338869.918472:0:14370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787338869.918475:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d400/0x83671231080c28ec lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabb4b expref: 7 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338869.918486:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff90bbc8283500) 00010000:00010000:1.0:1787338869.918558:0:14370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787338869.918563:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbc0031000/0x83671231080c2e3a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabcb7 expref: 6 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338869.918577:0:14370:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff90bac1c32800, canceled 8 locks, left on hash table 0. 00010000:00010000:1.0:1787338869.918593:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338869.918595:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338869.918596:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787338869.971452:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934676 is committed 00000001:00080000:2.0:1787338869.971470:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934677 is committed 00000001:00100000:2.0:1787338870.011263:0:7651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4f600308-4919-499d-be82-256c83420e0e 00000020:00000080:2.0:1787338870.011275:0:7651:0:(genops.c:885:class_export_put()) final put ffff90bac1c30800/4f600308-4919-499d-be82-256c83420e0e 00000020:00000080:3.0:1787338870.011518:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90bac1c30800/4f600308-4919-499d-be82-256c83420e0e for lustre-OST0001 00000020:00000080:3.0:1787338870.011574:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90bac1c32000 for lustre-OST0001 00000100:00100000:3.0:1787338870.600443:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338870.600506:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338870.600590:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192214656 00000100:00100000:0.0:1787338870.600590:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192214528 00000100:00100000:1.0:1787338870.600600:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192214656 00000100:00100000:0.0:1787338870.600600:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192214528 00000100:00100000:1.0:1787338870.600659:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 47 00000100:00100000:0.0:1787338870.600659:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 131 00000100:00100000:1.0:1787338870.600670:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbedcb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0bebf184-ca0d-4db5-82d4-d664d446db69+6:2359:x1874160192214656:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:0.0:1787338870.600677:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbff825850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1770da5-776a-45c2-a341-2fca212f2072+10:2359:x1874160192214528:12345-192.168.201.53@tcp:400:kworker.0 00000100:00080000:2.0:1787338870.600749:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787338870.600903:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbff825850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1770da5-776a-45c2-a341-2fca212f2072+10:2359:x1874160192214528:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 234us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338870.600945:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 131 00000100:00100000:1.0:1787338870.606996:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbedcb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0bebf184-ca0d-4db5-82d4-d664d446db69+6:2359:x1874160192214656:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 6314us (6475us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338870.607031:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 47 00010000:00010000:0.0:1787338870.722051:0:15652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338871.734357:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787338871.876186:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338871.876232:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338871.876342:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338871.876840:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192214784 00000100:00100000:0.0:1787338871.876840:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192214912 00000100:00100000:3.0:1787338871.876851:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192214784 00000100:00100000:0.0:1787338871.876851:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192214912 00000100:00100000:0.0:1787338871.876965:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192215040 00000100:00100000:2.0:1787338871.876973:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 7 00000100:00100000:0.0:1787338871.876984:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192215040 00000100:00100000:2.0:1787338871.876987:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbd172a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a1770da5-776a-45c2-a341-2fca212f2072+12:2358:x1874160192214912:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787338871.877007:0:14367:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787338871.877029:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90bbffef4c00/0x83671231080c2813 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabaf0 expref: 12 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338871.877073:0:14367:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787338871.877157:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbd172a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a1770da5-776a-45c2-a341-2fca212f2072+11:2358:x1874160192214912:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 172us (982us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338871.877165:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 7 00000100:00100000:3.0:1787338871.879007:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 8 00000100:00100000:3.0:1787338871.879034:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf7ed5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a1770da5-776a-45c2-a341-2fca212f2072+11:2356:x1874160192214784:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787338871.879267:0:14366:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787338871.879288:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90bc02045600/0x83671231080c280c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabac6 expref: 11 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338871.879321:0:14366:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787338871.879376:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf7ed5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a1770da5-776a-45c2-a341-2fca212f2072+10:2356:x1874160192214784:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 358us (3143us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338871.879384:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 8 00000100:00100000:3.0:1787338871.880297:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338871.880344:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192215296 00000100:00100000:3.0:1787338871.880353:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192215296 00000100:00100000:3.0:1787338871.880403:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 115 00000100:00100000:3.0:1787338871.880413:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbedcb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0bebf184-ca0d-4db5-82d4-d664d446db69+6:2355:x1874160192215296:12345-192.168.201.53@tcp:39:umount.0 00000020:00000080:3.0:1787338871.880457:0:14381:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x83671231080c2821 00000020:00010000:3.0:1787338871.880467:0:14381:0:(genops.c:1921:obd_stale_export_put()) Put export ffff90bac2b54800: total 0 00000100:00080000:3.0:1787338871.880472:0:14381:0:(import.c:65:import_set_state_nolock()) ffff90bac2b53000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787338871.880496:0:14381:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934678 00000100:00100000:3.0:1787338871.880753:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbedcb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0bebf184-ca0d-4db5-82d4-d664d446db69+5:2355:x1874160192215296:12345-192.168.201.53@tcp:39:umount.0 Request processed in 341us (458us total) trans 8589934679 rc 0/0 00000100:00100000:3.0:1787338871.880761:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 115 00000020:00010000:3.0:1787338871.880908:0:14370:0:(genops.c:1907:obd_stale_export_get()) Get export ffff90bac2b54800: total 0 00010000:00010000:3.0:1787338871.880946:0:14370:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff90bac2b54800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1787338871.880977:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90bbc2a93100) 00010000:00010000:3.0:1787338871.880981:0:14370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787338871.880987:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9cc00/0x83671231080c28fa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabb52 expref: 4 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338871.881009:0:14370:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff90bac2b54800, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1787338871.881018:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338871.881019:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338871.881033:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787338871.881497:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 9 00000100:00100000:0.0:1787338871.881510:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf7ed4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a1770da5-776a-45c2-a341-2fca212f2072+9:2357:x1874160192215040:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787338871.881523:0:14368:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787338871.881534:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90bbffef4200/0x83671231080c2875 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabb28 expref: 9 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338871.881545:0:14368:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787338871.881587:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf7ed4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a1770da5-776a-45c2-a341-2fca212f2072+8:2357:x1874160192215040:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 81us (5245us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338871.881594:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 9 00000100:00100000:3.0:1787338871.898314:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338871.898419:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192215552 00000100:00100000:0.0:1787338871.898430:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192215552 00000100:00100000:0.0:1787338871.898488:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 132 00000100:00100000:0.0:1787338871.898499:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbff827050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1770da5-776a-45c2-a341-2fca212f2072+7:2355:x1874160192215552:12345-192.168.201.53@tcp:251:umount.0 00000020:00000080:0.0:1787338871.898541:0:14373:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x83671231080c27c6 00000020:00010000:0.0:1787338871.898549:0:14373:0:(genops.c:1921:obd_stale_export_put()) Put export ffff90bac2b52000: total 0 00000100:00080000:0.0:1787338871.898554:0:14373:0:(import.c:65:import_set_state_nolock()) ffff90bac2b50800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1787338871.898633:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbff827050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1770da5-776a-45c2-a341-2fca212f2072+3:2355:x1874160192215552:12345-192.168.201.53@tcp:251:umount.0 Request processed in 135us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338871.898641:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 132 00000020:00010000:1.0:1787338871.899033:0:15652:0:(genops.c:1907:obd_stale_export_get()) Get export ffff90bac2b52000: total 0 00010000:00010000:1.0:1787338871.899037:0:15652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338871.899076:0:15652:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff90bac2b52000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1787338871.899116:0:15652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90bbffef4000/0x83671231080c27cd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadaba5d expref: 2 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338871.899131:0:15652:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff90bac2b52000, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1787338871.899139:0:15652:0:(genops.c:885:class_export_put()) final put ffff90bac2b52000/a1770da5-776a-45c2-a341-2fca212f2072 00010000:00010000:1.0:1787338871.899156:0:15652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338871.899158:0:15652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338871.899160:0:15652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787338871.899200:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff90bac2b52000/a1770da5-776a-45c2-a341-2fca212f2072 for MGS 00000020:00000080:3.0:1787338871.899244:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90bac2b50800 for MGS 00000100:00100000:0.0:1787338872.441810:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee082300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874160212100096:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787338872.441919:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338872.442000:0:15067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212100096 00000100:00100000:0.0:1787338872.442008:0:15067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212100096 00000100:00100000:0.0:1787338872.442065:0:15067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787338872.442074:0:15067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee082a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874160212100096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787338872.442120:0:15067:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787338872.442167:0:15067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee082a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874160212100096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338872.442175:0:15067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787338872.442222:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee082300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874160212100096:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787338872.442509:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:3.0:1787338872.504573:0:6714:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4f600308-4919-499d-be82-256c83420e0e 00000020:00000080:3.0:1787338872.504582:0:6714:0:(genops.c:885:class_export_put()) final put ffff90bac1c36800/4f600308-4919-499d-be82-256c83420e0e 00000020:00000080:3.0:1787338872.504613:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff90bac1c36800/4f600308-4919-499d-be82-256c83420e0e for lustre-OST0000 00000020:00000080:3.0:1787338872.504661:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90bac1c33000 for lustre-OST0000 00010000:00010000:3.0:1787338872.758015:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787338873.692513:0:17166:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1787338873.714131:0:17166:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1787338873.714185:0:17166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbf3c52c00/0x83671231080c24f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c24fc expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338873.714200:0:17166:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbf3c52c00/0x83671231080c24f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x83671231080c24fc expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338873.714207:0:17166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbf3c52c00/0x83671231080c24f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x83671231080c24fc expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338873.714215:0:17166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.153@tcp lock: ffff90bbf3c52c00/0x83671231080c24f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x83671231080c24fc expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338873.714240:0:17166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787338873.714246:0:17166:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1787338873.714267:0:17166:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787338873.714272:0:17166:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787338873.714278:0:17166:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787338873.714305:0:17166:0:(import.c:65:import_set_state_nolock()) ffff90bbc5197800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1787338873.714408:0:14370:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787338873.714415:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.153@tcp lock: ffff90bbf3c52c00/0x83671231080c24f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x83671231080c24fc expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338873.714432:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf3c52c00 already unused, calling callback (ffffffffc1b2ec20) 10000000:00010000:3.0:1787338873.714436:0:14370:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.153@tcp lock: ffff90bbf3c52c00/0x83671231080c24f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x83671231080c24fc expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338873.714445:0:14370:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.153@tcp lock: ffff90bbf3c52c00/0x83671231080c24f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x83671231080c24fc expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787338873.714454:0:14370:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.153@tcp lock: ffff90bbf3c52c00/0x83671231080c24f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x83671231080c24fc expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787338873.714459:0:14370:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787338873.714462:0:14370:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1787338873.714464:0:14370:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1787338873.714490:0:14370:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.153@tcp lock: ffff90bbf3c52c00/0x83671231080c24f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x83671231080c24fc expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338873.714496:0:14370:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787338873.714535:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.153@tcp lock: ffff90bbf3c52c00/0x83671231080c24f5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x83671231080c24fc expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338873.714541:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.153@tcp lock: ffff90bbf3c52c00/0x83671231080c24f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x83671231080c24fc expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338873.714552:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338873.714554:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338873.714555:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787338873.714651:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787338873.714676:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbedcb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c0e6575-df80-419a-8cc7-cbad06c93254:3315:1874160212100352:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787338873.714747:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338873.715520:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee082300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874160212100224:0@lo:39:umount.0 00000100:00100000:1.0:1787338873.715552:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338873.715697:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212100224 00000100:00100000:2.0:1787338873.715705:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212100224 00000100:00100000:2.0:1787338873.715757:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1787338873.715767:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf7ed6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874160212100224:12345-0@lo:39:umount.0 00000020:00000080:2.0:1787338873.715791:0:14382:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x83671231080c2526 00000100:00080000:2.0:1787338873.715799:0:14382:0:(import.c:65:import_set_state_nolock()) ffff90bbf41a1800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1787338873.715905:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf7ed6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3313:x1874160212100224:12345-0@lo:39:umount.0 Request processed in 139us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338873.715920:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000020:00000080:2.0:1787338873.715930:0:14382:0:(genops.c:885:class_export_put()) final put ffff90bbf41a7800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1787338873.715954:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff90bbf41a7800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1787338873.715989:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90bbf41a1800 for lustre-MDT0000 00000100:00080000:2.0:1787338873.716026:0:3313:0:(import.c:65:import_set_state_nolock()) ffff90bbc5197800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1787338873.716033:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee082300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874160212100224:0@lo:39:umount.0 00010000:00010000:0.0:1787338873.716162:0:15652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787338873.716175:0:17166:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787338873.716178:0:17166:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787338873.716183:0:17166:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787338873.719698:0:17166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbf7ea5000/0x83671231080c245b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c2462 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338873.719719:0:17166:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbf7ea5000/0x83671231080c245b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x83671231080c2462 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338873.719727:0:17166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbf7ea5000/0x83671231080c245b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x83671231080c2462 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338873.719734:0:17166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.153@tcp lock: ffff90bbf7ea5000/0x83671231080c245b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x83671231080c2462 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338873.719765:0:17166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787338873.719772:0:17166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbffef4a00/0x83671231080c26ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c26f4 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338873.719779:0:17166:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbffef4a00/0x83671231080c26ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x83671231080c26f4 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338873.719785:0:17166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbffef4a00/0x83671231080c26ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x83671231080c26f4 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338873.719791:0:17166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.153@tcp lock: ffff90bbffef4a00/0x83671231080c26ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x83671231080c26f4 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338873.719802:0:17166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787338873.719807:0:17166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbf40e3a00/0x83671231080c2867 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c286e expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338873.719828:0:17166:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbf40e3a00/0x83671231080c2867 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x83671231080c286e expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338873.719835:0:17166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbf40e3a00/0x83671231080c2867 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x83671231080c286e expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338873.719841:0:17166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.153@tcp lock: ffff90bbf40e3a00/0x83671231080c2867 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x83671231080c286e expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338873.719852:0:17166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1787338873.719893:0:15652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787338873.719899:0:15652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.153@tcp lock: ffff90bbf7ea5000/0x83671231080c245b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x83671231080c2462 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338873.719906:0:15652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea5000 already unused, calling callback (ffffffffc1b2ec20) 10000000:00010000:0.0:1787338873.719910:0:15652:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.153@tcp lock: ffff90bbf7ea5000/0x83671231080c245b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x83671231080c2462 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338873.720062:0:15652:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.153@tcp lock: ffff90bbf7ea5000/0x83671231080c245b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x83671231080c2462 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787338873.720071:0:15652:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.153@tcp lock: ffff90bbf7ea5000/0x83671231080c245b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x83671231080c2462 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787338873.720076:0:15652:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787338873.720079:0:15652:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:0.0:1787338873.720110:0:15652:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.153@tcp lock: ffff90bbf7ea5000/0x83671231080c245b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x83671231080c2462 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338873.720126:0:15652:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787338873.720150:0:15652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.153@tcp lock: ffff90bbf7ea5000/0x83671231080c245b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x83671231080c2462 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338873.720157:0:15652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.153@tcp lock: ffff90bbf7ea5000/0x83671231080c245b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x83671231080c2462 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338873.720171:0:15652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787338873.720174:0:15652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.153@tcp lock: ffff90bbffef4a00/0x83671231080c26ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x83671231080c26f4 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338873.720180:0:15652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbffef4a00 already unused, calling callback (ffffffffc1b2ec20) 10000000:00010000:0.0:1787338873.720183:0:15652:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.153@tcp lock: ffff90bbffef4a00/0x83671231080c26ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x83671231080c26f4 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338873.720190:0:15652:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.153@tcp lock: ffff90bbffef4a00/0x83671231080c26ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x83671231080c26f4 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787338873.720196:0:15652:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.153@tcp lock: ffff90bbffef4a00/0x83671231080c26ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x83671231080c26f4 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787338873.720201:0:15652:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1787338873.720204:0:15652:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1787338873.720206:0:15652:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1787338873.720221:0:15652:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.153@tcp lock: ffff90bbffef4a00/0x83671231080c26ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x83671231080c26f4 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338873.720227:0:15652:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787338873.720241:0:15652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.153@tcp lock: ffff90bbffef4a00/0x83671231080c26ed lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x83671231080c26f4 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338873.720258:0:15652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.153@tcp lock: ffff90bbffef4a00/0x83671231080c26ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x83671231080c26f4 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338873.720274:0:15652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787338873.720277:0:15652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.153@tcp lock: ffff90bbf40e3a00/0x83671231080c2867 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x83671231080c286e expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338873.720282:0:15652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e3a00 already unused, calling callback (ffffffffc1b2ec20) 10000000:00010000:0.0:1787338873.720285:0:15652:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.153@tcp lock: ffff90bbf40e3a00/0x83671231080c2867 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x83671231080c286e expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338873.720293:0:15652:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.153@tcp lock: ffff90bbf40e3a00/0x83671231080c2867 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x83671231080c286e expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787338873.720300:0:15652:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.153@tcp lock: ffff90bbf40e3a00/0x83671231080c2867 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x83671231080c286e expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787338873.720305:0:15652:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1787338873.720307:0:15652:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1787338873.720309:0:15652:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1787338873.720323:0:15652:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.153@tcp lock: ffff90bbf40e3a00/0x83671231080c2867 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x83671231080c286e expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338873.720329:0:15652:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787338873.720335:0:15652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.153@tcp lock: ffff90bbf40e3a00/0x83671231080c2867 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x83671231080c286e expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338873.720341:0:15652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.153@tcp lock: ffff90bbf40e3a00/0x83671231080c2867 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x83671231080c286e expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338873.720361:0:15652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787338873.720363:0:15652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787338873.720365:0:15652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787338873.720385:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee083800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c0e6575-df80-419a-8cc7-cbad06c93254:3315:1874160212100480:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787338873.720534:0:17166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbf7ea5200/0x83671231080c244d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c2454 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338873.720543:0:17166:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbf7ea5200/0x83671231080c244d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x83671231080c2454 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338873.720550:0:17166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbf7ea5200/0x83671231080c244d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x83671231080c2454 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338873.720556:0:17166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.153@tcp lock: ffff90bbf7ea5200/0x83671231080c244d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x83671231080c2454 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338873.720576:0:17166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787338873.720579:0:17166:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:1.0:1787338873.720582:0:17166:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:1.0:1787338873.720604:0:17166:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1787338873.720607:0:17166:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1787338873.720612:0:17166:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787338873.720626:0:17166:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/9 00000020:00080000:1.0:1787338873.720632:0:17166:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff90bac1c31800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787338873.720637:0:17166:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff90bbc673d000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787338873.720644:0:17166:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff90bac2b54800 0bebf184-ca0d-4db5-82d4-d664d446db69 192.168.201.53@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934599 stale:0 00000020:00080000:1.0:1787338873.720649:0:17166:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff90bac1c32800 4f600308-4919-499d-be82-256c83420e0e 192.168.201.53@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934677 stale:0 00000020:00080000:1.0:1787338873.720654:0:17166:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff90bbee0a8000) has exports, disconnecting them 00000020:00080000:1.0:1787338873.720659:0:17166:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff90bac1c31800), last request at 1787338869 00000020:00000080:1.0:1787338873.720665:0:17166:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x83671231080c26df 00000100:00080000:1.0:1787338873.720680:0:17166:0:(import.c:65:import_set_state_nolock()) ffff90bac1c34800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1787338873.720716:0:17166:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff90bac1c31800): rc 0 00000020:00000080:1.0:1787338873.720719:0:17166:0:(genops.c:885:class_export_put()) final put ffff90bac1c31800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1787338873.720727:0:17166:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff90bbc673d000), last request at 1787338869 00000020:00000080:1.0:1787338873.720730:0:17166:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x83671231080c25ab 00000100:00080000:1.0:1787338873.720735:0:17166:0:(import.c:65:import_set_state_nolock()) ffff90bbc6739800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1787338873.720741:0:17166:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff90bbc673d000): rc 0 00000020:00000080:1.0:1787338873.720743:0:17166:0:(genops.c:885:class_export_put()) final put ffff90bbc673d000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:1.0:1787338873.720750:0:17166:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa35144043ae0 00000100:00080000:1.0:1787338873.720768:0:17166:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1787338873.720771:0:17166:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934600 gen 3 00000004:00080000:1.0:1787338873.720782:0:17166:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1787338873.720852:0:17166:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1787338873.720891:0:17166:0:(import.c:65:import_set_state_nolock()) ffff90bbc93ac800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1787338873.720902:0:17166:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787338873.720904:0:17166:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 3 00000004:00080000:1.0:1787338873.720925:0:17166:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1787338873.720986:0:17166:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1787338873.720995:0:17166:0:(import.c:65:import_set_state_nolock()) ffff90bbf40f3800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1787338873.721035:0:17166:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff90bbee0a8000) has no exports 00010000:00010000:1.0:1787338873.721058:0:15652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787338873.721063:0:15652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.153@tcp lock: ffff90bbf7ea5200/0x83671231080c244d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x83671231080c2454 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338873.721069:0:15652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea5200 already unused, calling callback (ffffffffc1b2ec20) 10000000:00010000:1.0:1787338873.721071:0:15652:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.153@tcp lock: ffff90bbf7ea5200/0x83671231080c244d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x83671231080c2454 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338873.721078:0:15652:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.153@tcp lock: ffff90bbf7ea5200/0x83671231080c244d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x83671231080c2454 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787338873.721085:0:15652:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.153@tcp lock: ffff90bbf7ea5200/0x83671231080c244d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x83671231080c2454 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787338873.721090:0:15652:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1787338873.721092:0:15652:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1787338873.721095:0:15652:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1787338873.721109:0:15652:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.153@tcp lock: ffff90bbf7ea5200/0x83671231080c244d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x83671231080c2454 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338873.721115:0:15652:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787338873.721122:0:15652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.153@tcp lock: ffff90bbf7ea5200/0x83671231080c244d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x83671231080c2454 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338873.721138:0:15652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.153@tcp lock: ffff90bbf7ea5200/0x83671231080c244d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x83671231080c2454 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338873.721150:0:15652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338873.721152:0:15652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338873.721154:0:15652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787338873.721165:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee083b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c0e6575-df80-419a-8cc7-cbad06c93254:3317:1874160212100736:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787338873.721419:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf7ed7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c0e6575-df80-419a-8cc7-cbad06c93254:3314:1874160212101120:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787338873.726573:0:16493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212100352 00000100:00100000:3.0:1787338873.726588:0:16493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212100352 00010000:00010000:3.0:1787338873.726609:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787338873.726640:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee082300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c0e6575-df80-419a-8cc7-cbad06c93254:3316:1874160212100608:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787338873.726803:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:1.0:1787338873.728370:0:13151:0:(genops.c:844:class_export_destroy()) destroying export ffff90bac1c31800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1787338873.728435:0:13151:0:(genops.c:844:class_export_destroy()) destroying export ffff90bbc673d000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1787338873.728460:0:13151:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90bac1c34800 for lustre-MDT0000 00000020:00000080:1.0:1787338873.728465:0:13151:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90bbc6739800 for lustre-MDT0000 00000100:00100000:1.0:1787338873.728502:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf7ed4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1874160212100864:0@lo:9:umount.0 00000100:00100000:1.0:1787338873.728556:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338873.728584:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf7ed6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1874160212100992:0@lo:9:umount.0 00000100:00100000:1.0:1787338873.728608:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338873.729656:0:15063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212100864 00000100:00100000:2.0:1787338873.729665:0:15063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212100864 00000100:00100000:2.0:1787338873.729778:0:15063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212100992 00000100:00100000:2.0:1787338873.729781:0:15063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212100992 00000100:00100000:2.0:1787338873.729813:0:15063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787338873.729823:0:15063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf7ed4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874160212100864:12345-0@lo:9:umount.0 00000020:00000080:2.0:1787338873.729868:0:15063:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x83671231080c25c7 00000100:00080000:2.0:1787338873.729890:0:15063:0:(import.c:65:import_set_state_nolock()) ffff90bbef175800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787338873.729932:0:15063:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:2.0:1787338873.730265:0:15063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf7ed4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3313:x1874160212100864:12345-0@lo:9:umount.0 Request processed in 443us (1708us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338873.730273:0:15063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787338873.730289:0:15063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787338873.730297:0:15063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf7ed5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874160212100992:12345-0@lo:9:umount.0 00000020:00000080:2.0:1787338873.730310:0:15063:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x83671231080c26fb 00000100:00080000:2.0:1787338873.730315:0:15063:0:(import.c:65:import_set_state_nolock()) ffff90bac1c33800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787338873.730335:0:15063:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934598 00000100:00100000:2.0:1787338873.730522:0:15063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf7ed5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3313:x1874160212100992:12345-0@lo:9:umount.0 Request processed in 225us (1912us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338873.730529:0:15063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:2.0:1787338873.730574:0:3313:0:(import.c:65:import_set_state_nolock()) ffff90bbc93ac800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1787338873.730588:0:3313:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1787338873.730590:0:3313:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787338873.730593:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf7ed4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1874160212100864:0@lo:9:umount.0 00000100:00080000:2.0:1787338873.730605:0:3313:0:(import.c:65:import_set_state_nolock()) ffff90bbf40f3800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1787338873.730613:0:3313:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1787338873.730615:0:3313:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787338873.730617:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf7ed6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1874160212100992:0@lo:9:umount.0 00010000:00010000:2.0:1787338873.730650:0:15652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787338873.730671:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338873.730697:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212100736 00000100:00100000:2.0:1787338873.730702:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212100736 00000100:00100000:2.0:1787338873.730731:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212101120 00000100:00100000:2.0:1787338873.730734:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212101120 00000100:00100000:2.0:1787338873.730759:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787338873.730764:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf7ed7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c0e6575-df80-419a-8cc7-cbad06c93254+21:3317:x1874160212100736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787338873.730774:0:14368:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787338873.730791:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90bbffef5c00/0x83671231080c286e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x83671231080c2867 expref: 21 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338873.730805:0:14368:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787338873.730835:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf7ed7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c0e6575-df80-419a-8cc7-cbad06c93254+20:3317:x1874160212100736:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (4033us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338873.730841:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787338873.730852:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787338873.730870:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf5b72300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c0e6575-df80-419a-8cc7-cbad06c93254+19:3314:x1874160212101120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787338873.730897:0:14368:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787338873.730904:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90bbffef4800/0x83671231080c2454 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x83671231080c244d expref: 19 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338873.730917:0:14368:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787338873.730941:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf5b72300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c0e6575-df80-419a-8cc7-cbad06c93254+18:3314:x1874160212101120:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338873.730947:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787338873.730976:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee083b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c0e6575-df80-419a-8cc7-cbad06c93254:3317:1874160212100736:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787338873.731011:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf7ed7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c0e6575-df80-419a-8cc7-cbad06c93254:3314:1874160212101120:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787338873.735070:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338873.735839:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212100480 00000100:00100000:1.0:1787338873.735851:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212100480 00000100:00100000:1.0:1787338873.735969:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787338873.735980:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee083b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c0e6575-df80-419a-8cc7-cbad06c93254+18:3315:x1874160212100480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787338873.735999:0:14366:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787338873.736034:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90bbf3c53a00/0x83671231080c2462 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x83671231080c245b expref: 18 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338873.736049:0:14366:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787338873.736110:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee083b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c0e6575-df80-419a-8cc7-cbad06c93254+17:3315:x1874160212100480:12345-0@lo:103:ldlm_bl.0 Request processed in 131us (1046us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338873.736128:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1787338873.736151:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787338873.737198:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee083800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c0e6575-df80-419a-8cc7-cbad06c93254:3315:1874160212100480:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1787338873.737245:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787338873.743050:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787338873.743156:0:16493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787338873.743171:0:16493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee081180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2c0e6575-df80-419a-8cc7-cbad06c93254+16:3315:x1874160212100352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787338873.743189:0:16493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787338873.743210:0:16493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90bbf3c53600/0x83671231080c24fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x83671231080c24f5 expref: 16 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338873.743228:0:16493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787338873.743313:0:16493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee081180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2c0e6575-df80-419a-8cc7-cbad06c93254+15:3315:x1874160212100352:12345-0@lo:103:ldlm_bl.0 Request processed in 147us (28565us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338873.743321:0:16493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787338873.743365:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbedcb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c0e6575-df80-419a-8cc7-cbad06c93254:3315:1874160212100352:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787338873.744363:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338873.744443:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212100608 00000100:00100000:3.0:1787338873.744450:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212100608 00000100:00100000:3.0:1787338873.744490:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787338873.744499:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbd172b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c0e6575-df80-419a-8cc7-cbad06c93254+15:3316:x1874160212100608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787338873.744510:0:14367:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787338873.744522:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90bbf7ea4000/0x83671231080c26f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x83671231080c26ed expref: 15 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338873.744538:0:14367:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787338873.744569:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbd172b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c0e6575-df80-419a-8cc7-cbad06c93254+14:3316:x1874160212100608:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338873.744575:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787338873.744639:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee082300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c0e6575-df80-419a-8cc7-cbad06c93254:3316:1874160212100608:0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1787338873.762293:0:17166:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff90bbee0a8000) has no exports 00010000:00010000:1.0:1787338873.783131:0:15652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787338873.849261:0:17166:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x83671231080c24a8 00000020:00000080:2.0:1787338873.849281:0:17166:0:(genops.c:885:class_export_put()) final put ffff90bbd888a800/lustre-QMT0000_UUID 00000020:01000000:2.0:1787338873.849354:0:17166:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1787338873.851103:0:17166:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787338873.851119:0:17166:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787338873.851138:0:17166:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff90bbfc248000) has no exports 00000020:00000080:1.0:1787338873.854184:0:17166:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x83671231080c24a1 00000020:00000080:1.0:1787338873.854197:0:17166:0:(genops.c:885:class_export_put()) final put ffff90bbc9635000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787338873.865150:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff90bbd888a800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1787338873.869176:0:17166:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787338873.869199:0:17166:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1787338873.869205:0:17166:0:(genops.c:885:class_export_put()) final put ffff90bbc9632800/lustre-QMT0000_UUID 00000020:00000080:1.0:1787338873.869211:0:17166:0:(genops.c:844:class_export_destroy()) destroying export ffff90bbc9632800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1787338873.869223:0:17166:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:0.0:1787338873.869405:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff90bbc9635000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:1.0:1787338874.806093:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787338875.010526:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787338875.010574:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf7ed6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c0e6575-df80-419a-8cc7-cbad06c93254:3314:1874160212101248:0@lo:400:kworker.0 00000100:00100000:2.0:1787338875.010671:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338875.012005:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf7ed5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874160212101376:0@lo:400:kworker.0 00000100:00100000:2.0:1787338875.012060:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338875.012121:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212101248 00000100:00100000:2.0:1787338875.012129:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212101248 00000100:00100000:2.0:1787338875.012176:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1787338875.012187:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbff827450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c0e6575-df80-419a-8cc7-cbad06c93254+14:3314:x1874160212101248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787338875.012244:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbff827450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c0e6575-df80-419a-8cc7-cbad06c93254+14:3314:x1874160212101248:12345-0@lo:400:kworker.0 Request processed in 59us (1574us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338875.012252:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1787338875.012302:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf7ed6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c0e6575-df80-419a-8cc7-cbad06c93254:3314:1874160212101248:0@lo:400:kworker.0 00000100:00100000:2.0:1787338875.012341:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212101376 00000100:00100000:2.0:1787338875.012345:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212101376 00000100:00100000:2.0:1787338875.012367:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1787338875.012371:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf5b72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3316:x1874160212101376:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1787338875.012377:0:14381:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1787338875.012409:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf5b72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3316:x1874160212101376:12345-0@lo:400:kworker.0 Request processed in 36us (349us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787338875.012415:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00080000:2.0:1787338875.012439:0:3316:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787338875.012445:0:3316:0:(import.c:65:import_set_state_nolock()) ffff90bbc673e000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1787338875.012449:0:3316:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:1.0:1787338875.014531:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf7ed7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1874160212101504:0@lo:400:kworker.0 00000100:00100000:1.0:1787338875.014607:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338875.014662:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212101504 00000100:00100000:1.0:1787338875.014669:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212101504 00000100:00100000:1.0:1787338875.014708:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1787338875.014716:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf7ed5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3317:x1874160212101504:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1787338875.014724:0:14382:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1787338875.014761:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf7ed5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3317:x1874160212101504:12345-0@lo:400:kworker.0 Request processed in 44us (165us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787338875.014768:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00080000:1.0:1787338875.014804:0:3317:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787338875.014809:0:3317:0:(import.c:65:import_set_state_nolock()) ffff90bac2b55000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1787338875.014813:0:3317:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1787338875.014818:0:3317:0:(import.c:65:import_set_state_nolock()) ffff90bac2b55000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787338875.014846:0:3317:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 476 00000100:00080000:1.0:1787338875.014852:0:3317:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff90bac2b55000 using connection 192.168.201.153@tcp/0@lo 00000100:00100000:1.0:1787338875.014893:0:3317:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90bbf7ed6680 x1874160212101632/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787338875.014917:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf7ed7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1874160212101504:0@lo:400:kworker.0 00000100:00100000:1.0:1787338875.014941:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf7ed6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3313:1874160212101632:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1787338875.014966:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338875.014993:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212101632 00000100:00100000:1.0:1787338875.014997:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212101632 00000100:00100000:1.0:1787338875.015014:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1787338875.015018:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf7ed7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3313:x1874160212101632:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:1.0:1787338875.015032:0:14381:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1787338875.047046:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf7ed7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3313:x1874160212101632:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 32016us (32069us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787338875.047061:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00080000:1.0:1787338875.050779:0:3313:0:(import.c:65:import_set_state_nolock()) ffff90bac2b55000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787338875.050791:0:3313:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787338875.050796:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf7ed6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3313:1874160212101632:0@lo:38:ptlrpcd_00_03.0 00000001:00100000:3.0:1787338875.055128:0:7651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787338875.055135:0:7651:0:(genops.c:885:class_export_put()) final put ffff90bac1c37800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787338875.055164:0:13151:0:(genops.c:844:class_export_destroy()) destroying export ffff90bac1c37800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1787338875.055210:0:13151:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90bac1c33800 for lustre-OST0001 00000100:00080000:2.0:1787338875.056220:0:3316:0:(import.c:65:import_set_state_nolock()) ffff90bbc673e000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787338875.056231:0:3316:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 461 00000100:00080000:2.0:1787338875.056248:0:3316:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff90bbc673e000 using connection 192.168.201.153@tcp/0@lo 00000100:00100000:2.0:1787338875.056293:0:3316:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90bbf5b71500 x1874160212101760/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787338875.056320:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf7ed5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874160212101376:0@lo:400:kworker.0 00000100:00100000:2.0:1787338875.056356:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf5b71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3313:1874160212101760:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1787338875.056529:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338875.057953:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212101760 00000100:00100000:0.0:1787338875.057968:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212101760 00000100:00100000:0.0:1787338875.058010:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1787338875.058019:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf5b70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3313:x1874160212101760:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:0.0:1787338875.058039:0:14383:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1787338875.058111:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf5b70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3313:x1874160212101760:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 91us (1581us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787338875.058126:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:2.0:1787338875.058200:0:3313:0:(import.c:65:import_set_state_nolock()) ffff90bbc673e000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787338875.058206:0:3313:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787338875.058209:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf5b71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3313:1874160212101760:0@lo:38:ptlrpcd_00_02.0 00000001:00100000:2.0:1787338875.062211:0:5861:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 4f600308-4919-499d-be82-256c83420e0e 00000001:00080000:2.0:1787338875.062228:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934678 is committed 00000020:00000080:2.0:1787338875.062233:0:5861:0:(genops.c:885:class_export_put()) final put ffff90bac1c32800/4f600308-4919-499d-be82-256c83420e0e 00000001:00100000:2.0:1787338875.062256:0:5861:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0bebf184-ca0d-4db5-82d4-d664d446db69 00000001:00080000:2.0:1787338875.062263:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934679 is committed 00000020:00000080:2.0:1787338875.062266:0:5861:0:(genops.c:885:class_export_put()) final put ffff90bac2b54800/0bebf184-ca0d-4db5-82d4-d664d446db69 00000020:00000080:3.0:1787338875.062306:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff90bac1c32800/4f600308-4919-499d-be82-256c83420e0e for lustre-MDT0000 00000020:00000080:3.0:1787338875.062357:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff90bac2b54800/0bebf184-ca0d-4db5-82d4-d664d446db69 for lustre-MDT0000 00000020:00000080:3.0:1787338875.062387:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90bbffd11000 for lustre-MDT0000 00000020:00000080:3.0:1787338875.062392:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90bac2b53000 for lustre-MDT0000 00010000:00010000:0.0:1787338875.831937:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1787338875.894290:0:17166:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff90bbc670fb40 - data ffff90bbf1742a20/ffff90bac2aa5c00 00000020:01000000:1.0:1787338875.894462:0:17166:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff90bbc400e7e0 - data ffff90bbf154a360/ffff90bbf594b400 00000001:00000004:1.0:1787338875.904080:0:17166:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934679 00000100:00080000:2.0:1787338876.005499:0:17166:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787338876.005510:0:17166:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934600 gen 4 00000004:00080000:2.0:1787338876.005533:0:17166:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787338876.005536:0:17166:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1787338876.006037:0:14403:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1787338876.006238:0:14403:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 3 count 1 00000040:00080000:1.0:1787338876.006249:0:14403:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:0.0:1787338876.008666:0:17166:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787338876.008675:0:17166:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 4 00000004:00080000:0.0:1787338876.008694:0:17166:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787338876.008696:0:17166:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1787338876.009360:0:14405:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1787338876.009365:0:14405:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 2 count 1 00000040:00080000:1.0:1787338876.009386:0:14405:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:2.0:1787338876.069258:0:17166:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x83671231080c2470 00000020:00000080:2.0:1787338876.069273:0:17166:0:(genops.c:885:class_export_put()) final put ffff90bbc8435800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787338876.069652:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff90bbc8435800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787338876.070741:0:17166:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x83671231080c2485 00000020:00000080:2.0:1787338876.070750:0:17166:0:(genops.c:885:class_export_put()) final put ffff90bbc843a000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1787338876.070800:0:17166:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1787338876.070806:0:17166:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787338876.070824:0:17166:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787338876.070828:0:17166:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff90bbee0ab370) has no exports 00000004:01000000:2.0:1787338876.071021:0:17166:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1787338876.071030:0:17166:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x83671231080c24d2 00000020:00000080:2.0:1787338876.071034:0:17166:0:(genops.c:885:class_export_put()) final put ffff90bbc2c50800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787338876.071458:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff90bbc843a000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1787338876.071669:0:17166:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1787338876.071676:0:17166:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787338876.071683:0:17166:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787338876.071686:0:17166:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff90bbde3eb370) has no exports 00000020:00000080:2.0:1787338876.071693:0:17166:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x83671231080c24cb 00000020:00000080:2.0:1787338876.071699:0:17166:0:(genops.c:885:class_export_put()) final put ffff90bbc8437800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787338876.071981:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff90bbc2c50800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1787338876.071989:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff90bbc8437800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1787338876.072357:0:17166:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1787338876.072362:0:17166:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787338876.072366:0:17166:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 5 00000004:00080000:2.0:1787338876.072372:0:17166:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787338876.072374:0:17166:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787338876.072517:0:17166:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787338876.072526:0:17166:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787338876.072533:0:17166:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x83671231080c24bd 00000020:00000080:2.0:1787338876.072540:0:17166:0:(genops.c:885:class_export_put()) final put ffff90bbc9636800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787338876.073029:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90bbf40f3800 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1787338876.073036:0:8:0:(genops.c:885:class_export_put()) final put ffff90bbc9637800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787338876.073176:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff90bbc9637800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1787338876.073183:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1787338876.073320:0:17166:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1787338876.073326:0:17166:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787338876.073332:0:17166:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787338876.073336:0:17166:0:(genops.c:1558:class_disconnect_exports()) OBD device 8 (ffff90bbffd84d28) has no exports 00000020:00000080:2.0:1787338876.073343:0:17166:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x83671231080c24b6 00000020:00000080:2.0:1787338876.073348:0:17166:0:(genops.c:885:class_export_put()) final put ffff90bbc93a9800/lustre-MDT0000-osd_UUID 00010000:01000000:2.0:1787338876.074514:0:17166:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1787338876.074519:0:17166:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787338876.074523:0:17166:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934600 gen 5 00000004:00080000:2.0:1787338876.074528:0:17166:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787338876.074530:0:17166:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787338876.074823:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff90bbc9636800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1787338876.074902:0:17166:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787338876.074909:0:17166:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787338876.074935:0:17166:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787338876.074952:0:17166:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787338876.074956:0:17166:0:(genops.c:885:class_export_put()) final put ffff90bbc8432800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787338876.074959:0:17166:0:(genops.c:844:class_export_destroy()) destroying export ffff90bbc8432800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1787338876.074964:0:17166:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787338876.075345:0:17166:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x83671231080c248c 00000020:00000080:2.0:1787338876.075353:0:17166:0:(genops.c:885:class_export_put()) final put ffff90bbc8438800/lustre-MDD0000_UUID 00000020:00000080:0.0:1787338876.076034:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff90bbc93a9800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787338876.076054:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90bbc93ac800 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1787338876.076061:0:8:0:(genops.c:885:class_export_put()) final put ffff90bbc2c57000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787338876.076063:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff90bbc2c57000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1787338876.076067:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1787338876.076310:0:17166:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1787338876.076316:0:17166:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787338876.076323:0:17166:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787338876.076327:0:17166:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff90bbd1730000) has no exports 00000020:00000080:2.0:1787338876.076351:0:17166:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787338876.076355:0:17166:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1787338876.076360:0:17166:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x83671231080c2493 00000020:00000080:2.0:1787338876.076364:0:17166:0:(genops.c:885:class_export_put()) final put ffff90bbc843d800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1787338876.076372:0:17166:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90bbc8428000 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1787338876.076375:0:17166:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90bbc8428000 3 00000020:01000004:2.0:1787338876.076379:0:17166:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff90bbc8428000 from lustre-MDT0000 00000020:00000080:2.0:1787338876.076458:0:17166:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787338876.076462:0:17166:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1787338876.076465:0:17166:0:(genops.c:885:class_export_put()) final put ffff90bbc8432000/lustre-MDT0000_UUID 00000020:00000080:2.0:1787338876.076467:0:17166:0:(genops.c:844:class_export_destroy()) destroying export ffff90bbc8432000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1787338876.076474:0:17166:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1787338876.076509:0:17166:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:2.0:1787338876.076513:0:17166:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1787338876.076516:0:17166:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1787338876.076519:0:17166:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787338876.076522:0:17166:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787338876.076528:0:17166:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff90bac27d0800 2c0e6575-df80-419a-8cc7-cbad06c93254 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787338876.076533:0:17166:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff90bbfc24b370) has exports, disconnecting them 00000020:00080000:2.0:1787338876.076538:0:17166:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff90bac27d0800), last request at 1787338794 00000020:00000080:2.0:1787338876.076551:0:17166:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x83671231080c2438 00000020:00010000:2.0:1787338876.076556:0:17166:0:(genops.c:1921:obd_stale_export_put()) Put export ffff90bac27d0800: total 2 00000100:00080000:2.0:1787338876.076569:0:17166:0:(import.c:65:import_set_state_nolock()) ffff90bac27d5800 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1787338876.077763:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff90bbc8438800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1787338876.077772:0:8:0:(genops.c:885:class_export_put()) final put ffff90bbc8437000/lustre-MDD0000_UUID 00000020:00000080:0.0:1787338876.077774:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff90bbc8437000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1787338876.077780:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00080000:2.0:1787338876.077956:0:17166:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff90bac27d0800): rc 0 00000020:00080000:2.0:1787338876.077963:0:17166:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff90bbfc24b370) has no exports 00000020:00000080:0.0:1787338876.078312:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff90bbc843d800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00010000:1.0:1787338876.078687:0:15652:0:(genops.c:1907:obd_stale_export_get()) Get export ffff90bac27d0800: total 0 00010000:00010000:1.0:1787338876.078723:0:15652:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff90bac27d0800, canceled 0 locks, left on hash table 8. 00010000:00010000:1.0:1787338876.078752:0:15652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90bbf3c53e00/0x83671231080c255e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x83671231080c2557 expref: 9 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338876.078772:0:15652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90bbf40e3c00/0x83671231080c26ca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x83671231080c26c3 expref: 8 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338876.078784:0:15652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90bbf7ea4800/0x83671231080c256c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x83671231080c2565 expref: 7 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338876.078795:0:15652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90bbffef5400/0x83671231080c2852 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x83671231080c284b expref: 6 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338876.078805:0:15652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90bbfbe9c000/0x83671231080c2446 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x83671231080c243f expref: 5 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338876.078813:0:15652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90bbf40e3000/0x83671231080c2860 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x83671231080c2859 expref: 4 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338876.078839:0:15652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90bbffef4e00/0x83671231080c2596 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x83671231080c258f expref: 3 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338876.078849:0:15652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90bbfbe9c800/0x83671231080c26a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x83671231080c2699 expref: 2 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338876.078860:0:15652:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff90bac27d0800, canceled 8 locks, left on hash table 0. 00000020:00000080:1.0:1787338876.078890:0:15652:0:(genops.c:885:class_export_put()) final put ffff90bac27d0800/2c0e6575-df80-419a-8cc7-cbad06c93254 00010000:00010000:1.0:1787338876.078903:0:15652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338876.078905:0:15652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338876.078917:0:15652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787338876.079028:0:14375:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff90bbc7cde200:14375] 1 exiting: rc = 0 00000100:00100000:2.0:1787338876.079281:0:14376:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff90bbc7cdfe00:14376] 2 exiting: rc = 0 00000100:00100000:0.0:1787338876.079444:0:14373:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff90bbe0752600:14373] 0 exiting: rc = 1 00000020:00000080:0.0:1787338876.079493:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff90bac27d0800/2c0e6575-df80-419a-8cc7-cbad06c93254 for MGS 00000100:00100000:2.0:1787338876.079592:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338876.079602:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338876.079608:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338876.079618:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338876.079625:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338876.079631:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338876.079637:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338876.079643:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338876.079648:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338876.079654:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338876.079659:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338876.079664:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338876.079671:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338876.079677:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338876.079682:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338876.079687:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338876.079692:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338876.079697:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338876.079702:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338876.079707:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338876.079712:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338876.079717:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338876.079722:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338876.079727:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338876.079733:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338876.079739:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338876.079745:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338876.079752:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338876.079758:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338876.079774:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338876.079781:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338876.079788:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338876.079795:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338876.079802:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338876.079808:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338876.079826:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338876.079833:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338876.079839:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338876.079845:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338876.079851:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338876.079858:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338876.079864:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338876.079897:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338876.079904:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338876.079910:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338876.079916:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338876.079922:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338876.079929:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338876.079935:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338876.079940:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338876.079945:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338876.079951:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338876.079956:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338876.079961:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338876.079968:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338876.079973:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338876.079979:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338876.079984:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338876.079989:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338876.079995:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338876.080001:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338876.080007:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338876.080014:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338876.080021:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:2.0:1787338876.080987:0:17166:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787338876.080991:0:17166:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:00000080:0.0:1787338876.082834:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90bac27d5800 for MGS 00000020:01000000:2.0:1787338876.083755:0:17166:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff90bbffd092a0 - data ffff90bbf15bda20/ffff90bac3454c00 00000020:01000000:2.0:1787338876.083934:0:17166:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff90bbeb116e40 - data ffff90bbe68460d8/ffff90bbfad63000 00000020:00000080:2.0:1787338876.084765:0:17166:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x83671231080c241c 00000020:00000080:2.0:1787338876.084775:0:17166:0:(genops.c:885:class_export_put()) final put ffff90bac1f1f800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1787338876.084797:0:17166:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90bbc8428000 from MGS, refs=2 00000020:01000004:2.0:1787338876.084801:0:17166:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90bbc8428000 2 00000020:01000004:2.0:1787338876.084803:0:17166:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff90bbc8428000 from MGS 00000020:00000080:2.0:1787338876.084837:0:17166:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787338876.084844:0:17166:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1787338876.084846:0:17166:0:(genops.c:885:class_export_put()) final put ffff90bac1f1e000/MGS 00000020:00000080:2.0:1787338876.084849:0:17166:0:(genops.c:844:class_export_destroy()) destroying export ffff90bac1f1e000/MGS for MGS 00000020:01000000:2.0:1787338876.084856:0:17166:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1787338876.084943:0:17166:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1787338876.084947:0:17166:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787338876.084952:0:17166:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787338876.084960:0:17166:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff90bbc5194800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787338876.084966:0:17166:0:(genops.c:1553:class_disconnect_exports()) OBD device 10 (ffff90bbfc2499b8) has exports, disconnecting them 00000020:00080000:2.0:1787338876.084973:0:17166:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff90bbc5194800), last request at 1787338795 00000020:00000080:2.0:1787338876.084977:0:17166:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x83671231080c250a 00000020:00080000:2.0:1787338876.084986:0:17166:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff90bbc5194800): rc 0 00000020:00000080:2.0:1787338876.084991:0:17166:0:(genops.c:885:class_export_put()) final put ffff90bbc5194800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1787338876.092582:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff90bac1f1f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787338876.092601:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff90bbc5194800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1787338876.093046:0:17166:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1787338876.093052:0:17166:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787338876.093057:0:17166:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787338876.093064:0:17166:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787338876.093085:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90bbc5197800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1787338876.093268:0:17166:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787338876.093278:0:17166:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1787338876.093284:0:17166:0:(genops.c:885:class_export_put()) final put ffff90bbc5192800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1787338876.093288:0:17166:0:(genops.c:844:class_export_destroy()) destroying export ffff90bbc5192800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1787338876.093295:0:17166:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1787338876.093351:0:17166:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90bbc8428000 1 00000020:00000080:0.0:1787338876.093357:0:17166:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x83671231080c240e 00000020:00000080:0.0:1787338876.093363:0:17166:0:(genops.c:885:class_export_put()) final put ffff90bac1f1f000/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1787338876.093370:0:17166:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1787338876.093377:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff90bac1f1f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787338876.093386:0:17166:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787338876.093390:0:17166:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787338876.093394:0:17166:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff90bbee0acd28) has no exports 00000020:00000080:0.0:1787338876.124547:0:17166:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787338876.124562:0:17166:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1787338876.124566:0:17166:0:(genops.c:885:class_export_put()) final put ffff90bbc842b800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787338876.124571:0:17166:0:(genops.c:844:class_export_destroy()) destroying export ffff90bbc842b800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1787338876.124581:0:17166:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1787338876.124722:0:17166:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff90bbc842b000 00000020:01000000:0.0:1787338876.124744:0:17166:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1787338876.124748:0:17166:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787338876.124752:0:17166:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787338876.124764:0:17166:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff90bbfc24cd28) has no exports 00000100:00100000:0.0:1787338876.124834:0:16941:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff90bac2105000:16941] 3 exiting: rc = 0 00000100:00100000:0.0:1787338876.124959:0:14383:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff90bbd1b09000:14383] 2 exiting: rc = 0 00000100:00100000:0.0:1787338876.125954:0:14382:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff90bbd1b09800:14382] 1 exiting: rc = 0 00000100:00100000:0.0:1787338876.126015:0:14381:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff90bbffa26400:14381] 0 exiting: rc = 1 00000100:00100000:0.0:1787338876.126062:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.126069:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.126075:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.126081:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.126086:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.126092:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.126098:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.126103:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.126108:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.126114:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.126119:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.126124:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.126130:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.126136:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.126141:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.126146:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.126152:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.126158:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.126163:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.126170:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.126177:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.126182:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.126188:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.126194:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.126199:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.126206:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.126212:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.126218:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.126223:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.126240:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.126245:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.126250:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.126255:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.126260:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.126266:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.126272:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.126277:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.126282:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.126288:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.126293:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.126298:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.126304:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.126309:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.126314:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.126320:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.126325:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.126330:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.126336:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.126341:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.126346:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.126352:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.126357:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.126363:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.126368:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.126373:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.126378:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.126394:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.126399:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.126405:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.126414:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.126420:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.126425:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.126431:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.126436:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.130497:0:14385:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff90bbf43dc800:14385] 1 exiting: rc = 0 00000100:00100000:0.0:1787338876.131004:0:14384:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff90bbc2ad9a00:14384] 0 exiting: rc = 1 00000100:00100000:1.0:1787338876.131104:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.131117:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.131123:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.131130:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.131137:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.131144:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.131150:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.131155:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.131161:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.131167:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.131172:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.131176:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.131180:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.131185:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.131190:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.131196:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.131202:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.131208:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.131213:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.131217:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.131222:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.131227:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.131232:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.131236:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.131241:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.131246:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.131251:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.131256:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.131261:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.131267:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.131272:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.131277:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.131281:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.131300:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.131305:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.131310:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.131315:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.131320:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.131326:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.131330:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.131335:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.131341:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.131346:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.131351:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.131356:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.131361:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.131367:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.131372:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.131377:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.131451:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.131458:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.131463:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.131469:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.131475:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.131480:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.131485:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.131491:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.131496:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.131501:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.131506:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.131511:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.131517:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.131522:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.131527:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.132022:0:14386:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff90bbd1b09200:14386] 0 exiting: rc = 1 00000100:00100000:0.0:1787338876.132083:0:14387:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff90bbd1b09e00:14387] 1 exiting: rc = 0 00000100:00100000:1.0:1787338876.132168:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.132181:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.132188:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.132196:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.132210:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.132215:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.132231:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.132239:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.132245:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.132251:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.132257:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.132263:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.132269:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.132275:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.132281:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.132287:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.132292:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.132298:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.132318:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.132324:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.132329:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.132335:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.132340:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.132347:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.132354:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.132361:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.132367:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.132372:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.132378:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.132453:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.132474:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.132481:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.132487:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.132493:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.132500:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.132506:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.132513:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.132520:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.132526:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.132541:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.132548:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.132555:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.132575:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.132584:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.132591:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.132597:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.132603:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.132610:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.132617:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.132624:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.132629:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.132634:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.132640:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.132645:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.132665:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.132672:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.132677:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.132683:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.132689:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.132695:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.132700:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.132707:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.132712:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.132726:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.140124:0:14389:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff90bbfbc9e000:14389] 1 exiting: rc = 0 00000100:00100000:0.0:1787338876.140294:0:14388:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff90bbf3e97000:14388] 0 exiting: rc = 1 00000100:00100000:1.0:1787338876.140401:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.140408:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.140413:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.140419:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.140425:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.140430:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.140435:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.140440:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.140445:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.140465:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.140470:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.140475:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.140479:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.140484:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.140490:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.140495:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.140500:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.140505:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.140511:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.140516:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.140522:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.140527:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.140533:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.140539:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.140545:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.140550:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.140555:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.140560:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.140565:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.140570:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.140575:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.140580:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.140585:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.140591:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.140597:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.140602:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.140607:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.140613:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.140618:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.140623:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.140629:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.140634:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.140639:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.140644:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.140657:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.140662:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.140668:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.140672:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.140677:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.140682:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.140687:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.140692:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.140697:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.140702:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.140707:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.140713:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.140717:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.140723:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.140728:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.140733:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.140738:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.140744:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.140748:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.140753:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.141249:0:14391:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff90bbfbc9ea00:14391] 1 exiting: rc = 0 00000100:00100000:0.0:1787338876.141401:0:14390:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff90bbfbc9f800:14390] 0 exiting: rc = 1 00000100:00100000:1.0:1787338876.141509:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.141516:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.141521:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.141525:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.141530:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.141534:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.141539:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.141543:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.141548:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.141552:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.141557:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.141562:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.141567:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.141571:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.141577:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.141591:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.141596:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.141601:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.141605:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.141609:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.141615:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.141619:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.141623:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.141627:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.141632:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.141637:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.141641:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.141646:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.141651:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.141656:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.141660:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.141665:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.141670:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.141675:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.141680:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.141685:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.141690:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.141696:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.141701:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.141706:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.141710:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.141714:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.141719:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.141724:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.141729:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.141734:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.141738:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.141743:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.141748:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.141753:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.141764:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.141769:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.141775:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.141781:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.141786:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.141791:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.141795:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.141802:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.141806:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.141812:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.141829:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.141834:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.141839:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.141844:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.142317:0:14393:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff90bbed9e9400:14393] 1 exiting: rc = 0 00000100:00100000:2.0:1787338876.143655:0:14392:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff90bbfbc9fc00:14392] 0 exiting: rc = 1 00000100:00100000:1.0:1787338876.143840:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.143848:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.143853:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.143858:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.143863:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.143868:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.143898:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.143904:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.143910:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.144150:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.144159:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.144164:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.144169:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.144175:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.144179:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.144184:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.144188:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.144193:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.144198:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.144204:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.144209:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.144225:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.144231:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.144236:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.144241:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.144246:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.144252:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.144258:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.144263:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.144268:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.144272:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.144277:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.144282:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.144287:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.144292:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.144297:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.144302:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.144307:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.144311:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.144316:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.144321:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.144326:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.144332:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.144337:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.144342:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.144347:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.144352:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.144357:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.144362:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.144366:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.144370:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.144375:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.144379:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.144449:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.144455:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.144460:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.144471:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.144476:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.144481:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.144486:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.144492:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.144496:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.144501:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338876.144506:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.148627:0:14394:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff90bbf7e66400:14394] 0 exiting: rc = 1 00000100:00100000:0.0:1787338876.148836:0:14395:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff90bbf7e66a00:14395] 1 exiting: rc = 0 00000100:00100000:0.0:1787338876.149030:0:14396:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff90bbf7e67800:14396] 2 exiting: rc = 0 00000100:00100000:0.0:1787338876.149116:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.149123:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.149129:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.149143:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.149151:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.149156:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.149162:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.149168:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.149176:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.149182:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.149187:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.149192:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.149199:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.149205:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.149210:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.149215:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.149221:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.149226:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.149233:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.149239:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.149256:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.149263:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.149268:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.149286:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.149292:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.149298:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.149304:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.149309:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.149315:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.149320:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.149328:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.149333:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.149339:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.149344:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.149350:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.149356:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.149362:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.149367:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.149373:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.149478:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.149487:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.149493:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.149498:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.149504:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.149524:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.149530:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.149535:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.149540:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.149545:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.149550:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.149555:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.149561:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.149566:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.149578:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.149584:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.149589:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.149601:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.149608:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.149619:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.149625:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.149631:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.149637:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.149643:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338876.149648:0:17166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1787338876.154615:0:17166:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787338876.154627:0:17166:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1787338876.154632:0:17166:0:(genops.c:885:class_export_put()) final put ffff90bac1f18800/MDS_uuid 00000020:00000080:1.0:1787338876.154635:0:17166:0:(genops.c:844:class_export_destroy()) destroying export ffff90bac1f18800/MDS_uuid for MDS 00000020:01000000:1.0:1787338876.154640:0:17166:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1787338876.154759:0:17166:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:1.0:1787338876.857131:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787338877.630396:0:6714:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787338877.630407:0:6714:0:(genops.c:885:class_export_put()) final put ffff90bbef177800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787338877.630739:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff90bbef177800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1787338877.631629:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90bbef175800 for lustre-OST0000 00010000:00010000:1.0:1787338877.879343:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338878.902404:0:15652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787338879.200737:0:17319:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1787338879.225379:0:17319:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1787338879.225450:0:17319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9de00/0x83671231080c258f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c2596 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338879.225466:0:17319:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9de00/0x83671231080c258f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x83671231080c2596 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338879.225474:0:17319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9de00/0x83671231080c258f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x83671231080c2596 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338879.225481:0:17319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9de00/0x83671231080c258f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x83671231080c2596 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338879.225508:0:17319:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787338879.225514:0:17319:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1787338879.225535:0:17319:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787338879.225540:0:17319:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787338879.225546:0:17319:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787338879.225552:0:17319:0:(import.c:65:import_set_state_nolock()) ffff90bbc673e000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1787338879.225557:0:17319:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787338879.225558:0:17319:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787338879.225562:0:17319:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787338879.226498:0:17319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9d000/0x83671231080c2565 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c256c expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338879.226531:0:17319:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9d000/0x83671231080c2565 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x83671231080c256c expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338879.226538:0:17319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9d000/0x83671231080c2565 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x83671231080c256c expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338879.226545:0:17319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9d000/0x83671231080c2565 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x83671231080c256c expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338879.226574:0:17319:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787338879.226581:0:17319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9da00/0x83671231080c2859 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c2860 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338879.226588:0:17319:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9da00/0x83671231080c2859 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x83671231080c2860 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338879.226595:0:17319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9da00/0x83671231080c2859 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x83671231080c2860 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338879.226601:0:17319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9da00/0x83671231080c2859 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x83671231080c2860 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338879.226612:0:17319:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:0.0:1787338879.226616:0:17319:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1787338879.226635:0:17319:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1787338879.226639:0:17319:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1787338879.226644:0:17319:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787338879.226650:0:17319:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787338879.226656:0:17319:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff90bbffd819b8) has no exports 00000020:00080000:0.0:1787338879.226689:0:17319:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff90bbffd819b8) has no exports 00000020:01000000:0.0:1787338879.228448:0:17319:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff90bbeb116540 - data ffff90bbf14ece58/ffff90bac1bee400 00000020:01000000:0.0:1787338879.228634:0:17319:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff90bbfbd23cc0 - data ffff90bbf15c3d80/ffff90bbd7f67c00 00010000:00010000:1.0:1787338879.229370:0:14370:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787338879.229381:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9de00/0x83671231080c258f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x83671231080c2596 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338879.229392:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbfbe9de00 already unused, calling callback (ffffffffc1b2ec20) 10000000:00010000:1.0:1787338879.229397:0:14370:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9de00/0x83671231080c258f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x83671231080c2596 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338879.229408:0:14370:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9de00/0x83671231080c258f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x83671231080c2596 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787338879.229416:0:14370:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9de00/0x83671231080c258f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x83671231080c2596 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787338879.229422:0:14370:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787338879.229425:0:14370:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1787338879.229444:0:14370:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1787338879.229486:0:14370:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9de00/0x83671231080c258f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x83671231080c2596 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338879.229492:0:14370:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787338879.229523:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9de00/0x83671231080c258f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x83671231080c2596 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338879.229530:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9de00/0x83671231080c258f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x83671231080c2596 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338879.229543:0:14370:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787338879.229546:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9d000/0x83671231080c2565 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x83671231080c256c expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338879.229552:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbfbe9d000 already unused, calling callback (ffffffffc1b2ec20) 10000000:00010000:1.0:1787338879.229555:0:14370:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9d000/0x83671231080c2565 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x83671231080c256c expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338879.229561:0:14370:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9d000/0x83671231080c2565 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x83671231080c256c expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787338879.229568:0:14370:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9d000/0x83671231080c2565 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x83671231080c256c expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787338879.229573:0:14370:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787338879.229575:0:14370:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:1.0:1787338879.229577:0:14370:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:1.0:1787338879.229590:0:14370:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9d000/0x83671231080c2565 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x83671231080c256c expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338879.229605:0:14370:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787338879.229619:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9d000/0x83671231080c2565 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x83671231080c256c expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338879.229626:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9d000/0x83671231080c2565 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x83671231080c256c expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338879.229635:0:14370:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787338879.229638:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9da00/0x83671231080c2859 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x83671231080c2860 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338879.229644:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbfbe9da00 already unused, calling callback (ffffffffc1b2ec20) 10000000:00010000:1.0:1787338879.229647:0:14370:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9da00/0x83671231080c2859 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x83671231080c2860 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338879.229654:0:14370:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9da00/0x83671231080c2859 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x83671231080c2860 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787338879.229660:0:14370:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9da00/0x83671231080c2859 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x83671231080c2860 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787338879.229664:0:14370:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1787338879.229666:0:14370:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1787338879.229669:0:14370:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1787338879.229682:0:14370:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9da00/0x83671231080c2859 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x83671231080c2860 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338879.229688:0:14370:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787338879.229702:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9da00/0x83671231080c2859 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x83671231080c2860 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338879.229709:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9da00/0x83671231080c2859 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x83671231080c2860 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338879.229728:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338879.229730:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338879.229731:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338879.229739:0:15652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787338879.229757:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf7ed6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c0e6575-df80-419a-8cc7-cbad06c93254:3314:1874160212101888:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787338879.229849:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338879.229941:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787338879.229948:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf7ed5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c0e6575-df80-419a-8cc7-cbad06c93254:3314:1874160212102016:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787338879.229970:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338879.229999:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787338879.230007:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf7ed4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c0e6575-df80-419a-8cc7-cbad06c93254:3317:1874160212102144:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787338879.230028:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338879.230068:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212101888 00000100:00100000:1.0:1787338879.230074:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212101888 00000100:00100000:1.0:1787338879.230117:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212102016 00000100:00100000:1.0:1787338879.230120:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212102016 00000100:00100000:1.0:1787338879.230130:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212102144 00000100:00100000:1.0:1787338879.230133:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212102144 00000100:00100000:1.0:1787338879.230147:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787338879.230167:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf7ed7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3314:x1874160212101888:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1787338879.230174:0:14366:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787338879 with bad export cookie 9468556743367468088 00010000:00010000:3.0:1787338879.234280:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787338879.252718:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787338879.252730:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf7ed7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3314:x1874160212102016:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1787338879.252738:0:14367:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787338879 with bad export cookie 9468556743367468088 00000100:00100000:1.0:1787338879.253857:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf7ed7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3314:x1874160212102016:12345-0@lo:103:ldlm_bl.0 Request processed in 1121us (23879us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787338879.253909:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787338879.253945:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787338879.253951:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf7ed6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3317:x1874160212102144:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1787338879.253957:0:14367:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787338879 with bad export cookie 9468556743367468088 00000100:00100000:1.0:1787338879.254001:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf7ed6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3317:x1874160212102144:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (23971us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787338879.254007:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:1.0:1787338879.254123:0:3317:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.153@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787338879.254130:0:3317:0:(import.c:65:import_set_state_nolock()) ffff90bbc842d800 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1787338879.254134:0:3317:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.201.153@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:2.0:1787338879.254445:0:3314:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.153@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787338879.263303:0:3317:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.201.153@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1787338879.263311:0:3317:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1787338879.263377:0:3317:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff90bbf7ed6680 x1874160212101888/t0(0) o103->MGC192.168.201.153@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787338895 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787338879.263396:0:3317:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff90bbf7ed5f80 x1874160212102016/t0(0) o103->MGC192.168.201.153@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787338895 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787338879.263407:0:3317:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff90bbf7ed4e00 x1874160212102144/t0(0) o103->MGC192.168.201.153@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787338895 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1787338879.263417:0:3317:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1787338879.263420:0:3317:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1787338879.263422:0:3317:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1787338879.268258:0:3314:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff90bbc842d800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:2.0:1787338879.269545:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf7ed5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c0e6575-df80-419a-8cc7-cbad06c93254:3314:1874160212102016:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1787338879.269631:0:3317:0:(import.c:65:import_set_state_nolock()) ffff90bbc842d800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787338879.269638:0:3317:0:(import.c:510:import_select_connection()) MGC192.168.201.153@tcp: connect to NID 0@lo last attempt 447 00000100:00080000:1.0:1787338879.269646:0:3317:0:(import.c:624:import_select_connection()) MGC192.168.201.153@tcp: import ffff90bbc842d800 using connection 192.168.201.153@tcp/0@lo 00000100:00100000:1.0:1787338879.269683:0:3317:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90bbf7ed4380 x1874160212102272/t0(0) o250->MGC192.168.201.153@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787338879.269720:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf7ed4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c0e6575-df80-419a-8cc7-cbad06c93254:3317:1874160212102144:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787338879.269890:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf7ed4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2c0e6575-df80-419a-8cc7-cbad06c93254:3313:1874160212102272:0@lo:250:ptlrpcd_00_03.0 00000100:00100000:1.0:1787338879.270662:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf7ed6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c0e6575-df80-419a-8cc7-cbad06c93254:3314:1874160212101888:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787338879.272062:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf7ed7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3314:x1874160212101888:12345-0@lo:103:ldlm_bl.0 Request processed in 41891us (42197us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787338879.272077:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000400:00000100:1.0:1787338879.278997:0:3313:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874160212102272 offset 0 length 520: 4 00100000:10000000:0.0:1787338879.282168:0:17319:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1787338879.321825:0:17319:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x83671231080c257a 00000020:00000080:3.0:1787338879.321837:0:17319:0:(genops.c:885:class_export_put()) final put ffff90bbef176000/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1787338879.321860:0:17319:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90bbc2e86800 from lustre-OST0000, refs=2 00000020:01000004:3.0:1787338879.321863:0:17319:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90bbc2e86800 2 00000020:01000004:3.0:1787338879.321867:0:17319:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff90bbc2e86800 from lustre-OST0000 00000020:00000080:3.0:1787338879.321907:0:17319:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787338879.321918:0:17319:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1787338879.321921:0:17319:0:(genops.c:885:class_export_put()) final put ffff90bbc673c800/lustre-OST0000_UUID 00000020:00000080:3.0:1787338879.321924:0:17319:0:(genops.c:844:class_export_destroy()) destroying export ffff90bbc673c800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1787338879.321930:0:17319:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1787338879.321973:0:17319:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1787338879.321979:0:17319:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1787338879.321982:0:17319:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787338879.321987:0:17319:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787338879.321995:0:17319:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff90bbffa91000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787338879.322001:0:17319:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff90bbffd83370) has exports, disconnecting them 00000020:00080000:3.0:1787338879.322006:0:17319:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff90bbffa91000), last request at 1787338808 00000020:00000080:3.0:1787338879.322025:0:17319:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x83671231080c25a4 00000020:00080000:3.0:1787338879.322034:0:17319:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff90bbffa91000): rc 0 00000020:00000080:3.0:1787338879.322039:0:17319:0:(genops.c:885:class_export_put()) final put ffff90bbffa91000/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1787338879.322443:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff90bbef176000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1787338879.322454:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff90bbffa91000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1787338879.343547:0:17319:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1787338879.343558:0:17319:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787338879.343563:0:17319:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787338879.343573:0:17319:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787338879.343790:0:17319:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787338879.343800:0:17319:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:0.0:1787338879.343807:0:17319:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90bbc2e86800 1 00000020:00000080:0.0:1787338879.343813:0:17319:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x83671231080c2549 00000020:00000080:0.0:1787338879.343821:0:17319:0:(genops.c:885:class_export_put()) final put ffff90bbde7a3800/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1787338879.343826:0:17319:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1787338879.343832:0:17319:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787338879.343837:0:17319:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787338879.343840:0:17319:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff90bbde3e8000) has no exports 00000020:00000080:1.0:1787338879.343935:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90bbc673e000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1787338879.343943:0:8:0:(genops.c:885:class_export_put()) final put ffff90bbef176800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1787338879.343946:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff90bbef176800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1787338879.343957:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1787338879.344017:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff90bbde7a3800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1787338879.358923:0:17319:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787338879.358941:0:17319:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1787338879.358947:0:17319:0:(genops.c:885:class_export_put()) final put ffff90bbc2e86000/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1787338879.358952:0:17319:0:(genops.c:844:class_export_destroy()) destroying export ffff90bbc2e86000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1787338879.358960:0:17319:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1787338879.359095:0:17319:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff90bbc2e84800 00000020:02000400:1.0:1787338879.359143:0:17319:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1787338879.926159:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787338880.127366:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787338880.127378:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787338880.127382:0:8:0:(import.c:65:import_set_state_nolock()) ffff90bac2b55000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787338880.127391:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 527 00000100:00080000:1.0:1787338880.127397:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787338880.127404:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff90bac2b55000 using connection 192.168.201.153@tcp/0@lo 00000100:00100000:1.0:1787338880.127442:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90bbf7ed6680 x1874160212102400/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787338880.127537:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf7ed6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3313:1874160212102400:0@lo:38:kworker.0 00000400:00000100:0.0:1787338880.127590:0:3313:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874160212102400 offset 0 length 520: 4 00010000:00010000:3.0:1787338880.950122:0:15652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338881.976706:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787338882.072501:0:17470:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1787338882.087518:0:17470:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1787338882.087622:0:17470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9c600/0x83671231080c26c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c26ca expref: -99 pid: 15781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338882.087638:0:17470:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9c600/0x83671231080c26c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x83671231080c26ca expref: -99 pid: 15781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338882.087662:0:17470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9c600/0x83671231080c26c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x83671231080c26ca expref: -99 pid: 15781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338882.087669:0:17470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9c600/0x83671231080c26c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x83671231080c26ca expref: -99 pid: 15781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338882.087695:0:17470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787338882.087701:0:17470:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1787338882.087733:0:17470:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787338882.087745:0:17470:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff90bbf7ed6680 x1874160212102400/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787338895 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787338882.087826:0:17470:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787338882.087834:0:17470:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787338882.087851:0:17470:0:(import.c:65:import_set_state_nolock()) ffff90bac2b55000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1787338882.087858:0:17470:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787338882.087862:0:17470:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff90bbf7ed6680 x1874160212102400/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787338895 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1787338882.087930:0:14370:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787338882.087938:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9c600/0x83671231080c26c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x83671231080c26ca expref: -99 pid: 15781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338882.087946:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbfbe9c600 already unused, calling callback (ffffffffc1b2ec20) 10000000:00010000:2.0:1787338882.087950:0:14370:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9c600/0x83671231080c26c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x83671231080c26ca expref: -99 pid: 15781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338882.087959:0:14370:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9c600/0x83671231080c26c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x83671231080c26ca expref: -99 pid: 15781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787338882.087967:0:14370:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9c600/0x83671231080c26c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x83671231080c26ca expref: -99 pid: 15781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787338882.087973:0:14370:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787338882.087976:0:14370:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1787338882.087978:0:14370:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1787338882.087992:0:14370:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff90bbc842d800 00010000:00010000:2.0:1787338882.087997:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9c600/0x83671231080c26c3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x83671231080c26ca expref: -99 pid: 15781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338882.088003:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9c600/0x83671231080c26c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x83671231080c26ca expref: -99 pid: 15781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338882.088016:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787338882.088018:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787338882.088020:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787338882.088304:0:17470:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787338882.088337:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf7ed6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3313:1874160212102400:0@lo:38:kworker.0 00000100:00100000:0.0:1787338882.088399:0:17470:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787338882.090255:0:17470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbffef5e00/0x83671231080c2699 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c26a0 expref: -99 pid: 15781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338882.090274:0:17470:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbffef5e00/0x83671231080c2699 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x83671231080c26a0 expref: -99 pid: 15781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338882.090282:0:17470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbffef5e00/0x83671231080c2699 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x83671231080c26a0 expref: -99 pid: 15781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338882.090326:0:17470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.153@tcp lock: ffff90bbffef5e00/0x83671231080c2699 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x83671231080c26a0 expref: -99 pid: 15781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338882.090353:0:17470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787338882.090362:0:17470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bc02045800/0x83671231080c284b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c2852 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338882.090369:0:17470:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bc02045800/0x83671231080c284b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x83671231080c2852 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338882.090375:0:17470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bc02045800/0x83671231080c284b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x83671231080c2852 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338882.090381:0:17470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.153@tcp lock: ffff90bc02045800/0x83671231080c284b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x83671231080c2852 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338882.090455:0:17470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1787338882.090469:0:17470:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1787338882.090496:0:17470:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1787338882.090500:0:17470:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1787338882.090504:0:17470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787338882.090509:0:17470:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787338882.090513:0:17470:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff90bbde3e99b8) has no exports 00000020:00080000:0.0:1787338882.090550:0:17470:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff90bbde3e99b8) has no exports 00000020:01000000:0.0:1787338882.092681:0:17470:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff90bbeb116180 - data ffff90bbf15e7948/ffff90bac1bee800 00000020:01000000:0.0:1787338882.093402:0:17470:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff90bbeb1162a0 - data ffff90bbf7830d80/ffff90bac2a62800 00010000:00010000:1.0:1787338882.093857:0:14369:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787338882.093859:0:15652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787338882.093869:0:15652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.153@tcp lock: ffff90bc02045800/0x83671231080c284b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x83671231080c2852 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338882.093869:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.153@tcp lock: ffff90bbffef5e00/0x83671231080c2699 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x83671231080c26a0 expref: -99 pid: 15781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338882.094210:0:15652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bc02045800 already unused, calling callback (ffffffffc1b2ec20) 00010000:00010000:1.0:1787338882.094210:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbffef5e00 already unused, calling callback (ffffffffc1b2ec20) 10000000:00010000:3.0:1787338882.094215:0:15652:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.153@tcp lock: ffff90bc02045800/0x83671231080c284b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x83671231080c2852 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787338882.094215:0:14369:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.153@tcp lock: ffff90bbffef5e00/0x83671231080c2699 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x83671231080c26a0 expref: -99 pid: 15781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338882.094226:0:15652:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.153@tcp lock: ffff90bc02045800/0x83671231080c284b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x83671231080c2852 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338882.094226:0:14369:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.153@tcp lock: ffff90bbffef5e00/0x83671231080c2699 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x83671231080c26a0 expref: -99 pid: 15781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787338882.094235:0:15652:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.153@tcp lock: ffff90bc02045800/0x83671231080c284b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x83671231080c2852 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787338882.094235:0:14369:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.153@tcp lock: ffff90bbffef5e00/0x83671231080c2699 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x83671231080c26a0 expref: -99 pid: 15781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787338882.094242:0:15652:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1787338882.094242:0:14369:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787338882.094245:0:15652:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1787338882.094245:0:14369:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:3.0:1787338882.094248:0:15652:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:1.0:1787338882.094248:0:14369:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:3.0:1787338882.094266:0:15652:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff90bbc842d800 00010000:00010000:1.0:1787338882.094266:0:14369:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff90bbc842d800 00010000:00010000:3.0:1787338882.094270:0:15652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.153@tcp lock: ffff90bc02045800/0x83671231080c284b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x83671231080c2852 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338882.094270:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.153@tcp lock: ffff90bbffef5e00/0x83671231080c2699 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x83671231080c26a0 expref: -99 pid: 15781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338882.094278:0:15652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.153@tcp lock: ffff90bc02045800/0x83671231080c284b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x83671231080c2852 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338882.094278:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.153@tcp lock: ffff90bbffef5e00/0x83671231080c2699 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x83671231080c26a0 expref: -99 pid: 15781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338882.094290:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338882.094292:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338882.094294:0:15652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338882.094294:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338882.094295:0:15652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338882.094303:0:15652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:0.0:1787338882.102632:0:17470:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1787338882.153695:0:17470:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x83671231080c26ae 00000020:00000080:2.0:1787338882.154827:0:17470:0:(genops.c:885:class_export_put()) final put ffff90bac1c31000/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1787338882.154864:0:17470:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90bac2048000 from lustre-OST0001, refs=2 00000020:00000080:0.0:1787338882.155043:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff90bac1c31000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000004:2.0:1787338882.155187:0:17470:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90bac2048000 2 00000020:01000004:2.0:1787338882.155192:0:17470:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff90bac2048000 from lustre-OST0001 00000020:00000080:2.0:1787338882.155608:0:17470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787338882.155620:0:17470:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1787338882.155624:0:17470:0:(genops.c:885:class_export_put()) final put ffff90bbd0622000/lustre-OST0001_UUID 00000020:00000080:2.0:1787338882.155626:0:17470:0:(genops.c:844:class_export_destroy()) destroying export ffff90bbd0622000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1787338882.155635:0:17470:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:3.0:1787338882.164337:0:17470:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 2c0e6575-df80-419a-8cc7-cbad06c93254->MGS 00010000:00010000:3.0:1787338882.164364:0:17470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.153@tcp lock: ffff90bbffef5000/0x83671231080c2557 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x83671231080c255e expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787338882.164380:0:17470:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.153@tcp lock: ffff90bbffef5000/0x83671231080c2557 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x83671231080c255e expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787338882.164386:0:17470:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1787338882.164389:0:17470:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1787338882.164392:0:17470:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1787338882.164406:0:17470:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff90bbc842d800 00010000:00010000:3.0:1787338882.164409:0:17470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.153@tcp lock: ffff90bbffef5000/0x83671231080c2557 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x83671231080c255e expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338882.164426:0:17470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.153@tcp lock: ffff90bbf3c52600/0x83671231080c243f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x83671231080c2446 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787338882.164432:0:17470:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.153@tcp lock: ffff90bbf3c52600/0x83671231080c243f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x83671231080c2446 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787338882.165157:0:17470:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787338882.165161:0:17470:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1787338882.165163:0:17470:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1787338882.165179:0:17470:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff90bbc842d800 00010000:00010000:3.0:1787338882.165184:0:17470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.153@tcp lock: ffff90bbf3c52600/0x83671231080c243f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x83671231080c2446 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787338882.165205:0:17470:0:(import.c:65:import_set_state_nolock()) ffff90bbc842d800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1787338882.165209:0:17470:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1787338882.165211:0:17470:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1787338882.165223:0:17470:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1787338882.165228:0:17470:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1787338882.165396:0:17470:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff90bbf7ed4380 x1874160212102272/t0(0) o250->MGC192.168.201.153@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1787338889 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1787338882.165463:0:17470:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1787338882.165467:0:17470:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00000100:00100000:0.0:1787338882.169156:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf7ed4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2c0e6575-df80-419a-8cc7-cbad06c93254:3313:1874160212102272:0@lo:250:ptlrpcd_00_03.0 10000000:01000000:2.0:1787338882.169265:0:17470:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1787338882.169279:0:17470:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x83671231080c242a 00000020:00000080:2.0:1787338882.169291:0:17470:0:(genops.c:885:class_export_put()) final put ffff90bac1f1a800/2c0e6575-df80-419a-8cc7-cbad06c93254 00000020:01000000:2.0:1787338882.169302:0:17470:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.201.153@tcp (flags='') 00000020:00000080:2.0:1787338882.169307:0:17470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787338882.169314:0:17470:0:(obd_config.c:956:class_cleanup()) MGC192.168.201.153@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787338882.169318:0:17470:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff90bbee0a99b8) has no exports 00000020:00000080:0.0:1787338882.169556:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff90bac1f1a800/2c0e6575-df80-419a-8cc7-cbad06c93254 for MGC192.168.201.153@tcp 10000000:01000000:0.0:1787338882.170049:0:14378:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1787338882.170141:0:17470:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.201.153@tcp: client import never connected 00000100:00080000:2.0:1787338882.170145:0:17470:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1787338882.170148:0:17470:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1787338882.170151:0:17470:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1787338882.170153:0:17470:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1787338882.170197:0:17470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787338882.170204:0:17470:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.201.153@tcp (uuid 2c0e6575-df80-419a-8cc7-cbad06c93254) 00000020:01000000:2.0:1787338882.170209:0:17470:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1787338882.170213:0:17470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787338882.170217:0:17470:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787338882.170223:0:17470:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff90bac2b53800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787338882.170228:0:17470:0:(genops.c:1553:class_disconnect_exports()) OBD device 17 (ffff90bbee59b370) has exports, disconnecting them 00000020:00080000:2.0:1787338882.170232:0:17470:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff90bac2b53800), last request at 1787338823 00000020:00000080:2.0:1787338882.170235:0:17470:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x83671231080c26d8 00000020:00080000:2.0:1787338882.170247:0:17470:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff90bac2b53800): rc 0 00000020:00000080:2.0:1787338882.170251:0:17470:0:(genops.c:885:class_export_put()) final put ffff90bac2b53800/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1787338882.171734:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90bbc842d800 for MGC192.168.201.153@tcp 00000020:00000080:0.0:1787338882.171749:0:8:0:(genops.c:885:class_export_put()) final put ffff90bbc842e000/2c0e6575-df80-419a-8cc7-cbad06c93254 00000020:00000080:0.0:1787338882.171752:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff90bbc842e000/2c0e6575-df80-419a-8cc7-cbad06c93254 for MGC192.168.201.153@tcp 00000020:01000000:0.0:1787338882.171758:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.201.153@tcp (2c0e6575-df80-419a-8cc7-cbad06c93254) 00000020:00000080:0.0:1787338882.172042:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff90bac2b53800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:3.0:1787338882.172186:0:17470:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:3.0:1787338882.172191:0:17470:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787338882.172195:0:17470:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1787338882.172201:0:17470:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1787338882.172313:0:14370:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00000020:00000080:0.0:1787338882.172365:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90bac2b55000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:1.0:1787338882.172732:0:14369:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1787338882.173491:0:15652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:0.0:1787338882.173777:0:14364:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff90bbf7ecc600:14364] 0 exiting: rc = 1 00000100:00100000:1.0:1787338882.175866:0:14365:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff90bbf7ecdc00:14365] 1 exiting: rc = 0 00000100:00100000:3.0:1787338882.176005:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338882.176288:0:16493:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff90bac222f600:16493] 3 exiting: rc = 0 00000100:00100000:1.0:1787338882.176394:0:14367:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff90bbf7ecd000:14367] 1 exiting: rc = 0 00000100:00100000:1.0:1787338882.176462:0:14368:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff90bbf7eccc00:14368] 2 exiting: rc = 0 00000100:00100000:1.0:1787338882.176593:0:14366:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff90bbf7ecd600:14366] 0 exiting: rc = 1 00000100:00100000:3.0:1787338882.176761:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787338882.176768:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787338882.176773:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787338882.176780:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787338882.176787:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787338882.176797:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787338882.176802:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787338882.176844:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787338882.176852:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787338882.176857:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787338882.176862:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787338882.176867:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787338882.177022:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787338882.177030:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787338882.177035:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787338882.177040:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787338882.177046:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787338882.177051:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787338882.177056:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787338882.177103:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787338882.177112:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787338882.177117:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787338882.177122:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787338882.177136:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787338882.177142:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787338882.177147:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787338882.177152:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787338882.177158:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787338882.177164:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787338882.177170:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787338882.177175:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787338882.177181:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787338882.177185:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787338882.177190:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787338882.177195:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787338882.177199:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787338882.177204:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787338882.177209:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787338882.177213:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787338882.177218:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787338882.177224:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787338882.177259:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787338882.177286:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787338882.177292:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787338882.177297:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787338882.177303:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787338882.177309:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787338882.177318:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787338882.177324:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787338882.177330:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787338882.177335:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787338882.177339:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787338882.177344:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787338882.177350:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787338882.177387:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787338882.177393:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787338882.177398:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787338882.177403:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787338882.177415:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787338882.177424:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787338882.177430:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787338882.177434:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787338882.177439:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787338882.177444:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1787338882.180852:0:17470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787338882.180864:0:17470:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1787338882.180870:0:17470:0:(genops.c:885:class_export_put()) final put ffff90bbef174800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1787338882.181225:0:17470:0:(genops.c:844:class_export_destroy()) destroying export ffff90bbef174800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1787338882.181235:0:17470:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:3.0:1787338882.181419:0:17470:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90bac2048000 1 00000020:00000080:3.0:1787338882.181425:0:17470:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x83671231080c2692 00000020:00000080:3.0:1787338882.181431:0:17470:0:(genops.c:885:class_export_put()) final put ffff90bac277a800/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1787338882.181499:0:17470:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1787338882.181505:0:17470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787338882.181511:0:17470:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787338882.181514:0:17470:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff90bbffd80000) has no exports 00000020:00000080:0.0:1787338882.183304:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff90bac277a800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1787338882.203480:0:17470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787338882.203492:0:17470:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1787338882.203497:0:17470:0:(genops.c:885:class_export_put()) final put ffff90bac204e800/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1787338882.203500:0:17470:0:(genops.c:844:class_export_destroy()) destroying export ffff90bac204e800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1787338882.203508:0:17470:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1787338882.203706:0:17470:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff90bac2049000 00000020:01000000:2.0:1787338882.203743:0:17470:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1787338882.203747:0:17470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787338882.203752:0:17470:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787338882.203756:0:17470:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff90bbef8a8000) has no exports 00000020:00000080:2.0:1787338882.203799:0:17470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787338882.203805:0:17470:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1787338882.203808:0:17470:0:(genops.c:885:class_export_put()) final put ffff90bbde7a2000/OSS_uuid 00000020:00000080:2.0:1787338882.203810:0:17470:0:(genops.c:844:class_export_destroy()) destroying export ffff90bbde7a2000/OSS_uuid for OSS 00000020:01000000:2.0:1787338882.203814:0:17470:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:3.0:1787338882.206071:0:15066:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff90bbf43dae00:15066] 2 exiting: rc = 0 00000100:00100000:3.0:1787338882.206172:0:15063:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff90bbc51ba200:15063] 0 exiting: rc = 1 00000100:00080000:1.0:1787338882.207640:0:14377:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1787338882.207792:0:15650:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff90bac1868e00:15650] 3 exiting: rc = 0 00000100:00100000:0.0:1787338882.207868:0:15065:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff90bbf43da400:15065] 1 exiting: rc = 0 00000100:00100000:2.0:1787338882.208404:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338882.208413:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338882.208418:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338882.208423:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338882.208428:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338882.208434:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338882.208440:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338882.208445:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338882.208450:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338882.208456:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338882.208461:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338882.208466:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338882.208471:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338882.208479:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338882.208485:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338882.208490:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338882.208495:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338882.208500:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338882.208505:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338882.208528:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338882.208533:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338882.208538:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338882.208543:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338882.208619:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338882.208627:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338882.208631:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338882.208637:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338882.208642:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338882.208647:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338882.208652:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338882.208657:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338882.208662:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338882.208666:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338882.208671:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338882.208677:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338882.208682:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338882.208686:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338882.208691:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338882.208696:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338882.208700:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338882.208705:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338882.208721:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338882.208728:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338882.208733:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338882.208738:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338882.208742:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338882.208747:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338882.208752:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338882.208757:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338882.208763:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338882.208767:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338882.208772:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338882.208777:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338882.208782:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338882.208794:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338882.208798:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338882.208803:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338882.208808:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338882.208813:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338882.208819:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338882.208824:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338882.208830:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338882.208835:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338882.208839:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338882.218722:0:15068:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff90bbc2d98400:15068] 1 exiting: rc = 0 00000100:00100000:2.0:1787338882.219264:0:15067:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff90bbcaac1c00:15067] 0 exiting: rc = 1 00000100:00100000:0.0:1787338882.219427:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338882.219434:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338882.219440:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338882.219445:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338882.219451:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338882.219458:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338882.219462:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338882.219467:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338882.219471:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338882.219478:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338882.219483:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338882.219488:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338882.219493:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338882.219498:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338882.219503:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338882.219508:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338882.219528:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338882.219533:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338882.219538:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338882.219543:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338882.219557:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338882.219564:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338882.219568:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338882.219573:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338882.219578:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338882.219583:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338882.219590:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338882.219596:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338882.219602:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338882.219607:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338882.219612:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338882.219617:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338882.219623:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338882.219631:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338882.219636:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338882.219642:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338882.219648:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338882.219654:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338882.219659:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338882.219664:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338882.219669:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338882.219674:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338882.219678:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338882.219683:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338882.219689:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338882.219693:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338882.219698:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338882.219703:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338882.219718:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338882.219725:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338882.219730:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338882.219742:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338882.219746:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338882.219752:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338882.219757:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338882.219762:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338882.219767:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338882.219771:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338882.219777:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338882.219782:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338882.219787:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338882.219793:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338882.219798:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787338882.219803:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787338882.221741:0:15069:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff90bbffefd000:15069] 0 exiting: rc = 1 00000100:00100000:0.0:1787338882.222372:0:15070:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff90bbffefc800:15070] 1 exiting: rc = 0 00000100:00100000:0.0:1787338882.222557:0:15071:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff90bbffefd200:15071] 2 exiting: rc = 0 00000100:00100000:1.0:1787338882.222730:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.222738:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.222744:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.222750:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.222755:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.222770:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.222780:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.222786:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.222792:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.222798:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.222803:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.222811:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.222817:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.222823:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.222829:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.222835:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.222842:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.222847:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.222853:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.222859:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.222865:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.222905:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.222934:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.222941:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.222947:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.222952:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.222957:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.222962:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.222967:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.222972:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.222977:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.222982:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.222998:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.223004:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.223010:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.223016:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.223021:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.223027:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.223032:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.223038:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.223043:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.223049:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.223055:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.223060:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.223066:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.223072:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.223094:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.223101:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.223106:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.223112:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.223118:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.223124:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.223129:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.223135:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.223141:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.223146:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.223151:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.223157:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.223162:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.223168:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.223174:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.223180:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.223185:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.223191:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.231982:0:15072:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff90bbde5d2600:15072] 0 exiting: rc = 1 00000100:00100000:3.0:1787338882.232796:0:15073:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff90bbffd48200:15073] 1 exiting: rc = 0 00000100:00100000:1.0:1787338882.233102:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.233111:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.233130:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.233136:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.233141:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.233146:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.233151:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.233157:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.233163:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.233176:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.233182:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.233188:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.233194:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.233200:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.233206:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.233210:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.233215:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.233219:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.233225:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.233230:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.233235:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.233239:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.233244:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.233248:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.233254:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.233264:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.233270:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.233407:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.233414:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.233420:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.233424:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.233429:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.233434:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.233439:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.233445:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.234798:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.234806:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.234850:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.234856:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.234861:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.234866:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.234894:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.234901:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.234906:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.234912:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.234917:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.234923:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.234928:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.234934:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.234938:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.234943:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.234947:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.234953:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.234958:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.234962:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.234967:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.234973:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.234978:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.234982:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.234987:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.234992:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.234997:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.235257:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.235263:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787338882.236369:0:15075:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff90bbffaa1800:15075] 1 exiting: rc = 0 00000100:00100000:2.0:1787338882.236487:0:15074:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff90bbde201200:15074] 0 exiting: rc = 1 00000100:00100000:1.0:1787338882.236530:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.236546:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.236616:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.236625:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.236631:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.236637:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.236665:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.236672:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.236687:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.236693:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.236701:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.236721:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.236728:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.236736:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.236741:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.236747:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.236753:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.236759:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.236781:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.236789:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.236796:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.236802:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.236807:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.236813:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.236819:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.236827:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.236834:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.236840:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.236847:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.236853:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.236960:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.236968:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.236974:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.236980:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.236986:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.236993:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.237064:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.237194:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.237202:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.237209:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.237215:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.237223:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.237243:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.237258:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.237265:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.237272:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.237277:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.237284:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.237290:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.237295:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.237300:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.237308:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.237314:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.237320:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.237341:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.237348:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.237354:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.237360:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.237366:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.237372:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.237377:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.237383:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.237391:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787338882.237397:0:17470:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1787338882.246754:0:17470:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1787338897.118684:0:18084:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg153-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1787338904.142302:0:18544:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787338904.142307:0:18544:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1787338904.142434:0:18544:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff90bbe83a5800 00000020:01000004:2.0:1787338904.142448:0:18544:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1787338904.142456:0:18544:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1787338904.142469:0:18544:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff90bbd17319b8) 00000020:00000080:2.0:1787338904.142481:0:18544:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787338904.157314:0:18544:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1787338904.159506:0:18544:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x36:0x0] (8/32) 00100000:10000000:3.0:1787338904.160078:0:18544:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1787338904.160145:0:18544:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 431: rc = 0 00100000:10000000:3.0:1787338904.160243:0:18544:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 431: rc = 0 00100000:10000000:3.0:1787338904.160399:0:18544:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 431: rc = 0 00100000:10000000:3.0:1787338904.160492:0:18544:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 431: rc = 0 00100000:10000000:3.0:1787338904.160590:0:18544:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 431: rc = 0 00100000:10000000:3.0:1787338904.160687:0:18544:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 431: rc = 0 00100000:10000000:3.0:1787338904.161382:0:18544:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 40: rc = 0 00100000:10000000:3.0:1787338904.162498:0:18544:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 577: rc = 0 00100000:10000000:3.0:1787338904.162599:0:18544:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 577: rc = 0 00100000:10000000:3.0:1787338904.163246:0:18544:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 191: rc = 0 00100000:10000000:3.0:1787338904.164642:0:18544:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 191: rc = 0 00100000:10000000:3.0:1787338904.165422:0:18544:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 191: rc = 0 00100000:10000000:3.0:1787338904.165653:0:18544:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 191: rc = 0 00100000:10000000:3.0:1787338904.166179:0:18544:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 191: rc = 0 00100000:10000000:3.0:1787338904.166425:0:18544:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 191: rc = 0 00100000:10000000:3.0:1787338904.166672:0:18544:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 191: rc = 0 00100000:10000000:3.0:1787338904.167288:0:18544:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 191: rc = 0 00100000:10000000:3.0:1787338904.167542:0:18544:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 191: rc = 0 00100000:10000000:3.0:1787338904.168093:0:18544:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 191: rc = 0 00100000:10000000:3.0:1787338904.168346:0:18544:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 191: rc = 0 00100000:10000000:3.0:1787338904.168601:0:18544:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 191: rc = 0 00100000:10000000:3.0:1787338904.169568:0:18544:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 207: rc = 0 00100000:10000000:3.0:1787338904.170126:0:18544:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 207: rc = 0 00100000:10000000:3.0:1787338904.170394:0:18544:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 207: rc = 0 00100000:10000000:3.0:1787338904.170629:0:18544:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 207: rc = 0 00100000:10000000:3.0:1787338904.171135:0:18544:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 207: rc = 0 00100000:10000000:3.0:1787338904.171385:0:18544:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 207: rc = 0 00100000:10000000:3.0:1787338904.171635:0:18544:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 207: rc = 0 00100000:10000000:2.0:1787338904.172527:0:18544:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 207: rc = 0 00100000:10000000:2.0:1787338904.173073:0:18544:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 207: rc = 0 00100000:10000000:2.0:1787338904.173311:0:18544:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 207: rc = 0 00100000:10000000:2.0:1787338904.173575:0:18544:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 207: rc = 0 00100000:10000000:2.0:1787338904.174111:0:18544:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 207: rc = 0 00100000:10000000:2.0:1787338904.174374:0:18544:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 207: rc = 0 00100000:10000000:2.0:1787338904.174624:0:18544:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 207: rc = 0 00100000:10000000:2.0:1787338904.175132:0:18544:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 207: rc = 0 00100000:10000000:2.0:1787338904.175391:0:18544:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 207: rc = 0 00100000:10000000:2.0:1787338904.175626:0:18544:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 207: rc = 0 00100000:10000000:2.0:1787338904.176093:0:18544:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 207: rc = 0 00100000:10000000:2.0:1787338904.176359:0:18544:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 207: rc = 0 00100000:10000000:2.0:1787338904.176611:0:18544:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 207: rc = 0 00100000:10000000:2.0:1787338904.177234:0:18544:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 207: rc = 0 00100000:10000000:2.0:1787338904.177505:0:18544:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 207: rc = 0 00100000:10000000:2.0:1787338904.177856:0:18544:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 207: rc = 0 00100000:10000000:2.0:1787338904.178255:0:18544:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 207: rc = 0 00100000:10000000:2.0:1787338904.178515:0:18544:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 207: rc = 0 00100000:10000000:2.0:1787338904.178801:0:18544:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 207: rc = 0 00100000:10000000:2.0:1787338904.179078:0:18544:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 207: rc = 0 00100000:10000000:2.0:1787338904.179303:0:18544:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 207: rc = 0 00100000:10000000:2.0:1787338904.179738:0:18544:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 207: rc = 0 00100000:10000000:2.0:1787338904.180122:0:18544:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 207: rc = 0 00100000:10000000:2.0:1787338904.180377:0:18544:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 207: rc = 0 00100000:10000000:2.0:1787338904.180608:0:18544:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 207: rc = 0 00100000:10000000:2.0:1787338904.181314:0:18544:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 583: rc = 0 00100000:10000000:2.0:1787338904.183600:0:18544:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1787338904.183860:0:18544:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 436: rc = 0 00100000:10000000:2.0:1787338904.184120:0:18544:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1787338904.184205:0:18544:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 436: rc = 0 00100000:10000000:2.0:1787338904.184396:0:18544:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1787338904.184463:0:18544:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 436: rc = 0 00100000:10000000:2.0:1787338904.185278:0:18544:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1787338904.185370:0:18544:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 578: rc = 0 00100000:10000000:2.0:1787338904.185562:0:18544:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1787338904.185631:0:18544:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 578: rc = 0 00100000:10000000:2.0:1787338904.186500:0:18544:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1787338904.186579:0:18544:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 578: rc = 0 00000020:00000080:2.0:1787338904.186850:0:18544:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1787338904.186859:0:18544:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787338904.186869:0:18544:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x83671231080c2e87 00000020:01000004:2.0:1787338904.187057:0:18544:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1787338904.187062:0:18544:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1787338904.187069:0:18544:0:(tgt_mount.c:101:server_register_mount()) register mount ffff90bbe83a5800 from MGS 00000020:01000004:2.0:1787338904.187073:0:18544:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1787338904.187084:0:18544:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff90bbd1733370) 00000020:00000080:2.0:1787338904.187095:0:18544:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1787338904.187154:0:18544:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90bbe83a5800 from MGS, refs=2 00080000:01000000:2.0:1787338904.187158:0:18544:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787338904.187163:0:18544:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x83671231080c2e95 00000100:00100000:2.0:1787338904.187255:0:18544:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1787338904.187402:0:18544:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1787338904.187408:0:18544:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1787338904.188273:0:18544:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1787338904.188281:0:18544:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1787338904.189190:0:18544:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787338904.189387:0:18544:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1787338904.189398:0:18544:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1787338904.192499:0:18544:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1787338904.192511:0:18544:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1787338904.192835:0:18544:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1787338904.192841:0:18544:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1787338904.193601:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787338904.193605:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787338904.193607:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338904.194045:0:18551:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338904.194048:0:18551:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338904.194049:0:18551:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338904.194519:0:18544:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1787338904.200996:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1787338904.206237:0:18544:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1787338904.206255:0:18544:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787338904.206259:0:18544:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1787338904.207660:0:18553:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1787338904.207804:0:18544:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1787338904.208156:0:18544:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787338904.208632:0:18544:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1787338904.209201:0:18544:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787338904.209388:0:18544:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1787338904.209394:0:18544:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1787338904.215520:0:18544:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1787338904.215533:0:18544:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1787338904.219048:0:18544:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1787338904.219061:0:18544:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1787338904.223209:0:18544:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1787338904.223228:0:18544:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.153@tcp' 00000020:01000004:0.0:1787338904.223230:0:18544:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1787338904.223259:0:18544:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.153@tcp (typ=mgc) 00000020:00000080:0.0:1787338904.223271:0:18544:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.153@tcp (ffff90bbde3eb370) 00000020:00000080:0.0:1787338904.223287:0:18544:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1787338904.223371:0:18544:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90bac1c34800@MGC192.168.201.153@tcp: add connection 192.168.201.153@tcp at head 00010000:00010000:0.0:1787338904.223485:0:18544:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.153@tcp-0 is initialized 00000040:01000000:0.0:1787338904.223489:0:18544:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.153@tcp ctxt 1 is initialized 00000100:00080000:3.0:1787338904.223714:0:18558:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1787338904.226526:0:18559:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1787338904.226760:0:18544:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.153@tcp (uuid 4530016f-1c37-4f4c-b7ee-21f57031a048) 00000020:00000080:1.0:1787338904.226787:0:18544:0:(genops.c:1385:class_connect()) connect: client 4530016f-1c37-4f4c-b7ee-21f57031a048, cookie 0x83671231080c2ea3 00000100:00080000:1.0:1787338904.226799:0:18544:0:(import.c:510:import_select_connection()) MGC192.168.201.153@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787338904.226805:0:18544:0:(import.c:624:import_select_connection()) MGC192.168.201.153@tcp: import ffff90bac1c34800 using connection 192.168.201.153@tcp/0@lo 00000100:00100000:1.0:1787338904.226840:0:18544:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90bbf7ed6680 x1874160212102528/t0(0) o250->MGC192.168.201.153@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787338904.227008:0:18544:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 4530016f-1c37-4f4c-b7ee-21f57031a048->MGS 00000020:01000004:1.0:1787338904.227067:0:18544:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1787338904.227072:0:18544:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1787338904.227086:0:18544:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff90bbee5999b8) 00000100:00100000:0.0:1787338904.227096:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf7ed6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:4530016f-1c37-4f4c-b7ee-21f57031a048:3313:1874160212102528:0@lo:250:mount.lustre.0 00000020:00000080:1.0:1787338904.227099:0:18544:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1787338904.227173:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338904.227420:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212102528 00000100:00100000:3.0:1787338904.227427:0:18554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212102528 00000100:00100000:3.0:1787338904.227457:0:18554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787338904.227462:0:18554:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf4118c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3313:x1874160212102528:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1787338904.227481:0:18554:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 4530016f-1c37-4f4c-b7ee-21f57031a048@0@lo t0 exp 0000000000000000 cur 557 last 0 00000020:00000080:3.0:1787338904.227498:0:18554:0:(genops.c:1385:class_connect()) connect: client 4530016f-1c37-4f4c-b7ee-21f57031a048, cookie 0x83671231080c2eb1 00000100:00080000:3.0:1787338904.227576:0:18554:0:(import.c:65:import_set_state_nolock()) ffff90bbf41a4000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787338904.227614:0:18554:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf4118c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4530016f-1c37-4f4c-b7ee-21f57031a048+5:3313:x1874160212102528:12345-0@lo:250:mount.lustre.0 Request processed in 151us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338904.227619:0:18554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787338904.227678:0:3313:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.201.153@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1787338904.227686:0:3313:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.153@tcp: connect to target with instance 0 00000100:00080000:0.0:1787338904.227813:0:3313:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.201.153@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1787338904.227817:0:3313:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1787338904.227819:0:3313:0:(import.c:65:import_set_state_nolock()) ffff90bac1c34800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1787338904.227821:0:3313:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1787338904.227828:0:3313:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1787338904.227832:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf7ed6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:4530016f-1c37-4f4c-b7ee-21f57031a048:3313:1874160212102528:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1787338904.234396:0:18544:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787338904.234694:0:18544:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1787338904.234701:0:18544:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1787338904.237718:0:18544:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1787338904.237736:0:18544:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1787338904.238208:0:18544:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1787338904.238216:0:18544:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1787338904.241391:0:18544:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787338904.241592:0:18544:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1787338904.241602:0:18544:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1787338904.246005:0:18544:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1787338904.246026:0:18544:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1787338904.277534:0:18544:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787338904.277741:0:18544:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1787338904.277747:0:18544:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1787338904.278706:0:18544:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1787338904.278713:0:18544:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1787338904.279458:0:18544:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787338904.279607:0:18544:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787338904.279612:0:18544:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1787338904.280025:0:18544:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787338904.280033:0:18544:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1787338904.280534:0:18544:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787338904.280679:0:18544:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787338904.280683:0:18544:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1787338904.281269:0:18544:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787338904.281276:0:18544:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1787338904.281776:0:18544:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787338904.283112:0:18544:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787338904.283120:0:18544:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1787338904.284416:0:18544:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787338904.284426:0:18544:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1787338904.304664:0:18544:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787338904.304869:0:18544:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1787338904.305014:0:18544:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1787338904.306035:0:18544:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1787338904.306042:0:18544:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1787338904.306687:0:18544:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1787338904.306694:0:18544:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1787338904.308192:0:18544:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1787338904.308215:0:18544:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1787338904.308219:0:18544:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.153@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1787338904.308357:0:18544:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.153@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787338904.308388:0:18544:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.153@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1787338904.308391:0:18544:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787338904.308392:0:18544:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787338904.308393:0:18544:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787338904.308394:0:18544:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787338904.308395:0:18544:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787338904.308396:0:18544:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787338904.308397:0:18544:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787338904.308398:0:18544:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787338904.308399:0:18544:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787338904.308400:0:18544:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787338904.308402:0:18544:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1787338904.308403:0:18544:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787338904.308404:0:18544:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787338904.308405:0:18544:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787338904.308405:0:18544:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787338904.308406:0:18544:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787338904.308406:0:18544:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787338904.308410:0:18544:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787338904.308410:0:18544:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787338904.308411:0:18544:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787338904.308411:0:18544:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787338904.308436:0:18544:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1787338904.308454:0:18544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee081500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4530016f-1c37-4f4c-b7ee-21f57031a048:18544:1874160212102656:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787338904.308518:0:18544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338904.308660:0:18544:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc1359c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787338904.308704:0:18557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212102656 00000100:00100000:3.0:1787338904.308711:0:18557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212102656 00000100:00100000:3.0:1787338904.308798:0:18557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787338904.308810:0:18557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf4119850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4530016f-1c37-4f4c-b7ee-21f57031a048+5:18544:x1874160212102656:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787338904.308860:0:18557:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787338904.308863:0:18557:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1787338904.308866:0:18557:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1787338904.309238:0:18578:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1787338904.309521:0:18557:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 8 20000000:01000000:0.0:1787338904.310425:0:18579:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1787338904.310429:0:18579:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1787338904.310431:0:18579:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1787338904.310451:0:18579:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:3.0:1787338904.310653:0:18557:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787338904.310661:0:18557:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1787338904.318045:0:18557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf4119850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4530016f-1c37-4f4c-b7ee-21f57031a048+5:18544:x1874160212102656:12345-0@lo:253:mount.lustre.0 Request processed in 9228us (9515us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338904.318058:0:18557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787338904.318200:0:18544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee081500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4530016f-1c37-4f4c-b7ee-21f57031a048:18544:1874160212102656:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787338904.318217:0:18544:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1787338904.318220:0:18544:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787338904.318222:0:18544:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787338904.318223:0:18544:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787338904.318224:0:18544:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787338904.318224:0:18544:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787338904.318225:0:18544:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787338904.318226:0:18544:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787338904.318227:0:18544:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787338904.318228:0:18544:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787338904.318229:0:18544:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787338904.318248:0:18544:0:(tgt_mount.c:101:server_register_mount()) register mount ffff90bbe83a5800 from lustre-MDT0000 10000000:01000000:0.0:1787338904.318273:0:18544:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1787338904.318276:0:18544:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1787338904.318280:0:18544:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff90bbde3eb370 10000000:01000000:0.0:1787338904.318284:0:18544:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787338904.318291:0:18544:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff90bbde3eb370 from 1 10000000:01000000:0.0:1787338904.318294:0:18544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787338904.318345:0:18544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbc0030600/0x83671231080c2eb8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338904.318373:0:18544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.153@tcp lock: ffff90bbc0030600/0x83671231080c2eb8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338904.318385:0:18544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.153@tcp lock: ffff90bbc0030600/0x83671231080c2eb8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338904.318407:0:18544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee081500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4530016f-1c37-4f4c-b7ee-21f57031a048:18544:1874160212102784:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787338904.318467:0:18544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338904.318538:0:18544:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc5551000 going to sleep for 11 seconds 00000100:00100000:1.0:1787338904.318640:0:18556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212102784 00000100:00100000:1.0:1787338904.318647:0:18556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212102784 00000100:00100000:1.0:1787338904.318731:0:18556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787338904.318741:0:18556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbff90d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4530016f-1c37-4f4c-b7ee-21f57031a048+5:18544:x1874160212102784:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787338904.318753:0:18556:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787338904.318766:0:18556:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90bbfbe9c000/0x83671231080c2ebf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x83671231080c2eb8 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338904.318788:0:18556:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bbfbe9c000/0x83671231080c2ebf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x83671231080c2eb8 expref: 6 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338904.318798:0:18556:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90bbfbe9c000/0x83671231080c2ebf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c2eb8 expref: 6 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338904.318807:0:18556:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbfbe9c000, rc 0) 00000100:00100000:1.0:1787338904.318850:0:18556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbff90d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4530016f-1c37-4f4c-b7ee-21f57031a048+6:18544:x1874160212102784:12345-0@lo:101:mount.lustre.0 Request processed in 111us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338904.318862:0:18556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787338904.319026:0:18544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee081500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4530016f-1c37-4f4c-b7ee-21f57031a048:18544:1874160212102784:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787338904.319037:0:18544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.153@tcp lock: ffff90bbc0030600/0x83671231080c2eb8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c2ebf expref: -99 pid: 18544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338904.319043:0:18544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.153@tcp lock: ffff90bbc0030600/0x83671231080c2eb8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x83671231080c2ebf expref: -99 pid: 18544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338904.319077:0:18544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee081500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4530016f-1c37-4f4c-b7ee-21f57031a048:18544:1874160212102912:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787338904.319097:0:18544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338904.319336:0:18544:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc5551000 going to sleep for 11 seconds 00000100:00100000:3.0:1787338904.319403:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212102912 00000100:00100000:3.0:1787338904.319407:0:18554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212102912 00000100:00100000:3.0:1787338904.319424:0:18554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787338904.319428:0:18554:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbff90c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4530016f-1c37-4f4c-b7ee-21f57031a048+6:18544:x1874160212102912:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787338904.319632:0:18554:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbff90c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4530016f-1c37-4f4c-b7ee-21f57031a048+6:18544:x1874160212102912:12345-0@lo:501:mount.lustre.0 Request processed in 202us (533us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787338904.319637:0:18554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787338904.319724:0:18544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee081500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4530016f-1c37-4f4c-b7ee-21f57031a048:18544:1874160212102912:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1787338904.319750:0:18544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.153@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787338904.319762:0:18544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbc0030600/0x83671231080c2eb8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c2ebf expref: -99 pid: 18544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338904.319771:0:18544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.153@tcp lock: ffff90bbc0030600/0x83671231080c2eb8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c2ebf expref: -99 pid: 18544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787338904.319790:0:18544:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff90bbe83a5800 10000000:01000000:0.0:1787338904.319806:0:18544:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787338904.319812:0:18544:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff90bbe83a5800 10000000:01000000:0.0:1787338904.319814:0:18544:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1787338904.319816:0:18544:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff90bbe83a5800 from 1 10000000:01000000:0.0:1787338904.319818:0:18544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1787338904.319834:0:18544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbc0031200/0x83671231080c2ec6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338904.319840:0:18544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.153@tcp lock: ffff90bbc0031200/0x83671231080c2ec6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338904.319845:0:18544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.153@tcp lock: ffff90bbc0031200/0x83671231080c2ec6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338904.319854:0:18544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee081500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4530016f-1c37-4f4c-b7ee-21f57031a048:18544:1874160212103040:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787338904.319960:0:18544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338904.319976:0:18544:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc5551000 going to sleep for 11 seconds 00000100:00100000:3.0:1787338904.320030:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212103040 00000100:00100000:3.0:1787338904.320033:0:18554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212103040 00000100:00100000:3.0:1787338904.320047:0:18554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787338904.320051:0:18554:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbff90e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4530016f-1c37-4f4c-b7ee-21f57031a048+6:18544:x1874160212103040:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787338904.320057:0:18554:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787338904.320065:0:18554:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90bbffef5200/0x83671231080c2ecd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x83671231080c2ec6 expref: -99 pid: 18554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338904.320076:0:18554:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bbffef5200/0x83671231080c2ecd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x83671231080c2ec6 expref: 7 pid: 18554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338904.320082:0:18554:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90bbffef5200/0x83671231080c2ecd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c2ec6 expref: 7 pid: 18554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338904.320087:0:18554:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbffef5200, rc 0) 00000100:00100000:3.0:1787338904.320114:0:18554:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbff90e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4530016f-1c37-4f4c-b7ee-21f57031a048+7:18544:x1874160212103040:12345-0@lo:101:mount.lustre.0 Request processed in 62us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338904.320125:0:18554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787338904.320190:0:18544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee081500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4530016f-1c37-4f4c-b7ee-21f57031a048:18544:1874160212103040:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787338904.320201:0:18544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.153@tcp lock: ffff90bbc0031200/0x83671231080c2ec6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c2ecd expref: -99 pid: 18544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338904.320208:0:18544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.153@tcp lock: ffff90bbc0031200/0x83671231080c2ec6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x83671231080c2ecd expref: -99 pid: 18544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787338904.320218:0:18544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.153@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1787338904.320224:0:18544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbc0031200/0x83671231080c2ec6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c2ecd expref: -99 pid: 18544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338904.320233:0:18544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.153@tcp lock: ffff90bbc0031200/0x83671231080c2ec6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c2ecd expref: -99 pid: 18544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787338904.320237:0:18544:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1787338904.320246:0:18544:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787338904.320249:0:18544:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff90bbe83a5800 10000000:01000000:0.0:1787338904.320251:0:18544:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1787338904.320253:0:18544:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1787338904.320254:0:18544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787338904.320264:0:18544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbc0031400/0x83671231080c2ed4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338904.320269:0:18544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.153@tcp lock: ffff90bbc0031400/0x83671231080c2ed4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338904.320274:0:18544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.153@tcp lock: ffff90bbc0031400/0x83671231080c2ed4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338904.320281:0:18544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee081500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4530016f-1c37-4f4c-b7ee-21f57031a048:18544:1874160212103168:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787338904.320303:0:18544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338904.320334:0:18544:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc5551000 going to sleep for 11 seconds 00000100:00100000:3.0:1787338904.320378:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212103168 00000100:00100000:3.0:1787338904.320381:0:18554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212103168 00000100:00100000:3.0:1787338904.320394:0:18554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787338904.320397:0:18554:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbff90c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4530016f-1c37-4f4c-b7ee-21f57031a048+7:18544:x1874160212103168:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787338904.320402:0:18554:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787338904.320407:0:18554:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90bbffef5000/0x83671231080c2edb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x83671231080c2ed4 expref: -99 pid: 18554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338904.320416:0:18554:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bbffef5000/0x83671231080c2edb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x83671231080c2ed4 expref: 8 pid: 18554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338904.320421:0:18554:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90bbffef5000/0x83671231080c2edb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c2ed4 expref: 8 pid: 18554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338904.320425:0:18554:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbffef5000, rc 0) 00000100:00100000:3.0:1787338904.320451:0:18554:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbff90c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4530016f-1c37-4f4c-b7ee-21f57031a048+8:18544:x1874160212103168:12345-0@lo:101:mount.lustre.0 Request processed in 53us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338904.320455:0:18554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787338904.320541:0:18544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee081500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4530016f-1c37-4f4c-b7ee-21f57031a048:18544:1874160212103168:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787338904.320559:0:18544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.153@tcp lock: ffff90bbc0031400/0x83671231080c2ed4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c2edb expref: -99 pid: 18544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338904.320566:0:18544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.153@tcp lock: ffff90bbc0031400/0x83671231080c2ed4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x83671231080c2edb expref: -99 pid: 18544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338904.320615:0:18544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee081500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4530016f-1c37-4f4c-b7ee-21f57031a048:18544:1874160212103296:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787338904.320634:0:18544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338904.320650:0:18544:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc5551000 going to sleep for 11 seconds 00000100:00100000:3.0:1787338904.320685:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212103296 00000100:00100000:3.0:1787338904.320689:0:18554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212103296 00000100:00100000:3.0:1787338904.320716:0:18554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787338904.320723:0:18554:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbff90fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4530016f-1c37-4f4c-b7ee-21f57031a048+8:18544:x1874160212103296:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787338904.321099:0:18554:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbff90fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4530016f-1c37-4f4c-b7ee-21f57031a048+9:18544:x1874160212103296:12345-0@lo:501:mount.lustre.0 Request processed in 377us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338904.321104:0:18554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787338904.321251:0:18544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee081500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4530016f-1c37-4f4c-b7ee-21f57031a048:18544:1874160212103296:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787338904.321273:0:18544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee081500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4530016f-1c37-4f4c-b7ee-21f57031a048:18544:1874160212103424:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787338904.321307:0:18544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338904.321347:0:18544:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc5551000 going to sleep for 11 seconds 00000100:00100000:1.0:1787338904.321386:0:18556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212103424 00000100:00100000:1.0:1787338904.321390:0:18556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212103424 00000100:00100000:1.0:1787338904.321415:0:18556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787338904.321420:0:18556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbff90f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4530016f-1c37-4f4c-b7ee-21f57031a048+9:18544:x1874160212103424:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787338904.321707:0:18556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbff90f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4530016f-1c37-4f4c-b7ee-21f57031a048+9:18544:x1874160212103424:12345-0@lo:503:mount.lustre.0 Request processed in 285us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338904.321714:0:18556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787338904.321819:0:18544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee081500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4530016f-1c37-4f4c-b7ee-21f57031a048:18544:1874160212103424:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787338904.322296:0:18580:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee081500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4530016f-1c37-4f4c-b7ee-21f57031a048:18580:1874160212103552:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787338904.322348:0:18580:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338904.322377:0:18580:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc55513c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787338904.322411:0:18556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212103552 00000100:00100000:1.0:1787338904.322415:0:18556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212103552 00000100:00100000:1.0:1787338904.322440:0:18556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787338904.322445:0:18556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbff90c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4530016f-1c37-4f4c-b7ee-21f57031a048+9:18580:x1874160212103552:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787338904.322712:0:18556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbff90c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4530016f-1c37-4f4c-b7ee-21f57031a048+9:18580:x1874160212103552:12345-0@lo:502:llog_process_th.0 Request processed in 265us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338904.322720:0:18556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787338904.322794:0:18580:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee081500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4530016f-1c37-4f4c-b7ee-21f57031a048:18580:1874160212103552:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787338904.322813:0:18580:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787338904.322822:0:18580:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787338904.322824:0:18580:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787338904.322828:0:18580:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1787338904.322830:0:18580:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787338904.322840:0:18580:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff90bbde3ecd28) 00000020:00000080:0.0:1787338904.322852:0:18580:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1787338904.322856:0:18580:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1787338904.322974:0:18580:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:0.0:1787338904.322980:0:18580:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x83671231080c2ee9 00000020:00000080:0.0:1787338904.323127:0:18580:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1787338904.323131:0:18580:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787338904.323133:0:18580:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787338904.323139:0:18580:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787338904.323142:0:18580:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787338904.323146:0:18580:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787338904.323147:0:18580:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1787338904.323150:0:18580:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787338904.323157:0:18580:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff90bbde3e99b8) 00000020:00000080:0.0:1787338904.323167:0:18580:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1787338904.323171:0:18580:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1787338904.323173:0:18580:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1787338904.323176:0:18580:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1787338904.323182:0:18580:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787338904.323222:0:18580:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90bbe83a5800 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1787338904.323232:0:18580:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff90bbde3e8000) 00000020:00000080:0.0:1787338904.323237:0:18580:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1787338904.323275:0:18580:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1787338904.323279:0:18580:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x83671231080c2efe 00000020:00000080:0.0:1787338904.323375:0:18580:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1787338904.323379:0:18580:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1787338904.323382:0:18580:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x83671231080c2f05 00080000:01000000:0.0:1787338904.323385:0:18580:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:0.0:1787338904.323388:0:18580:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x83671231080c2f0c 00010000:00010000:2.0:1787338904.384676:0:18580:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1787338904.385269:0:18580:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934679 00000001:00080000:2.0:1787338904.385471:0:18580:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1787338904.386445:0:18580:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff90bbef8acd28) 00000020:00000080:3.0:1787338904.386473:0:18580:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1787338904.389243:0:18580:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:3.0:1787338904.389261:0:18580:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x83671231080c2f1a 00000020:00000080:1.0:1787338904.395353:0:18580:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1787338904.399064:0:18580:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x83671231080c2f21 00000020:00000080:2.0:1787338904.409472:0:18580:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1787338904.409486:0:18580:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787338904.409494:0:18580:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787338904.409496:0:18580:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1787338904.409501:0:18580:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787338904.409508:0:18580:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787338904.409509:0:18580:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1787338904.409514:0:18580:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1787338904.409560:0:18580:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1787338904.409582:0:18580:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787338904.409586:0:18580:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787338904.409587:0:18580:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1787338904.409590:0:18580:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787338904.409591:0:18580:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #10 00000020:01000000:2.0:1787338904.409593:0:18580:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787338904.409595:0:18580:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787338904.409596:0:18580:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787338904.409599:0:18580:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787338904.409613:0:18580:0:(obd_config.c:1563:class_process_config()) marker 10 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787338904.409617:0:18580:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787338904.409620:0:18580:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1787338904.409623:0:18580:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787338904.409625:0:18580:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1787338904.409627:0:18580:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787338904.409633:0:18580:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.153@tcp to nid 0x20000c0a8c999 (192.168.201.153@tcp) 00000020:01000000:2.0:1787338904.409659:0:18580:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787338904.409662:0:18580:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787338904.409677:0:18580:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff90bbd1734d28) 00000020:00000080:2.0:1787338904.409695:0:18580:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1787338904.409700:0:18580:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787338904.409761:0:18580:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1787338904.409767:0:18580:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:2.0:1787338904.409774:0:18580:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x83671231080c2f2f 00010000:00080000:2.0:1787338904.409803:0:18580:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90bbd888e800@lustre-OST0000-osc-MDT0000: add connection 192.168.201.153@tcp at head 00010000:00010000:2.0:1787338904.410300:0:18580:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:2.0:1787338904.410731:0:18580:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1787338904.410778:0:18580:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1787338904.412444:0:18580:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787338904.412516:0:18580:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:2.0:1787338904.412584:0:18580:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000040:00080000:1.0:1787338904.413243:0:18584:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1787338904.413249:0:18584:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1787338904.413855:0:18580:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787338904.413867:0:18580:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787338904.415806:0:18580:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1787338904.415834:0:18580:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x83671231080c2f36 00000100:00080000:3.0:1787338904.415846:0:18580:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787338904.415853:0:18580:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff90bbd888e800 using connection 192.168.201.153@tcp/0@lo 00000100:00100000:3.0:1787338904.416134:0:18580:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90bbedcb4380 x1874160212103680/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787338904.416287:0:18580:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1787338904.416410:0:18580:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787338904.416416:0:18580:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787338904.416418:0:18580:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1787338904.416421:0:18580:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787338904.416424:0:18580:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:3.0:1787338904.416425:0:18580:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787338904.416426:0:18580:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787338904.416428:0:18580:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787338904.416430:0:18580:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787338904.416431:0:18580:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787338904.416433:0:18580:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787338904.416437:0:18580:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1787338904.416440:0:18580:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787338904.416442:0:18580:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1787338904.416445:0:18580:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787338904.416448:0:18580:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.153@tcp to nid 0x20000c0a8c999 (192.168.201.153@tcp) 00000020:01000000:3.0:1787338904.416472:0:18580:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787338904.416474:0:18580:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787338904.416489:0:18580:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff90bbef8a99b8) 00000020:00000080:3.0:1787338904.416505:0:18580:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1787338904.416509:0:18580:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787338904.416572:0:18580:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1787338904.416584:0:18580:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:3.0:1787338904.416591:0:18580:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x83671231080c2f44 00010000:00080000:3.0:1787338904.416621:0:18580:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90bbc2e83000@lustre-OST0001-osc-MDT0000: add connection 192.168.201.153@tcp at head 00000100:00100000:0.0:1787338904.417311:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbedcb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1874160212103680:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1787338904.417381:0:3313:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874160212103680 offset 0 length 520: 4 00010000:00010000:3.0:1787338904.417593:0:18580:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:3.0:1787338904.417785:0:18580:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1787338904.417809:0:18580:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1787338904.418664:0:18580:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787338904.418727:0:18580:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:3.0:1787338904.418796:0:18580:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000040:00080000:3.0:1787338904.419625:0:18586:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1787338904.419630:0:18586:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1787338904.420514:0:18580:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787338904.420527:0:18580:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787338904.420560:0:18580:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1787338904.420579:0:18580:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x83671231080c2f4b 00000100:00080000:1.0:1787338904.420589:0:18580:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787338904.420594:0:18580:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff90bbc2e83000 using connection 192.168.201.153@tcp/0@lo 00000100:00100000:1.0:1787338904.420627:0:18580:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90bbf7ed4e00 x1874160212103808/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787338904.420663:0:18580:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:0.0:1787338904.420747:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf7ed4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1874160212103808:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1787338904.420799:0:3313:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874160212103808 offset 0 length 520: 4 00000020:01000000:1.0:1787338904.420944:0:18580:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787338904.420949:0:18580:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787338904.420951:0:18580:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1787338904.420954:0:18580:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787338904.420958:0:18580:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787338904.420960:0:18580:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787338904.420963:0:18580:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787338904.420965:0:18580:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787338904.420967:0:18580:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787338904.420969:0:18580:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787338904.420971:0:18580:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787338904.420973:0:18580:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787338904.420975:0:18580:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787338904.420976:0:18580:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787338904.420979:0:18580:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787338904.421008:0:18580:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf7ed6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4530016f-1c37-4f4c-b7ee-21f57031a048:18580:1874160212103936:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787338904.421063:0:18580:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338904.421092:0:18580:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbd8e9ae40 going to sleep for 11 seconds 00000100:00100000:0.0:1787338904.421269:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212103936 00000100:00100000:0.0:1787338904.421276:0:18554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212103936 00000100:00100000:0.0:1787338904.421329:0:18554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787338904.421338:0:18554:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbff90f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4530016f-1c37-4f4c-b7ee-21f57031a048+9:18580:x1874160212103936:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787338904.421565:0:18554:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbff90f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4530016f-1c37-4f4c-b7ee-21f57031a048+9:18580:x1874160212103936:12345-0@lo:502:llog_process_th.0 Request processed in 227us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338904.421578:0:18554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787338904.421631:0:18580:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf7ed6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4530016f-1c37-4f4c-b7ee-21f57031a048:18580:1874160212103936:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787338904.421658:0:18580:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787338904.421663:0:18580:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787338904.421664:0:18580:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787338904.421671:0:18580:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1787338904.421860:0:18544:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:1.0:1787338904.422592:0:18544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.153@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787338904.422614:0:18544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbc0031400/0x83671231080c2ed4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c2edb expref: -99 pid: 18544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338904.422626:0:18544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.153@tcp lock: ffff90bbc0031400/0x83671231080c2ed4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c2edb expref: -99 pid: 18544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787338904.422635:0:18544:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90bbe83a5800 from 1 10000000:01000000:1.0:1787338904.422637:0:18544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787338904.422671:0:18544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9c400/0x83671231080c2f52 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338904.422687:0:18544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9c400/0x83671231080c2f52 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338904.422698:0:18544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9c400/0x83671231080c2f52 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338904.422717:0:18544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf7ed5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4530016f-1c37-4f4c-b7ee-21f57031a048:18544:1874160212104064:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787338904.422763:0:18544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338904.422802:0:18544:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbd0cd7480 going to sleep for 11 seconds 00000100:00100000:3.0:1787338904.422925:0:18557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212104064 00000100:00100000:3.0:1787338904.422931:0:18557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212104064 00000100:00100000:3.0:1787338904.422967:0:18557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787338904.422977:0:18557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbff90f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4530016f-1c37-4f4c-b7ee-21f57031a048+9:18544:x1874160212104064:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787338904.422988:0:18557:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787338904.423002:0:18557:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90bbffef5800/0x83671231080c2f59 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x83671231080c2f52 expref: -99 pid: 18557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338904.423022:0:18557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bbffef5800/0x83671231080c2f59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x83671231080c2f52 expref: 10 pid: 18557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338904.423031:0:18557:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90bbffef5800/0x83671231080c2f59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c2f52 expref: 10 pid: 18557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338904.423039:0:18557:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbffef5800, rc 0) 00000100:00100000:3.0:1787338904.423077:0:18557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbff90f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4530016f-1c37-4f4c-b7ee-21f57031a048+10:18544:x1874160212104064:12345-0@lo:101:mount.lustre.0 Request processed in 102us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338904.423083:0:18557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787338904.423428:0:18544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf7ed5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4530016f-1c37-4f4c-b7ee-21f57031a048:18544:1874160212104064:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787338904.423443:0:18544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9c400/0x83671231080c2f52 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c2f59 expref: -99 pid: 18544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338904.423452:0:18544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9c400/0x83671231080c2f52 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x83671231080c2f59 expref: -99 pid: 18544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338904.424496:0:18544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee081500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4530016f-1c37-4f4c-b7ee-21f57031a048:18544:1874160212104192:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1787338904.424547:0:18544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338904.424612:0:18544:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc5551240 going to sleep for 11 seconds 00000100:00100000:1.0:1787338904.424652:0:18556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212104192 00000100:00100000:1.0:1787338904.424658:0:18556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212104192 00000100:00100000:1.0:1787338904.424733:0:18556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787338904.424742:0:18556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbff90ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4530016f-1c37-4f4c-b7ee-21f57031a048+10:18544:x1874160212104192:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1787338904.424759:0:18556:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1787338904.424764:0:18556:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1787338904.424842:0:18556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbff90ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4530016f-1c37-4f4c-b7ee-21f57031a048+10:18544:x1874160212104192:12345-0@lo:256:mount.lustre.0 Request processed in 101us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338904.424849:0:18556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787338904.425049:0:18544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee081500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4530016f-1c37-4f4c-b7ee-21f57031a048:18544:1874160212104192:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1787338904.425798:0:18544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.153@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787338904.425827:0:18544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9c400/0x83671231080c2f52 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c2f59 expref: -99 pid: 18544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338904.425839:0:18544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9c400/0x83671231080c2f52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c2f59 expref: -99 pid: 18544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787338904.425848:0:18544:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90bbe83a5800 from 1 10000000:01000000:0.0:1787338904.425851:0:18544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787338904.426069:0:18544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbc0030400/0x83671231080c2f60 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338904.426078:0:18544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.153@tcp lock: ffff90bbc0030400/0x83671231080c2f60 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338904.426087:0:18544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.153@tcp lock: ffff90bbc0030400/0x83671231080c2f60 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338904.426118:0:18544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee081500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4530016f-1c37-4f4c-b7ee-21f57031a048:18544:1874160212104320:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787338904.426237:0:18544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338904.426555:0:18544:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc5551240 going to sleep for 11 seconds 00000100:00100000:3.0:1787338904.426626:0:18557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212104320 00000100:00100000:3.0:1787338904.426641:0:18557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212104320 00000100:00100000:3.0:1787338904.426675:0:18557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787338904.426684:0:18557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbff90d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4530016f-1c37-4f4c-b7ee-21f57031a048+10:18544:x1874160212104320:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787338904.426696:0:18557:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787338904.426710:0:18557:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90bbffef5a00/0x83671231080c2f67 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x83671231080c2f60 expref: -99 pid: 18557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338904.426731:0:18557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bbffef5a00/0x83671231080c2f67 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x83671231080c2f60 expref: 11 pid: 18557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338904.426740:0:18557:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90bbffef5a00/0x83671231080c2f67 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c2f60 expref: 11 pid: 18557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338904.426748:0:18557:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbffef5a00, rc 0) 00000100:00100000:3.0:1787338904.426791:0:18557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbff90d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4530016f-1c37-4f4c-b7ee-21f57031a048+11:18544:x1874160212104320:12345-0@lo:101:mount.lustre.0 Request processed in 108us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338904.426798:0:18557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787338904.427047:0:18544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee081500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4530016f-1c37-4f4c-b7ee-21f57031a048:18544:1874160212104320:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787338904.427058:0:18544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.153@tcp lock: ffff90bbc0030400/0x83671231080c2f60 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c2f67 expref: -99 pid: 18544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338904.427065:0:18544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.153@tcp lock: ffff90bbc0030400/0x83671231080c2f60 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x83671231080c2f67 expref: -99 pid: 18544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338904.427107:0:18544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee081500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4530016f-1c37-4f4c-b7ee-21f57031a048:18544:1874160212104448:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787338904.427127:0:18544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338904.427147:0:18544:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc5551240 going to sleep for 11 seconds 00000100:00100000:3.0:1787338904.427306:0:18557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212104448 00000100:00100000:3.0:1787338904.427310:0:18557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212104448 00000100:00100000:3.0:1787338904.427335:0:18557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787338904.427342:0:18557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbff90e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4530016f-1c37-4f4c-b7ee-21f57031a048+11:18544:x1874160212104448:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787338904.427690:0:18557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbff90e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4530016f-1c37-4f4c-b7ee-21f57031a048+11:18544:x1874160212104448:12345-0@lo:501:mount.lustre.0 Request processed in 348us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338904.427698:0:18557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787338904.427768:0:18544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee081500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4530016f-1c37-4f4c-b7ee-21f57031a048:18544:1874160212104448:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787338904.427799:0:18544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee081500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4530016f-1c37-4f4c-b7ee-21f57031a048:18544:1874160212104576:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787338904.427838:0:18544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338904.427965:0:18544:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc5551240 going to sleep for 11 seconds 00000100:00100000:1.0:1787338904.428047:0:18556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212104576 00000100:00100000:1.0:1787338904.428050:0:18556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212104576 00000100:00100000:1.0:1787338904.428104:0:18556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787338904.428110:0:18556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbff90d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4530016f-1c37-4f4c-b7ee-21f57031a048+11:18544:x1874160212104576:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787338904.428277:0:18556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbff90d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4530016f-1c37-4f4c-b7ee-21f57031a048+11:18544:x1874160212104576:12345-0@lo:503:mount.lustre.0 Request processed in 167us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338904.428282:0:18556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787338904.428338:0:18544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee081500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4530016f-1c37-4f4c-b7ee-21f57031a048:18544:1874160212104576:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787338904.428487:0:18588:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee081500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4530016f-1c37-4f4c-b7ee-21f57031a048:18588:1874160212104704:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787338904.428514:0:18588:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338904.428675:0:18588:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc5551300 going to sleep for 11 seconds 00000100:00100000:2.0:1787338904.428703:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212104704 00000100:00100000:2.0:1787338904.428708:0:18554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212104704 00000100:00100000:3.0:1787338904.428819:0:18554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787338904.428828:0:18554:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbff90dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4530016f-1c37-4f4c-b7ee-21f57031a048+11:18588:x1874160212104704:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787338904.429522:0:18554:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbff90dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4530016f-1c37-4f4c-b7ee-21f57031a048+11:18588:x1874160212104704:12345-0@lo:502:llog_process_th.0 Request processed in 693us (1005us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338904.429540:0:18554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787338904.429613:0:18588:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee081500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4530016f-1c37-4f4c-b7ee-21f57031a048:18588:1874160212104704:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787338904.429639:0:18588:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787338904.429652:0:18588:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787338904.429655:0:18588:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787338904.429663:0:18588:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90bbe83a5800 00000020:00000080:0.0:1787338904.429666:0:18588:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787338904.429673:0:18588:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787338904.429676:0:18588:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787338904.429677:0:18588:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1787338904.429679:0:18588:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787338904.429682:0:18588:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787338904.429683:0:18588:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787338904.429687:0:18588:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90bbe83a5800 00000020:00000080:0.0:1787338904.429689:0:18588:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787338904.429739:0:18588:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787338904.429743:0:18588:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787338904.429744:0:18588:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1787338904.429746:0:18588:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787338904.429749:0:18588:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787338904.429750:0:18588:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787338904.429753:0:18588:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90bbe83a5800 00000020:00000080:0.0:1787338904.429755:0:18588:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787338904.429790:0:18588:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee081500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4530016f-1c37-4f4c-b7ee-21f57031a048:18588:1874160212104832:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787338904.429827:0:18588:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338904.430394:0:18588:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc5551300 going to sleep for 11 seconds 00000100:00100000:1.0:1787338904.430432:0:18556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212104832 00000100:00100000:1.0:1787338904.430438:0:18556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212104832 00000100:00100000:0.0:1787338904.435313:0:18556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787338904.435338:0:18556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbef28b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4530016f-1c37-4f4c-b7ee-21f57031a048+11:18588:x1874160212104832:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787338904.435573:0:18556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbef28b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4530016f-1c37-4f4c-b7ee-21f57031a048+11:18588:x1874160212104832:12345-0@lo:502:llog_process_th.0 Request processed in 249us (5745us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338904.435581:0:18556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787338904.435643:0:18588:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee081500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4530016f-1c37-4f4c-b7ee-21f57031a048:18588:1874160212104832:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787338904.435674:0:18588:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787338904.435684:0:18588:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787338904.435686:0:18588:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1787338904.435691:0:18588:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1787338904.435744:0:18544:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1787338904.435761:0:18544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787338904.436516:0:18544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbc0030400/0x83671231080c2f60 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c2f67 expref: -99 pid: 18544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338904.436531:0:18544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.153@tcp lock: ffff90bbc0030400/0x83671231080c2f60 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c2f67 expref: -99 pid: 18544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787338904.436576:0:18544:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787338904.436579:0:18544:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff90bbe83a5800 10000000:01000000:0.0:1787338904.436582:0:18544:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff90bbe83a5800 10000000:01000000:0.0:1787338904.436586:0:18544:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787338904.436591:0:18544:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90bbe83a5800 from 1 10000000:01000000:0.0:1787338904.436593:0:18544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787338904.436622:0:18544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbc0031c00/0x83671231080c2f6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338904.436631:0:18544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.153@tcp lock: ffff90bbc0031c00/0x83671231080c2f6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338904.436640:0:18544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.153@tcp lock: ffff90bbc0031c00/0x83671231080c2f6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338904.436660:0:18544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee081500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4530016f-1c37-4f4c-b7ee-21f57031a048:18544:1874160212104960:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787338904.436707:0:18544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338904.436739:0:18544:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc5551300 going to sleep for 11 seconds 00000100:00100000:0.0:1787338904.436759:0:18556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212104960 00000100:00100000:0.0:1787338904.436765:0:18556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212104960 00000100:00100000:0.0:1787338904.436799:0:18556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787338904.436806:0:18556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbef28a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4530016f-1c37-4f4c-b7ee-21f57031a048+11:18544:x1874160212104960:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787338904.436816:0:18556:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787338904.436829:0:18556:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90bbc0031000/0x83671231080c2f75 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x83671231080c2f6e expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338904.436850:0:18556:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bbc0031000/0x83671231080c2f75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x83671231080c2f6e expref: 12 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338904.436860:0:18556:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90bbc0031000/0x83671231080c2f75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c2f6e expref: 12 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338904.436900:0:18556:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbc0031000, rc 0) 00000100:00100000:0.0:1787338904.436933:0:18556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbef28a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4530016f-1c37-4f4c-b7ee-21f57031a048+12:18544:x1874160212104960:12345-0@lo:101:mount.lustre.0 Request processed in 127us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338904.436939:0:18556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787338904.436979:0:18544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee081500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4530016f-1c37-4f4c-b7ee-21f57031a048:18544:1874160212104960:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787338904.436991:0:18544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.153@tcp lock: ffff90bbc0031c00/0x83671231080c2f6e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c2f75 expref: -99 pid: 18544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338904.436999:0:18544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.153@tcp lock: ffff90bbc0031c00/0x83671231080c2f6e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x83671231080c2f75 expref: -99 pid: 18544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338904.437037:0:18544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee081500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4530016f-1c37-4f4c-b7ee-21f57031a048:18544:1874160212105088:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787338904.437060:0:18544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338904.437075:0:18544:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc5551300 going to sleep for 11 seconds 00000100:00100000:0.0:1787338904.437087:0:18557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212105088 00000100:00100000:0.0:1787338904.437090:0:18557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212105088 00000100:00100000:0.0:1787338904.437115:0:18557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787338904.437120:0:18557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbef288c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4530016f-1c37-4f4c-b7ee-21f57031a048+12:18544:x1874160212105088:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787338904.437447:0:18557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbef288c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4530016f-1c37-4f4c-b7ee-21f57031a048+12:18544:x1874160212105088:12345-0@lo:501:mount.lustre.0 Request processed in 326us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338904.437455:0:18557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787338904.437482:0:18544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee081500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4530016f-1c37-4f4c-b7ee-21f57031a048:18544:1874160212105088:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787338904.437505:0:18544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee081500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4530016f-1c37-4f4c-b7ee-21f57031a048:18544:1874160212105216:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787338904.437537:0:18544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338904.437549:0:18544:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc5551300 going to sleep for 11 seconds 00000100:00100000:0.0:1787338904.437562:0:18557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212105216 00000100:00100000:0.0:1787338904.437565:0:18557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212105216 00000100:00100000:0.0:1787338904.437584:0:18557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787338904.437590:0:18557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbef289450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4530016f-1c37-4f4c-b7ee-21f57031a048+12:18544:x1874160212105216:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787338904.437718:0:18557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbef289450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4530016f-1c37-4f4c-b7ee-21f57031a048+12:18544:x1874160212105216:12345-0@lo:503:mount.lustre.0 Request processed in 127us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338904.437725:0:18557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787338904.437760:0:18544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee081500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4530016f-1c37-4f4c-b7ee-21f57031a048:18544:1874160212105216:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787338904.443438:0:18590:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf7ed5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4530016f-1c37-4f4c-b7ee-21f57031a048:18590:1874160212105344:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787338904.443524:0:18590:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338904.443568:0:18590:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbd0cd7f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787338904.443633:0:18557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212105344 00000100:00100000:0.0:1787338904.443641:0:18557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212105344 00000100:00100000:0.0:1787338904.443723:0:18557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787338904.443733:0:18557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbef288450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4530016f-1c37-4f4c-b7ee-21f57031a048+12:18590:x1874160212105344:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787338904.444001:0:18557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbef288450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4530016f-1c37-4f4c-b7ee-21f57031a048+12:18590:x1874160212105344:12345-0@lo:502:llog_process_th.0 Request processed in 268us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338904.444010:0:18557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787338904.445692:0:18590:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf7ed5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4530016f-1c37-4f4c-b7ee-21f57031a048:18590:1874160212105344:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1787338904.445767:0:18590:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1787338904.445783:0:18590:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff90bbee59cd28) 00000020:00000080:1.0:1787338904.445803:0:18590:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:1.0:1787338904.446452:0:18590:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90bbe83a5800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1787338904.446456:0:18590:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90bbe83a5800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1787338904.446459:0:18590:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90bbe83a5800 4 00010000:00080000:1.0:1787338904.446502:0:18590:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90bbde3ca800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.153@tcp at head 00010000:00010000:1.0:1787338904.451272:0:18590:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:1.0:1787338904.451483:0:18590:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1787338904.451521:0:18590:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787338904.451534:0:18590:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x83671231080c2f83 00000100:00080000:1.0:1787338904.451544:0:18590:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787338904.451550:0:18590:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff90bbde3ca800 using connection 192.168.201.153@tcp/0@lo 00000100:00100000:1.0:1787338904.451585:0:18590:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90bbf7ed5c00 x1874160212105472/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787338904.451616:0:18590:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787338904.451770:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf7ed5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874160212105472:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787338904.451843:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338904.453076:0:18562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212105472 00000100:00100000:1.0:1787338904.453085:0:18562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212105472 00000100:00100000:1.0:1787338904.453115:0:18562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787338904.453123:0:18562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee081500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3313:x1874160212105472:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787338904.453200:0:18562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee081500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3313:x1874160212105472:12345-0@lo:38:llog_process_th.0 Request processed in 76us (1356us total) trans 0 rc -11/-11 00000100:00100000:1.0:1787338904.453208:0:18562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787338904.453304:0:18590:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf7ed4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4530016f-1c37-4f4c-b7ee-21f57031a048:18590:1874160212105600:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787338904.453465:0:18590:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338904.453496:0:18590:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbd0cd79c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787338904.453504:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212105600 00000100:00100000:3.0:1787338904.453508:0:18554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212105600 00000100:00100000:3.0:1787338904.453548:0:18554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787338904.453556:0:18554:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbef28b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4530016f-1c37-4f4c-b7ee-21f57031a048+12:18590:x1874160212105600:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787338904.453606:0:3313:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00100000:3.0:1787338904.454383:0:18554:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbef28b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4530016f-1c37-4f4c-b7ee-21f57031a048+12:18590:x1874160212105600:12345-0@lo:502:llog_process_th.0 Request processed in 824us (914us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338904.454392:0:18554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:0.0:1787338904.454674:0:3313:0:(import.c:65:import_set_state_nolock()) ffff90bbde3ca800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787338904.454679:0:3313:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1787338904.454682:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf7ed5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874160212105472:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787338904.455262:0:18590:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf7ed4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4530016f-1c37-4f4c-b7ee-21f57031a048:18590:1874160212105600:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1787338904.455298:0:18590:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1787338904.455380:0:18544:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1787338904.455399:0:18544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787338904.455430:0:18544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbc0031c00/0x83671231080c2f6e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c2f75 expref: -99 pid: 18544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338904.455442:0:18544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.153@tcp lock: ffff90bbc0031c00/0x83671231080c2f6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c2f75 expref: -99 pid: 18544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787338904.455487:0:18544:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787338904.455490:0:18544:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787338904.455491:0:18544:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787338904.455492:0:18544:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787338904.455493:0:18544:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787338904.455495:0:18544:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787338904.455496:0:18544:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787338904.455497:0:18544:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787338904.455499:0:18544:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787338904.455501:0:18544:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787338904.455504:0:18544:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1787338904.455507:0:18544:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787338904.455508:0:18544:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787338904.455509:0:18544:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787338904.455510:0:18544:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787338904.455511:0:18544:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787338904.455516:0:18544:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787338904.455517:0:18544:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787338904.455518:0:18544:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787338904.455519:0:18544:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787338904.455520:0:18544:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787338904.455540:0:18544:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1787338904.455554:0:18544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee082a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4530016f-1c37-4f4c-b7ee-21f57031a048:18544:1874160212105728:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787338904.455606:0:18544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338904.455636:0:18544:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc954b600 going to sleep for 11 seconds 00000100:00100000:0.0:1787338904.455653:0:18557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212105728 00000100:00100000:0.0:1787338904.455659:0:18557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212105728 00000100:00100000:0.0:1787338904.455694:0:18557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787338904.455702:0:18557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbef289850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4530016f-1c37-4f4c-b7ee-21f57031a048+12:18544:x1874160212105728:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787338904.455736:0:18557:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787338904.455749:0:18557:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1787338904.513642:0:18557:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787338904.513665:0:18557:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1787338904.513721:0:18578:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787338904.513726:0:18578:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787338904.513749:0:18578:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90bbc0030800/0x83671231080c2f8a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338904.513768:0:18578:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90bbffef5800/0x83671231080c2f59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c2f52 expref: 12 pid: 18557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338904.513778:0:18578:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90bbc0030800/0x83671231080c2f8a lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338904.513818:0:18578:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90bbffef5800/0x83671231080c2f59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x83671231080c2f52 expref: 12 pid: 18557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338904.513831:0:18578:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90bbffef5800/0x83671231080c2f59 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x83671231080c2f52 expref: 12 pid: 18557 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338904.513844:0:18578:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee083480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:18578:1874160212105856:0@lo:104: 00000100:00100000:0.0:1787338904.513973:0:18578:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338904.514010:0:18578:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc954bf00 going to sleep for 11 seconds 00000100:00100000:1.0:1787338904.514299:0:18545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212105856 00000100:00100000:1.0:1787338904.514307:0:18545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212105856 00000100:00100000:1.0:1787338904.514366:0:18545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787338904.514376:0:18545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee080a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4530016f-1c37-4f4c-b7ee-21f57031a048+3:18578:x1874160212105856:12345-0@lo:104: 00010000:00010000:1.0:1787338904.514389:0:18545:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9c400/0x83671231080c2f52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x83671231080c2f59 expref: -99 pid: 18544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338904.514442:0:18545:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787338904.514448:0:18545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee080a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4530016f-1c37-4f4c-b7ee-21f57031a048+3:18578:x1874160212105856:12345-0@lo:104: Request processed in 74us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338904.514455:0:18545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1787338904.514477:0:18551:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787338904.514482:0:18551:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9c400/0x83671231080c2f52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x83671231080c2f59 expref: -99 pid: 18544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338904.514489:0:18551:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbfbe9c400 already unused, calling callback (ffffffffc1b2ec20) 10000000:00010000:1.0:1787338904.514500:0:18551:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9c400/0x83671231080c2f52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x83671231080c2f59 expref: -99 pid: 18544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338904.514508:0:18551:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9c400/0x83671231080c2f52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x83671231080c2f59 expref: -99 pid: 18544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787338904.514515:0:18551:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9c400/0x83671231080c2f52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x83671231080c2f59 expref: -99 pid: 18544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787338904.514521:0:18551:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787338904.514549:0:18551:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9c400/0x83671231080c2f52 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c2f59 expref: -99 pid: 18544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338904.514556:0:18551:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787338904.514573:0:18551:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9c400/0x83671231080c2f52 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c2f59 expref: -99 pid: 18544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338904.514580:0:18551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9c400/0x83671231080c2f52 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c2f59 expref: -99 pid: 18544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338904.514597:0:18551:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338904.514599:0:18551:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338904.514601:0:18551:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787338904.514630:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf7ed6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4530016f-1c37-4f4c-b7ee-21f57031a048:3317:1874160212105984:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787338904.514659:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338904.514792:0:18578:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee083480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:18578:1874160212105856:0@lo:104: 00010000:00010000:0.0:1787338904.514812:0:18578:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90bbc0030800/0x83671231080c2f8a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338904.515103:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212105984 00000100:00100000:0.0:1787338904.515108:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212105984 00010000:00010000:0.0:1787338904.515125:0:18547:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90bbffef5800/0x83671231080c2f59 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x83671231080c2f52 expref: 13 pid: 18557 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338904.515153:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787338904.515160:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf7ed4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4530016f-1c37-4f4c-b7ee-21f57031a048+13:3317:x1874160212105984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787338904.515170:0:18547:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787338904.515174:0:18547:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90bbffef5800/0x83671231080c2f59 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x83671231080c2f52 expref: 13 pid: 18557 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338904.515184:0:18547:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90bbffef5800/0x83671231080c2f59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x83671231080c2f52 expref: 13 pid: 18557 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338904.515196:0:18547:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90bbffef5800/0x83671231080c2f59 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x83671231080c2f52 expref: 13 pid: 18557 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338904.515207:0:18547:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90bbc0030800/0x83671231080c2f8a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338904.515214:0:18547:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bbc0030800/0x83671231080c2f8a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787338904.515225:0:18547:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001499691s 00010000:00010000:0.0:1787338904.515236:0:18547:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90bbc0030800/0x83671231080c2f8a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338904.515241:0:18547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90bbc0030800/0x83671231080c2f8a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338904.515247:0:18547:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90bbc0030800/0x83671231080c2f8a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338904.515253:0:18547:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90bbc0030800/0x83671231080c2f8a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338904.515258:0:18547:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbc0030800 already unused, calling callback (ffffffffc1546230) 00010000:00010000:0.0:1787338904.515262:0:18547:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90bbc0030800/0x83671231080c2f8a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338904.515269:0:18547:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90bbc0030800/0x83671231080c2f8a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338904.515290:0:18547:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90bbc0030800/0x83671231080c2f8a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338904.515299:0:18547:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787338904.515346:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf7ed4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4530016f-1c37-4f4c-b7ee-21f57031a048+12:3317:x1874160212105984:12345-0@lo:103:ldlm_bl.0 Request processed in 187us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338904.515353:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787338904.515387:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf7ed6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4530016f-1c37-4f4c-b7ee-21f57031a048:3317:1874160212105984:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787338904.515433:0:18578:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90bbc0030800/0x83671231080c2f8a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338904.515440:0:18578:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90bbc0030800/0x83671231080c2f8a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338904.515455:0:18578:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90bbc0030800/0x83671231080c2f8a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338904.523636:0:18557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbef289850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4530016f-1c37-4f4c-b7ee-21f57031a048+11:18544:x1874160212105728:12345-0@lo:253:mount.lustre.0 Request processed in 67924us (68019us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338904.523653:0:18557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787338904.523727:0:18544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee082a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4530016f-1c37-4f4c-b7ee-21f57031a048:18544:1874160212105728:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787338904.523739:0:18544:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1787338904.523742:0:18544:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787338904.523755:0:18544:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787338904.523756:0:18544:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787338904.523756:0:18544:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787338904.523757:0:18544:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787338904.523758:0:18544:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787338904.523759:0:18544:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787338904.523760:0:18544:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787338904.523761:0:18544:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787338904.523762:0:18544:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787338904.523774:0:18544:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1787338904.528485:0:18544:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1787338904.528598:0:18544:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1787338904.529028:0:18544:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1787338904.529163:0:18544:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1787338904.529461:0:18544:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1787338904.529614:0:18544:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1787338904.532185:0:18544:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1787338904.532378:0:18544:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1787338904.532657:0:18544:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1787338904.533129:0:18544:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1787338904.533412:0:18544:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1787338904.533561:0:18544:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:1.0:1787338904.570597:0:18544:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967528 00000040:01000000:1.0:1787338904.571031:0:18544:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:1.0:1787338904.571272:0:18601:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:1.0:1787338904.571337:0:18601:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:0.0:1787338904.573765:0:18544:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1787338904.573921:0:18544:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1787338904.574336:0:18544:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1787338904.574343:0:18544:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1787338904.574471:0:18544:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787338904.577597:0:18601:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787338904.577756:0:18601:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1787338904.577761:0:18601:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00080000:2.0:1787338904.577948:0:18600:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967528 00000020:00080000:2.0:1787338904.577953:0:18600:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967528 00000040:00080000:0.0:1787338904.578426:0:18544:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1787338904.579264:0:18544:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1787338904.579310:0:18544:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1787338904.580148:0:18544:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:1.0:1787338904.581163:0:18544:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x37:0x0] (8/8/4) registered 00000001:00000004:1.0:1787338904.586544:0:18544:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:2.0:1787338904.619239:0:18544:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1787338904.619277:0:18544:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa35141c83988 00100000:10000000:2.0:1787338904.619284:0:18544:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1787338904.620240:0:18544:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787338904.620256:0:18544:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.153@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787338904.620274:0:18544:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1787338904.620298:0:18544:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:2.0:1787338905.208352:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787338905.527838:0:18559:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787338905.527845:0:18559:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90bbe83a5800 from 9 10000000:01000000:1.0:1787338905.527850:0:18559:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787338905.527917:0:18559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9c600/0x83671231080c2f91 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338905.527930:0:18559:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9c600/0x83671231080c2f91 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338905.527943:0:18559:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9c600/0x83671231080c2f91 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338905.527969:0:18559:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf7ed5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4530016f-1c37-4f4c-b7ee-21f57031a048:18559:1874160212106112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787338905.528054:0:18559:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338905.528102:0:18559:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbd07dd240 going to sleep for 11 seconds 00000100:00100000:1.0:1787338905.528126:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212106112 00000100:00100000:1.0:1787338905.528133:0:18554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212106112 00000100:00100000:1.0:1787338905.528178:0:18554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787338905.528188:0:18554:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbef28b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4530016f-1c37-4f4c-b7ee-21f57031a048+11:18559:x1874160212106112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787338905.528201:0:18554:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787338905.528213:0:18554:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90bbfbe9c200/0x83671231080c2f98 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x83671231080c2f91 expref: -99 pid: 18554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338905.528235:0:18554:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bbfbe9c200/0x83671231080c2f98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x83671231080c2f91 expref: 12 pid: 18554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338905.528245:0:18554:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90bbfbe9c200/0x83671231080c2f98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c2f91 expref: 12 pid: 18554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338905.528267:0:18554:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbfbe9c200, rc 0) 00000100:00100000:1.0:1787338905.528317:0:18554:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbef28b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4530016f-1c37-4f4c-b7ee-21f57031a048+12:18559:x1874160212106112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338905.528324:0:18554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787338905.528369:0:18559:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf7ed5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4530016f-1c37-4f4c-b7ee-21f57031a048:18559:1874160212106112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787338905.528383:0:18559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9c600/0x83671231080c2f91 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c2f98 expref: -99 pid: 18559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338905.528391:0:18559:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9c600/0x83671231080c2f91 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x83671231080c2f98 expref: -99 pid: 18559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787338905.528406:0:18597:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787338905.528411:0:18597:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000100:00100000:1.0:1787338905.528436:0:18559:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf7ed5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4530016f-1c37-4f4c-b7ee-21f57031a048:18559:1874160212106240:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787338905.528466:0:18559:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338905.528479:0:18559:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbd07dd240 going to sleep for 11 seconds 00000100:00100000:1.0:1787338905.528491:0:18557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212106240 00000100:00100000:1.0:1787338905.528494:0:18557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212106240 00000100:00100000:1.0:1787338905.528514:0:18557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787338905.528520:0:18557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbef289c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4530016f-1c37-4f4c-b7ee-21f57031a048+12:18559:x1874160212106240:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787338905.528531:0:18557:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787338905.528546:0:18557:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787338905.528548:0:18557:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:1.0:1787338905.528615:0:18557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbef289c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4530016f-1c37-4f4c-b7ee-21f57031a048+12:18559:x1874160212106240:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 94us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338905.528622:0:18557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787338905.528667:0:18559:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf7ed5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4530016f-1c37-4f4c-b7ee-21f57031a048:18559:1874160212106240:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787338905.528734:0:18559:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.153@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787338905.528742:0:18559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9c600/0x83671231080c2f91 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c2f98 expref: -99 pid: 18559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338905.528750:0:18559:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9c600/0x83671231080c2f91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c2f98 expref: -99 pid: 18559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787338905.528756:0:18597:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 4 count 4 00000040:00080000:2.0:1787338905.528762:0:18597:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1787338906.236764:0:18551:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787338906.550093:0:18597:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787338906.550103:0:18597:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787338906.550140:0:18597:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 4 count 4 00000040:00080000:2.0:1787338906.550147:0:18597:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1787338907.254718:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787338908.278022:0:18551:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787338908.849499:0:18843:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg153-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787338909.301987:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787338909.814427:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbedcb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4530016f-1c37-4f4c-b7ee-21f57031a048:3314:1874160212106368:0@lo:400:kworker.0 00000100:00100000:1.0:1787338909.814790:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787338909.817843:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787338909.817854:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787338909.817857:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787338909.817861:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787338909.817864:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1787338909.817867:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787338909.817889:0:8:0:(import.c:65:import_set_state_nolock()) ffff90bbde3ca800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787338909.817903:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff90bbde3ca800 using connection 192.168.201.153@tcp/0@lo 00000100:00100000:0.0:1787338909.817912:0:18557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212106368 00000100:00100000:0.0:1787338909.817925:0:18557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212106368 00000100:00100000:3.0:1787338909.817942:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90bbedcb7b80 x1874160212106496/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787338909.817981:0:18557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787338909.817993:0:18557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbef28bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4530016f-1c37-4f4c-b7ee-21f57031a048+12:3314:x1874160212106368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787338909.818026:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbedcb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874160212106496:0@lo:38:kworker.0 00000100:00100000:3.0:1787338909.818088:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338909.818168:0:18564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212106496 00000100:00100000:3.0:1787338909.818172:0:18564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212106496 00000100:00100000:3.0:1787338909.818199:0:18564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787338909.818205:0:18564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbedcb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3313:x1874160212106496:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1787338909.818249:0:18564:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 562 last 0 00000020:00000080:3.0:1787338909.818288:0:18564:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x83671231080c2f9f 00000004:00100000:3.0:1787338909.818305:0:18564:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787338909.818454:0:18564:0:(import.c:65:import_set_state_nolock()) ffff90bbc96ac000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787338909.818504:0:18564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbedcb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874160212106496:12345-0@lo:38:kworker.0 Request processed in 297us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338909.818511:0:18564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787338909.818806:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff90bbedcb7b80 x1874160212106496/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787338919 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787338909.818823:0:3313:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1787338909.818831:0:3313:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1787338909.818835:0:3313:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787338909.818837:0:3313:0:(import.c:65:import_set_state_nolock()) ffff90bbde3ca800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787338909.818843:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbedcb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874160212106496:0@lo:38:kworker.0 00000100:00100000:1.0:1787338909.819539:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbedcb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4530016f-1c37-4f4c-b7ee-21f57031a048:3314:1874160212106368:0@lo:400:kworker.0 00000100:00100000:0.0:1787338909.819541:0:18557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbef28bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4530016f-1c37-4f4c-b7ee-21f57031a048+12:3314:x1874160212106368:12345-0@lo:400:kworker.0 Request processed in 1547us (4749us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338909.819554:0:18557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:2.0:1787338910.326451:0:18551:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787338911.350107:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787338911.690050:0:18995:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffda7d22230 20000000:00000080:1.0:1787338911.690068:0:18995:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff90bbc691ac00 uarg=0000000000000000 20000000:01000000:1.0:1787338911.690102:0:18995:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1787338911.690109:0:18995:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1787338911.690114:0:18995:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1787338911.691510:0:18996:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:3.0:1787338911.691640:0:18995:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1787338911.705380:0:18995:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787338911.705413:0:18995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90bbffef5e00/0x83671231080c2fa6 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338911.705433:0:18995:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90bbffef5a00/0x83671231080c2f67 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c2f60 expref: 11 pid: 18557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338911.705442:0:18995:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90bbffef5e00/0x83671231080c2fa6 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338911.705488:0:18995:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90bbffef5a00/0x83671231080c2f67 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x83671231080c2f60 expref: 11 pid: 18557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338911.705587:0:18995:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90bbffef5a00/0x83671231080c2f67 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x83671231080c2f60 expref: 11 pid: 18557 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338911.705602:0:18995:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbedcb7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18995:1874160212106624:0@lo:104: 00000100:00100000:3.0:1787338911.705666:0:18995:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338911.705727:0:18995:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc829dc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787338911.705759:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212106624 00000100:00100000:0.0:1787338911.705768:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212106624 00000100:00100000:0.0:1787338911.705820:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787338911.705830:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbedcb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4530016f-1c37-4f4c-b7ee-21f57031a048+3:18995:x1874160212106624:12345-0@lo:104: 00010000:00010000:0.0:1787338911.705844:0:18546:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.153@tcp lock: ffff90bbc0030400/0x83671231080c2f60 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x83671231080c2f67 expref: -99 pid: 18544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338911.705925:0:18546:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787338911.705937:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbedcb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4530016f-1c37-4f4c-b7ee-21f57031a048+3:18995:x1874160212106624:12345-0@lo:104: Request processed in 109us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338911.705954:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1787338911.706160:0:18551:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787338911.706172:0:18551:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.153@tcp lock: ffff90bbc0030400/0x83671231080c2f60 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x83671231080c2f67 expref: -99 pid: 18544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338911.706181:0:18551:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbc0030400 already unused, calling callback (ffffffffc1b2ec20) 10000000:00010000:2.0:1787338911.706185:0:18551:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.153@tcp lock: ffff90bbc0030400/0x83671231080c2f60 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x83671231080c2f67 expref: -99 pid: 18544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338911.706203:0:18551:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.153@tcp lock: ffff90bbc0030400/0x83671231080c2f60 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x83671231080c2f67 expref: -99 pid: 18544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787338911.706211:0:18551:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.153@tcp lock: ffff90bbc0030400/0x83671231080c2f60 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x83671231080c2f67 expref: -99 pid: 18544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787338911.706228:0:18551:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1787338911.706242:0:18995:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbedcb7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18995:1874160212106624:0@lo:104: 00010000:00010000:2.0:1787338911.706263:0:18551:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.153@tcp lock: ffff90bbc0030400/0x83671231080c2f60 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c2f67 expref: -99 pid: 18544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338911.706265:0:18995:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90bbffef5e00/0x83671231080c2fa6 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338911.706280:0:18551:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787338911.706308:0:18551:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.153@tcp lock: ffff90bbc0030400/0x83671231080c2f60 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c2f67 expref: -99 pid: 18544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338911.706315:0:18551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.153@tcp lock: ffff90bbc0030400/0x83671231080c2f60 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c2f67 expref: -99 pid: 18544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338911.706328:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf5b73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4530016f-1c37-4f4c-b7ee-21f57031a048:3315:1874160212106752:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787338911.706339:0:18551:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787338911.706342:0:18551:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787338911.706345:0:18551:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787338911.706362:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338911.706784:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212106752 00000100:00100000:2.0:1787338911.706790:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212106752 00010000:00010000:2.0:1787338911.706814:0:18547:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90bbffef5a00/0x83671231080c2f67 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x83671231080c2f60 expref: 12 pid: 18557 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338911.706844:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787338911.706852:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbedcb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4530016f-1c37-4f4c-b7ee-21f57031a048+12:3315:x1874160212106752:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787338911.706863:0:18547:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787338911.706868:0:18547:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90bbffef5a00/0x83671231080c2f67 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x83671231080c2f60 expref: 12 pid: 18557 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338911.706901:0:18547:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90bbffef5a00/0x83671231080c2f67 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x83671231080c2f60 expref: 12 pid: 18557 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338911.706915:0:18547:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90bbffef5a00/0x83671231080c2f67 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x83671231080c2f60 expref: 12 pid: 18557 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338911.706936:0:18547:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90bbffef5e00/0x83671231080c2fa6 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338911.706955:0:18547:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bbffef5e00/0x83671231080c2fa6 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338911.706970:0:18547:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90bbffef5e00/0x83671231080c2fa6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338911.706977:0:18547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90bbffef5e00/0x83671231080c2fa6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338911.706984:0:18547:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90bbffef5e00/0x83671231080c2fa6 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338911.706991:0:18547:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90bbffef5e00/0x83671231080c2fa6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338911.706996:0:18547:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbffef5e00 already unused, calling callback (ffffffffc1546230) 00010000:00010000:2.0:1787338911.707001:0:18547:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90bbffef5e00/0x83671231080c2fa6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338911.707009:0:18547:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90bbffef5e00/0x83671231080c2fa6 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338911.707022:0:18547:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90bbffef5e00/0x83671231080c2fa6 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338911.707030:0:18547:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787338911.707065:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbedcb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4530016f-1c37-4f4c-b7ee-21f57031a048+11:3315:x1874160212106752:12345-0@lo:103:ldlm_bl.0 Request processed in 214us (703us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338911.707077:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787338911.707116:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf5b73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4530016f-1c37-4f4c-b7ee-21f57031a048:3315:1874160212106752:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787338911.707926:0:18995:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90bbffef5e00/0x83671231080c2fa6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338911.707939:0:18995:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90bbffef5e00/0x83671231080c2fa6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338911.707946:0:18995:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90bbffef5e00/0x83671231080c2fa6 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338912.374021:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787338913.145660:0:18559:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787338913.145668:0:18559:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90bbe83a5800 from 10 10000000:01000000:0.0:1787338913.145673:0:18559:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787338913.145723:0:18559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbc0030400/0x83671231080c2fad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338913.145745:0:18559:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.153@tcp lock: ffff90bbc0030400/0x83671231080c2fad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338913.145757:0:18559:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.153@tcp lock: ffff90bbc0030400/0x83671231080c2fad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338913.145781:0:18559:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee082a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4530016f-1c37-4f4c-b7ee-21f57031a048:18559:1874160212106880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787338913.145850:0:18559:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338913.145913:0:18556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212106880 00000100:00100000:0.0:1787338913.145919:0:18559:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbff9b7300 going to sleep for 11 seconds 00000100:00100000:2.0:1787338913.145930:0:18556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212106880 00000100:00100000:2.0:1787338913.145979:0:18556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787338913.145990:0:18556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbef28a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4530016f-1c37-4f4c-b7ee-21f57031a048+11:18559:x1874160212106880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787338913.146003:0:18556:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787338913.146016:0:18556:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90bbf40e3a00/0x83671231080c2fb4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x83671231080c2fad expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338913.146044:0:18556:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bbf40e3a00/0x83671231080c2fb4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x83671231080c2fad expref: 12 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338913.146055:0:18556:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90bbf40e3a00/0x83671231080c2fb4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c2fad expref: 12 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338913.146064:0:18556:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf40e3a00, rc 0) 00000100:00100000:2.0:1787338913.146117:0:18556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbef28a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4530016f-1c37-4f4c-b7ee-21f57031a048+12:18559:x1874160212106880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338913.146134:0:18556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787338913.146150:0:18559:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee082a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4530016f-1c37-4f4c-b7ee-21f57031a048:18559:1874160212106880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787338913.146164:0:18559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.153@tcp lock: ffff90bbc0030400/0x83671231080c2fad lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c2fb4 expref: -99 pid: 18559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338913.146184:0:18559:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.153@tcp lock: ffff90bbc0030400/0x83671231080c2fad lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x83671231080c2fb4 expref: -99 pid: 18559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338913.146235:0:18559:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee082a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4530016f-1c37-4f4c-b7ee-21f57031a048:18559:1874160212107008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787338913.146260:0:18559:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338913.146281:0:18559:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbff9b7300 going to sleep for 11 seconds 00000100:00100000:1.0:1787338913.146333:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212107008 00000100:00100000:1.0:1787338913.146338:0:18554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212107008 00000100:00100000:1.0:1787338913.146369:0:18554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787338913.146376:0:18554:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbef28ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4530016f-1c37-4f4c-b7ee-21f57031a048+12:18559:x1874160212107008:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787338913.146625:0:18554:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbef28ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4530016f-1c37-4f4c-b7ee-21f57031a048+12:18559:x1874160212107008:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 249us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338913.146631:0:18554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787338913.146727:0:18559:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee082a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4530016f-1c37-4f4c-b7ee-21f57031a048:18559:1874160212107008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787338913.146767:0:18559:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf5b73480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4530016f-1c37-4f4c-b7ee-21f57031a048:18559:1874160212107136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787338913.146803:0:18559:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338913.146824:0:18559:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbd8aae000 going to sleep for 11 seconds 00000100:00100000:0.0:1787338913.146927:0:18556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212107136 00000100:00100000:0.0:1787338913.146931:0:18556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212107136 00000100:00100000:0.0:1787338913.146961:0:18556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787338913.146968:0:18556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbef289050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4530016f-1c37-4f4c-b7ee-21f57031a048+12:18559:x1874160212107136:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787338913.147107:0:18556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbef289050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4530016f-1c37-4f4c-b7ee-21f57031a048+12:18559:x1874160212107136:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 139us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338913.147113:0:18556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787338913.147200:0:18559:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf5b73480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4530016f-1c37-4f4c-b7ee-21f57031a048:18559:1874160212107136:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787338913.147970:0:19063:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1787338913.148092:0:18559:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1787338913.148109:0:18559:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787338913.148119:0:18559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbc0030400/0x83671231080c2fad lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c2fb4 expref: -99 pid: 18559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338913.148130:0:18559:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.153@tcp lock: ffff90bbc0030400/0x83671231080c2fad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c2fb4 expref: -99 pid: 18559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338913.398130:0:18551:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787338914.423176:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787338914.938563:0:3313:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787338904/real 1787338904] req@ffff90bbf7ed4e00 x1874160212103808/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787338914 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787338914.938607:0:3313:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90bbf7ed4e00 x1874160212103808/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787338914 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787338914.938617:0:3313:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787338904/real 1787338904] req@ffff90bbedcb4380 x1874160212103680/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787338914 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787338914.938628:0:3313:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90bbedcb4380 x1874160212103680/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787338914 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787338914.938646:0:3313:0:(import.c:65:import_set_state_nolock()) ffff90bbc2e83000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787338914.938660:0:3313:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787338914.938664:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf7ed4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1874160212103808:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1787338914.938670:0:3313:0:(import.c:65:import_set_state_nolock()) ffff90bbd888e800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787338914.938674:0:3313:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787338914.938677:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbedcb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1874160212103680:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1787338914.939043:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787338914.939048:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787338914.939051:0:8:0:(import.c:65:import_set_state_nolock()) ffff90bbd888e800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787338914.939056:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 557 00000100:00080000:3.0:1787338914.939061:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787338914.939068:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff90bbd888e800 using connection 192.168.201.153@tcp/0@lo 00000100:00100000:3.0:1787338914.939095:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90bbedcb4a80 x1874160212107392/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787338914.939108:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787338914.939111:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787338914.939113:0:8:0:(import.c:65:import_set_state_nolock()) ffff90bbc2e83000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787338914.939116:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 557 00000100:00080000:3.0:1787338914.939118:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787338914.939121:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff90bbc2e83000 using connection 192.168.201.153@tcp/0@lo 00000100:00100000:3.0:1787338914.939131:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90bbedcb4e00 x1874160212107520/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787338914.939526:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbedcb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874160212107648:0@lo:400:kworker.0 00000100:00100000:0.0:1787338914.939589:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338914.939641:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787338914.939647:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbedcb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4530016f-1c37-4f4c-b7ee-21f57031a048:3317:1874160212107264:0@lo:400:kworker.0 00000100:00100000:0.0:1787338914.939681:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338914.939716:0:18557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212107264 00000100:00100000:0.0:1787338914.939722:0:18557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212107264 00000100:00100000:0.0:1787338914.939767:0:18557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787338914.939776:0:18557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbef28a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4530016f-1c37-4f4c-b7ee-21f57031a048+12:3317:x1874160212107264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787338914.939824:0:18557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbef28a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4530016f-1c37-4f4c-b7ee-21f57031a048+12:3317:x1874160212107264:12345-0@lo:400:kworker.0 Request processed in 49us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338914.939832:0:18557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787338914.939996:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbedcb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4530016f-1c37-4f4c-b7ee-21f57031a048:3317:1874160212107264:0@lo:400:kworker.0 00000100:00100000:1.0:1787338914.945176:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbedcb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1874160212107392:0@lo:8:kworker.0 00000400:00000100:1.0:1787338914.945234:0:3313:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874160212107392 offset 0 length 520: 4 00000100:00100000:1.0:1787338914.945269:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbedcb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1874160212107520:0@lo:8:kworker.0 00000400:00000100:1.0:1787338914.945284:0:3313:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874160212107520 offset 0 length 520: 4 00000100:00100000:1.0:1787338914.945312:0:18562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212107648 00000100:00100000:1.0:1787338914.945319:0:18562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212107648 00000100:00100000:1.0:1787338914.945371:0:18562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787338914.945379:0:18562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee083480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874160212107648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787338914.945446:0:18562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee083480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874160212107648:12345-0@lo:400:kworker.0 Request processed in 67us (5857us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338914.945462:0:18562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787338914.945506:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff90bbedcb5880 x1874160212107648/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787338930 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787338914.945520:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbedcb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874160212107648:0@lo:400:kworker.0 00010000:00010000:0.0:1787338915.451978:0:18551:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787338916.180656:0:19244:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787338916.180660:0:19244:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1787338916.181129:0:19244:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff90bbc96ab000 00000020:01000004:3.0:1787338916.181146:0:19244:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1787338916.181158:0:19244:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1787338916.181172:0:19244:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff90bbef8ab370) 00000020:00000080:3.0:1787338916.181190:0:19244:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787338916.231990:0:19244:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787338916.232292:0:19244:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1787338916.232978:0:19244:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787338916.233248:0:19244:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1787338916.233480:0:19244:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0xb:0x0] (8/32) 00100000:10000000:3.0:1787338916.233851:0:19244:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 579: rc = 0 00100000:10000000:3.0:1787338916.233980:0:19244:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 579: rc = 0 00100000:10000000:3.0:1787338916.234082:0:19244:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 579: rc = 0 00100000:10000000:0.0:1787338916.245307:0:19244:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 720: rc = 0 00100000:10000000:0.0:1787338916.245589:0:19244:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 720: rc = 0 00100000:10000000:0.0:1787338916.245854:0:19244:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 720: rc = 0 00100000:10000000:0.0:1787338916.246157:0:19244:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 720: rc = 0 00100000:10000000:0.0:1787338916.246412:0:19244:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 720: rc = 0 00100000:10000000:0.0:1787338916.246683:0:19244:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 720: rc = 0 00000020:00000080:0.0:1787338916.247275:0:19244:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1787338916.247287:0:19244:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787338916.247298:0:19244:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x83671231080c2fc2 00000020:01000004:0.0:1787338916.247306:0:19244:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:0.0:1787338916.247326:0:19244:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.153@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1787338916.247330:0:19244:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.153@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1787338916.247336:0:19244:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1787338916.247340:0:19244:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1787338916.247351:0:19244:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff90bbffd80000) 00000020:00000080:0.0:1787338916.247362:0:19244:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:0.0:1787338916.254773:0:19244:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787338916.254995:0:19244:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1787338916.255002:0:19244:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1787338916.261415:0:19244:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1787338916.261427:0:19244:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1787338916.261864:0:19244:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1787338916.261903:0:19244:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1787338916.267841:0:19244:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787338916.268079:0:19244:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1787338916.268085:0:19244:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1787338916.268864:0:19244:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1787338916.268896:0:19244:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1787338916.308106:0:19244:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787338916.308373:0:19244:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1787338916.308381:0:19244:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1787338916.312865:0:19244:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1787338916.313186:0:19244:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1787338916.313866:0:19244:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1787338916.313904:0:19244:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1787338916.317509:0:19244:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787338916.317796:0:19244:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1787338916.317803:0:19244:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1787338916.318791:0:19244:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1787338916.318799:0:19244:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1787338916.350134:0:19244:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787338916.350329:0:19244:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1787338916.350336:0:19244:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1787338916.351461:0:19244:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1787338916.351471:0:19244:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1787338916.352057:0:19244:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1787338916.352091:0:19244:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1787338916.352097:0:19244:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.153@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1787338916.363248:0:19244:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.153@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787338916.363299:0:19244:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.153@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1787338916.363308:0:19244:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787338916.363310:0:19244:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787338916.363311:0:19244:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787338916.363312:0:19244:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787338916.363313:0:19244:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787338916.363315:0:19244:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787338916.363316:0:19244:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787338916.363317:0:19244:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787338916.363318:0:19244:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787338916.363322:0:19244:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1787338916.363324:0:19244:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787338916.363325:0:19244:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787338916.363326:0:19244:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787338916.363327:0:19244:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787338916.363328:0:19244:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787338916.363329:0:19244:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787338916.363330:0:19244:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787338916.363331:0:19244:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787338916.363332:0:19244:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787338916.363358:0:19244:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787338916.363378:0:19244:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf5b73480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4530016f-1c37-4f4c-b7ee-21f57031a048:19244:1874160212107776:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787338916.363453:0:19244:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338916.363511:0:19244:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc674c300 going to sleep for 11 seconds 00000100:00100000:1.0:1787338916.365529:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212107776 00000100:00100000:1.0:1787338916.365540:0:18554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212107776 00000100:00100000:1.0:1787338916.365606:0:18554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787338916.365617:0:18554:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbeb0ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4530016f-1c37-4f4c-b7ee-21f57031a048+12:19244:x1874160212107776:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787338916.365653:0:18554:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1787338916.365656:0:18554:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1787338916.365660:0:18554:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1787338916.374614:0:18554:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbeb0ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4530016f-1c37-4f4c-b7ee-21f57031a048+12:19244:x1874160212107776:12345-0@lo:253:mount.lustre.0 Request processed in 8989us (11151us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338916.374629:0:18554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787338916.374829:0:19244:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf5b73480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4530016f-1c37-4f4c-b7ee-21f57031a048:19244:1874160212107776:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787338916.374846:0:19244:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787338916.374849:0:19244:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787338916.374850:0:19244:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787338916.374852:0:19244:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787338916.374853:0:19244:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787338916.374854:0:19244:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787338916.374855:0:19244:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787338916.374857:0:19244:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787338916.374859:0:19244:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787338916.374860:0:19244:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787338916.374953:0:19244:0:(tgt_mount.c:101:server_register_mount()) register mount ffff90bbc96ab000 from lustre-OST0000 10000000:01000000:2.0:1787338916.374981:0:19244:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1787338916.374984:0:19244:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787338916.375003:0:19244:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff90bbde3eb370 local copy 00010000:00010000:2.0:1787338916.375014:0:19244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbc0030600/0x83671231080c2eb8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c2ebf expref: -99 pid: 18544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338916.375253:0:19244:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf5b73480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4530016f-1c37-4f4c-b7ee-21f57031a048:19244:1874160212107904:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787338916.375298:0:19244:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338916.375375:0:19244:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc674c600 going to sleep for 11 seconds 00000100:00100000:0.0:1787338916.375418:0:18556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212107904 00000100:00100000:0.0:1787338916.375425:0:18556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212107904 00000100:00100000:0.0:1787338916.375514:0:18556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787338916.375526:0:18556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbeb0c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4530016f-1c37-4f4c-b7ee-21f57031a048+12:19244:x1874160212107904:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787338916.375904:0:18556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbeb0c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4530016f-1c37-4f4c-b7ee-21f57031a048+12:19244:x1874160212107904:12345-0@lo:501:mount.lustre.0 Request processed in 379us (603us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787338916.375911:0:18556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787338916.376074:0:19244:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf5b73480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4530016f-1c37-4f4c-b7ee-21f57031a048:19244:1874160212107904:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1787338916.376098:0:19244:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.153@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787338916.376257:0:19244:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.153@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787338916.376265:0:19244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbc0030600/0x83671231080c2eb8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c2ebf expref: -99 pid: 18544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338916.376274:0:19244:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.153@tcp lock: ffff90bbc0030600/0x83671231080c2eb8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c2ebf expref: -99 pid: 18544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787338916.376294:0:19244:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff90bbc96ab000 10000000:01000000:3.0:1787338916.376298:0:19244:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787338916.376303:0:19244:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff90bbde3eb370 10000000:01000000:3.0:1787338916.376305:0:19244:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1787338916.376308:0:19244:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff90bbde3eb370 from 1 10000000:01000000:3.0:1787338916.376310:0:19244:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1787338916.376336:0:19244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbffef5800/0x83671231080c2fd0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338916.376344:0:19244:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.153@tcp lock: ffff90bbffef5800/0x83671231080c2fd0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338916.376352:0:19244:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.153@tcp lock: ffff90bbffef5800/0x83671231080c2fd0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338916.376366:0:19244:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbedcb5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4530016f-1c37-4f4c-b7ee-21f57031a048:19244:1874160212108032:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787338916.376398:0:19244:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338916.376466:0:19244:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc2c1ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1787338916.376510:0:18556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212108032 00000100:00100000:0.0:1787338916.376515:0:18556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212108032 00000100:00100000:0.0:1787338916.376550:0:18556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787338916.376559:0:18556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbeb0c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4530016f-1c37-4f4c-b7ee-21f57031a048+12:19244:x1874160212108032:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787338916.376569:0:18556:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787338916.376581:0:18556:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90bbc0030800/0x83671231080c2fd7 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x83671231080c2fd0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338916.376614:0:18556:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bbc0030800/0x83671231080c2fd7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x83671231080c2fd0 expref: 13 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338916.376623:0:18556:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90bbc0030800/0x83671231080c2fd7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c2fd0 expref: 13 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338916.376644:0:18556:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbc0030800, rc 0) 00000100:00100000:0.0:1787338916.376732:0:18556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbeb0c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4530016f-1c37-4f4c-b7ee-21f57031a048+13:19244:x1874160212108032:12345-0@lo:101:mount.lustre.0 Request processed in 175us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338916.376739:0:18556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787338916.377099:0:19244:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbedcb5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4530016f-1c37-4f4c-b7ee-21f57031a048:19244:1874160212108032:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787338916.377122:0:19244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.153@tcp lock: ffff90bbffef5800/0x83671231080c2fd0 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c2fd7 expref: -99 pid: 19244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338916.377139:0:19244:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.153@tcp lock: ffff90bbffef5800/0x83671231080c2fd0 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x83671231080c2fd7 expref: -99 pid: 19244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787338916.377157:0:19244:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.153@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1787338916.377203:0:19244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbffef5800/0x83671231080c2fd0 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c2fd7 expref: -99 pid: 19244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338916.377211:0:19244:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.153@tcp lock: ffff90bbffef5800/0x83671231080c2fd0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c2fd7 expref: -99 pid: 19244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787338916.377217:0:19244:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1787338916.377221:0:19244:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787338916.377225:0:19244:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1787338916.377227:0:19244:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787338916.377243:0:19244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbffef4600/0x83671231080c2fde lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338916.377249:0:19244:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.153@tcp lock: ffff90bbffef4600/0x83671231080c2fde lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338916.377256:0:19244:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.153@tcp lock: ffff90bbffef4600/0x83671231080c2fde lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338916.377268:0:19244:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbedcb5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4530016f-1c37-4f4c-b7ee-21f57031a048:19244:1874160212108160:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787338916.377298:0:19244:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338916.377327:0:19244:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc2c1ce40 going to sleep for 11 seconds 00000100:00100000:1.0:1787338916.377377:0:18556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212108160 00000100:00100000:1.0:1787338916.377383:0:18556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212108160 00000100:00100000:1.0:1787338916.377420:0:18556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787338916.377428:0:18556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbeb0ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4530016f-1c37-4f4c-b7ee-21f57031a048+13:19244:x1874160212108160:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787338916.377445:0:18556:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787338916.377456:0:18556:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90bbfbe9cc00/0x83671231080c2fe5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x83671231080c2fde expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338916.377470:0:18556:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bbfbe9cc00/0x83671231080c2fe5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x83671231080c2fde expref: 14 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338916.377478:0:18556:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90bbfbe9cc00/0x83671231080c2fe5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c2fde expref: 14 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338916.377485:0:18556:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbfbe9cc00, rc 0) 00000100:00100000:1.0:1787338916.377591:0:18556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbeb0ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4530016f-1c37-4f4c-b7ee-21f57031a048+14:19244:x1874160212108160:12345-0@lo:101:mount.lustre.0 Request processed in 163us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338916.377597:0:18556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787338916.377758:0:19244:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbedcb5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4530016f-1c37-4f4c-b7ee-21f57031a048:19244:1874160212108160:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787338916.377769:0:19244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.153@tcp lock: ffff90bbffef4600/0x83671231080c2fde lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c2fe5 expref: -99 pid: 19244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338916.377782:0:19244:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.153@tcp lock: ffff90bbffef4600/0x83671231080c2fde lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x83671231080c2fe5 expref: -99 pid: 19244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787338916.380021:0:19244:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:3.0:1787338916.381376:0:19244:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787338916.381601:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:3.0:1787338916.381654:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:3.0:1787338916.381744:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:3.0:1787338916.381796:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:3.0:1787338916.381826:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:3.0:1787338916.381852:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:3.0:1787338916.381910:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:3.0:1787338916.381954:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:3.0:1787338916.381981:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:3.0:1787338916.382029:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:3.0:1787338916.382059:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:3.0:1787338916.382095:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:3.0:1787338916.382159:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:3.0:1787338916.382167:0:19244:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:3.0:1787338916.382251:0:19244:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbedcb5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4530016f-1c37-4f4c-b7ee-21f57031a048:19244:1874160212108288:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787338916.382319:0:19244:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338916.382452:0:19244:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc2c1ca80 going to sleep for 11 seconds 00000100:00100000:1.0:1787338916.382734:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212108288 00000100:00100000:1.0:1787338916.382741:0:18554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212108288 00000100:00100000:1.0:1787338916.382819:0:18554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787338916.382829:0:18554:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbeb0c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4530016f-1c37-4f4c-b7ee-21f57031a048+14:19244:x1874160212108288:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787338916.383441:0:18554:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbeb0c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4530016f-1c37-4f4c-b7ee-21f57031a048+14:19244:x1874160212108288:12345-0@lo:501:mount.lustre.0 Request processed in 611us (1119us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338916.383449:0:18554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787338916.383529:0:19244:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbedcb5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4530016f-1c37-4f4c-b7ee-21f57031a048:19244:1874160212108288:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787338916.383569:0:19244:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbedcb5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4530016f-1c37-4f4c-b7ee-21f57031a048:19244:1874160212108416:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787338916.383612:0:19244:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338916.383783:0:19244:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc2c1ca80 going to sleep for 11 seconds 00000100:00100000:1.0:1787338916.383822:0:18556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212108416 00000100:00100000:1.0:1787338916.383829:0:18556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212108416 00000100:00100000:2.0:1787338916.384150:0:18557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787338916.384162:0:18557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbeb0cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4530016f-1c37-4f4c-b7ee-21f57031a048+14:19244:x1874160212108416:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787338916.384566:0:18557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbeb0cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4530016f-1c37-4f4c-b7ee-21f57031a048+14:19244:x1874160212108416:12345-0@lo:503:mount.lustre.0 Request processed in 406us (952us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338916.384574:0:18557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787338916.384755:0:19244:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbedcb5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4530016f-1c37-4f4c-b7ee-21f57031a048:19244:1874160212108416:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787338916.385409:0:19244:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787338916.385478:0:19244:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbedcb5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4530016f-1c37-4f4c-b7ee-21f57031a048:19244:1874160212108544:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787338916.385535:0:19244:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338916.385628:0:19244:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc2c1ca80 going to sleep for 11 seconds 00000100:00100000:1.0:1787338916.385798:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212108544 00000100:00100000:1.0:1787338916.385806:0:18554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212108544 00000100:00100000:1.0:1787338916.386040:0:18554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787338916.386051:0:18554:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbeb0cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4530016f-1c37-4f4c-b7ee-21f57031a048+14:19244:x1874160212108544:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787338916.386292:0:18554:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbeb0cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4530016f-1c37-4f4c-b7ee-21f57031a048+14:19244:x1874160212108544:12345-0@lo:502:mount.lustre.0 Request processed in 243us (757us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338916.386306:0:18554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787338916.386403:0:19244:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbedcb5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4530016f-1c37-4f4c-b7ee-21f57031a048:19244:1874160212108544:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787338916.386629:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:3.0:1787338916.386706:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:3.0:1787338916.386744:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:3.0:1787338916.386798:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:3.0:1787338916.386838:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:3.0:1787338916.386918:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:3.0:1787338916.386974:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:3.0:1787338916.387032:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:3.0:1787338916.387069:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:3.0:1787338916.387136:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:3.0:1787338916.387173:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:3.0:1787338916.387220:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:3.0:1787338916.387254:0:19244:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbedcb5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4530016f-1c37-4f4c-b7ee-21f57031a048:19244:1874160212108672:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787338916.387300:0:19244:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338916.387592:0:19244:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc2c1ca80 going to sleep for 11 seconds 00000100:00100000:0.0:1787338916.388075:0:18556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212108672 00000100:00100000:0.0:1787338916.388082:0:18556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212108672 00000100:00100000:0.0:1787338916.388141:0:18556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787338916.388153:0:18556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbeb0c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4530016f-1c37-4f4c-b7ee-21f57031a048+14:19244:x1874160212108672:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787338916.388384:0:18556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbeb0c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4530016f-1c37-4f4c-b7ee-21f57031a048+14:19244:x1874160212108672:12345-0@lo:502:mount.lustre.0 Request processed in 233us (1082us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338916.388391:0:18556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787338916.392845:0:19244:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbedcb5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4530016f-1c37-4f4c-b7ee-21f57031a048:19244:1874160212108672:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787338916.393034:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:3.0:1787338916.393051:0:19244:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:0.0:1787338916.396092:0:19258:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787338916.396105:0:19258:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1787338916.396146:0:19258:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787338916.396149:0:19258:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1787338916.396156:0:19258:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787338916.396171:0:19258:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff90bbffd83370) 00000020:00000080:0.0:1787338916.396199:0:19258:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:0.0:1787338916.396206:0:19258:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787338916.396267:0:19258:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90bbc96ab000 from lustre-OST0000, refs=2 00080000:01000000:0.0:1787338916.396274:0:19258:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787338916.396280:0:19258:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x83671231080c2ff3 00010000:00010000:0.0:1787338916.401311:0:19258:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:0.0:1787338916.403077:0:19258:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934600 00080000:10000000:0.0:1787338916.405279:0:19258:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00000020:00000080:0.0:1787338916.410755:0:19258:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1787338916.410768:0:19258:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787338916.410775:0:19258:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787338916.410777:0:19258:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1787338916.410780:0:19258:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787338916.410783:0:19258:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:0.0:1787338916.410785:0:19258:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787338916.410787:0:19258:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787338916.410788:0:19258:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787338916.410791:0:19258:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787338916.410792:0:19258:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787338916.410795:0:19258:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787338916.410798:0:19258:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787338916.410800:0:19258:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787338916.410802:0:19258:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787338916.410804:0:19258:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787338916.410807:0:19258:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787338916.410809:0:19258:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787338916.410810:0:19258:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:0.0:1787338916.410812:0:19258:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787338916.410814:0:19258:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787338916.410816:0:19258:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787338916.410819:0:19258:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1787338916.410909:0:19258:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787338916.410913:0:19258:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787338916.410915:0:19258:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787338916.410917:0:19258:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:3.0:1787338916.411175:0:19244:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1787338916.411202:0:19244:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.153@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1787338916.411225:0:19244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbffef4600/0x83671231080c2fde lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c2fe5 expref: -99 pid: 19244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338916.411248:0:19244:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.153@tcp lock: ffff90bbffef4600/0x83671231080c2fde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c2fe5 expref: -99 pid: 19244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787338916.411256:0:19244:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90bbc96ab000 from 1 10000000:01000000:3.0:1787338916.411258:0:19244:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787338916.411290:0:19244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbffef4e00/0x83671231080c2ffa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338916.411297:0:19244:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.153@tcp lock: ffff90bbffef4e00/0x83671231080c2ffa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338916.411308:0:19244:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.153@tcp lock: ffff90bbffef4e00/0x83671231080c2ffa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338916.411329:0:19244:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbedcb5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4530016f-1c37-4f4c-b7ee-21f57031a048:19244:1874160212108800:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787338916.411413:0:19244:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338916.411459:0:19244:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc2c1cf00 going to sleep for 11 seconds 00000100:00100000:2.0:1787338916.411602:0:18556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212108800 00000100:00100000:2.0:1787338916.411610:0:18556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212108800 00000100:00100000:2.0:1787338916.411656:0:18556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787338916.411666:0:18556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc9553050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4530016f-1c37-4f4c-b7ee-21f57031a048+14:19244:x1874160212108800:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787338916.411688:0:18556:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787338916.411701:0:18556:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90bbf40e3200/0x83671231080c3001 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x83671231080c2ffa expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338916.411722:0:18556:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bbf40e3200/0x83671231080c3001 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x83671231080c2ffa expref: 15 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338916.411732:0:18556:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90bbf40e3200/0x83671231080c3001 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c2ffa expref: 15 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338916.411741:0:18556:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf40e3200, rc 0) 00000100:00100000:2.0:1787338916.411779:0:18556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc9553050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4530016f-1c37-4f4c-b7ee-21f57031a048+15:19244:x1874160212108800:12345-0@lo:101:mount.lustre.0 Request processed in 115us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338916.411793:0:18556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787338916.412249:0:19244:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbedcb5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4530016f-1c37-4f4c-b7ee-21f57031a048:19244:1874160212108800:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787338916.412265:0:19244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.153@tcp lock: ffff90bbffef4e00/0x83671231080c2ffa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c3001 expref: -99 pid: 19244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338916.412274:0:19244:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.153@tcp lock: ffff90bbffef4e00/0x83671231080c2ffa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x83671231080c3001 expref: -99 pid: 19244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787338916.412952:0:19244:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000040:00080000:3.0:1787338916.413262:0:19244:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787338916.413851:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:3.0:1787338916.414007:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:3.0:1787338916.414072:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:3.0:1787338916.414123:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:3.0:1787338916.414159:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:3.0:1787338916.414207:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:3.0:1787338916.414260:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:3.0:1787338916.414297:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:3.0:1787338916.420687:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:3.0:1787338916.420715:0:19244:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 9 count 10 00000100:00100000:3.0:1787338916.420837:0:19244:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbedcb5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4530016f-1c37-4f4c-b7ee-21f57031a048:19244:1874160212108928:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787338916.420928:0:19244:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338916.421020:0:19244:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc2c1cf00 going to sleep for 11 seconds 00000100:00100000:2.0:1787338916.423188:0:18557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212108928 00000100:00100000:2.0:1787338916.423202:0:18557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212108928 00000100:00100000:2.0:1787338916.423308:0:18557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787338916.423319:0:18557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc9551050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4530016f-1c37-4f4c-b7ee-21f57031a048+15:19244:x1874160212108928:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787338916.423604:0:18557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc9551050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4530016f-1c37-4f4c-b7ee-21f57031a048+15:19244:x1874160212108928:12345-0@lo:501:mount.lustre.0 Request processed in 286us (2675us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338916.423612:0:18557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787338916.423624:0:19244:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbedcb5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4530016f-1c37-4f4c-b7ee-21f57031a048:19244:1874160212108928:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787338916.424292:0:19244:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf7ed4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4530016f-1c37-4f4c-b7ee-21f57031a048:19244:1874160212109056:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787338916.424344:0:19244:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338916.426338:0:18556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212109056 00000100:00100000:3.0:1787338916.426351:0:18556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212109056 00000100:00100000:3.0:1787338916.426412:0:18556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787338916.426422:0:18556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc9552050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4530016f-1c37-4f4c-b7ee-21f57031a048+15:19244:x1874160212109056:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787338916.426458:0:19244:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbd1649cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787338916.426624:0:18556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc9552050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4530016f-1c37-4f4c-b7ee-21f57031a048+15:19244:x1874160212109056:12345-0@lo:503:mount.lustre.0 Request processed in 203us (2279us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338916.426959:0:19244:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf7ed4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4530016f-1c37-4f4c-b7ee-21f57031a048:19244:1874160212109056:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787338916.427648:0:19244:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787338916.427725:0:19244:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf5b71500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4530016f-1c37-4f4c-b7ee-21f57031a048:19244:1874160212109184:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787338916.427796:0:19244:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338916.427831:0:18557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212109184 00000100:00100000:2.0:1787338916.427837:0:18557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212109184 00000100:00100000:3.0:1787338916.428692:0:18556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787338916.428834:0:18557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787338916.428846:0:18557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc9553850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4530016f-1c37-4f4c-b7ee-21f57031a048+15:19244:x1874160212109184:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787338916.429013:0:19244:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbd87f66c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787338916.429301:0:18557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc9553850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4530016f-1c37-4f4c-b7ee-21f57031a048+15:19244:x1874160212109184:12345-0@lo:502:mount.lustre.0 Request processed in 458us (1504us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338916.429309:0:18557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787338916.429440:0:19244:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf5b71500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4530016f-1c37-4f4c-b7ee-21f57031a048:19244:1874160212109184:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787338916.429751:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:3.0:1787338916.429862:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:2.0:1787338916.437606:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:2.0:1787338916.437665:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:2.0:1787338916.437703:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:2.0:1787338916.437753:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:2.0:1787338916.437791:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:2.0:1787338916.437826:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000100:00100000:2.0:1787338916.438518:0:19244:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf5b70000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4530016f-1c37-4f4c-b7ee-21f57031a048:19244:1874160212109312:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787338916.438610:0:19244:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338916.438653:0:19244:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbd87f6480 going to sleep for 11 seconds 00000100:00100000:3.0:1787338916.439337:0:18556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212109312 00000100:00100000:3.0:1787338916.439346:0:18556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212109312 00000100:00100000:3.0:1787338916.439466:0:18556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787338916.439477:0:18556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc9550c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4530016f-1c37-4f4c-b7ee-21f57031a048+15:19244:x1874160212109312:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787338916.439777:0:18556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc9550c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4530016f-1c37-4f4c-b7ee-21f57031a048+15:19244:x1874160212109312:12345-0@lo:502:mount.lustre.0 Request processed in 302us (1166us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338916.439795:0:18556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787338916.443753:0:19244:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf5b70000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4530016f-1c37-4f4c-b7ee-21f57031a048:19244:1874160212109312:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787338916.445235:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:0.0:1787338916.445251:0:19244:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1787338916.446531:0:19262:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787338916.446542:0:19262:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787338916.446545:0:19262:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787338916.446552:0:19262:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90bbc96ab000 00000020:00000080:1.0:1787338916.446554:0:19262:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787338916.446561:0:19262:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787338916.446564:0:19262:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787338916.446565:0:19262:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1787338916.446568:0:19262:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787338916.446571:0:19262:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787338916.446572:0:19262:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787338916.446576:0:19262:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90bbc96ab000 00000020:00000080:1.0:1787338916.446578:0:19262:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787338916.446664:0:19262:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787338916.446668:0:19262:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787338916.446670:0:19262:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1787338916.446673:0:19262:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787338916.446675:0:19262:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787338916.446677:0:19262:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787338916.446680:0:19262:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90bbc96ab000 00000020:00000080:1.0:1787338916.446682:0:19262:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787338916.446721:0:19262:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787338916.446724:0:19262:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787338916.446726:0:19262:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1787338916.446729:0:19262:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 10 count 10 00000020:01000000:3.0:1787338916.450410:0:19244:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1787338916.450451:0:19244:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787338916.450470:0:19244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbffef4e00/0x83671231080c2ffa lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c3001 expref: -99 pid: 19244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338916.450484:0:19244:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.153@tcp lock: ffff90bbffef4e00/0x83671231080c2ffa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c3001 expref: -99 pid: 19244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787338916.450532:0:19244:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787338916.450535:0:19244:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff90bbc96ab000 10000000:01000000:3.0:1787338916.450538:0:19244:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff90bbc96ab000 10000000:01000000:3.0:1787338916.450542:0:19244:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787338916.450548:0:19244:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90bbc96ab000 from 1 10000000:01000000:3.0:1787338916.450551:0:19244:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787338916.450587:0:19244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbffef5400/0x83671231080c3008 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338916.450596:0:19244:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.153@tcp lock: ffff90bbffef5400/0x83671231080c3008 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338916.450607:0:19244:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.153@tcp lock: ffff90bbffef5400/0x83671231080c3008 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338916.450630:0:19244:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbedcb5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4530016f-1c37-4f4c-b7ee-21f57031a048:19244:1874160212109440:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787338916.450697:0:19244:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338916.450738:0:19244:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbd16a23c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787338916.452549:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212109440 00000100:00100000:0.0:1787338916.452560:0:18554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212109440 00000100:00100000:0.0:1787338916.452614:0:18554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787338916.452625:0:18554:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc9551c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4530016f-1c37-4f4c-b7ee-21f57031a048+15:19244:x1874160212109440:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787338916.452640:0:18554:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787338916.452657:0:18554:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90bbc0030c00/0x83671231080c300f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x83671231080c3008 expref: -99 pid: 18554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338916.452684:0:18554:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bbc0030c00/0x83671231080c300f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x83671231080c3008 expref: 16 pid: 18554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338916.452695:0:18554:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90bbc0030c00/0x83671231080c300f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c3008 expref: 16 pid: 18554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338916.452703:0:18554:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbc0030c00, rc 0) 00000100:00100000:0.0:1787338916.452775:0:18554:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc9551c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4530016f-1c37-4f4c-b7ee-21f57031a048+16:19244:x1874160212109440:12345-0@lo:101:mount.lustre.0 Request processed in 152us (2078us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338916.452782:0:18554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787338916.453030:0:19244:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbedcb5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4530016f-1c37-4f4c-b7ee-21f57031a048:19244:1874160212109440:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787338916.453050:0:19244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.153@tcp lock: ffff90bbffef5400/0x83671231080c3008 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c300f expref: -99 pid: 19244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338916.453066:0:19244:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.153@tcp lock: ffff90bbffef5400/0x83671231080c3008 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x83671231080c300f expref: -99 pid: 19244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787338916.453677:0:19244:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000040:00080000:3.0:1787338916.454192:0:19244:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787338916.454447:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:3.0:1787338916.454492:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:3.0:1787338916.454526:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:3.0:1787338916.454597:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:3.0:1787338916.454637:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:3.0:1787338916.454687:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:3.0:1787338916.454723:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:3.0:1787338916.455460:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:3.0:1787338916.455533:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:3.0:1787338916.455586:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:3.0:1787338916.455623:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:3.0:1787338916.455672:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:3.0:1787338916.455708:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:3.0:1787338916.455742:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:3.0:1787338916.459526:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:3.0:1787338916.459582:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:3.0:1787338916.459614:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:3.0:1787338916.459662:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:3.0:1787338916.459698:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:3.0:1787338916.459731:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:3.0:1787338916.459793:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:3.0:1787338916.459830:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:3.0:1787338916.459862:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:3.0:1787338916.459933:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:3.0:1787338916.459969:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 128 off12440 00000040:00080000:3.0:1787338916.460023:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12664 00000040:00080000:3.0:1787338916.460093:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12888 00000040:00080000:3.0:1787338916.467088:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off12968 00000040:00080000:3.0:1787338916.467168:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13192 00000040:00080000:3.0:1787338916.467237:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13416 00000040:00080000:3.0:1787338916.467271:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13504 00000040:00080000:3.0:1787338916.467302:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13632 00000040:00080000:3.0:1787338916.467333:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13776 00000040:00080000:3.0:1787338916.467628:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13904 00000040:00080000:3.0:1787338916.467671:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14128 00000040:00080000:3.0:1787338916.467736:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14352 00000040:00080000:3.0:1787338916.468503:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14432 00000040:00080000:3.0:1787338916.468543:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14656 00000040:00080000:3.0:1787338916.468594:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14880 00000040:00080000:3.0:1787338916.468626:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 120 off15000 00000040:00080000:3.0:1787338916.468723:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 224 off15224 00000040:00080000:3.0:1787338916.468731:0:19244:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 41 count 42 00000100:00100000:3.0:1787338916.468843:0:19244:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbedcb5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4530016f-1c37-4f4c-b7ee-21f57031a048:19244:1874160212109568:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787338916.472628:0:19244:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338916.472683:0:19244:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbd16a23c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787338916.472688:0:18557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212109568 00000100:00100000:2.0:1787338916.472696:0:18557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212109568 00000100:00100000:2.0:1787338916.472749:0:18557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787338916.472760:0:18557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc9550850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4530016f-1c37-4f4c-b7ee-21f57031a048+16:19244:x1874160212109568:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787338916.473074:0:18557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc9550850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4530016f-1c37-4f4c-b7ee-21f57031a048+16:19244:x1874160212109568:12345-0@lo:501:mount.lustre.0 Request processed in 315us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338916.473083:0:18557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787338916.474300:0:19244:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbedcb5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4530016f-1c37-4f4c-b7ee-21f57031a048:19244:1874160212109568:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787338916.474352:0:19244:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbedcb5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4530016f-1c37-4f4c-b7ee-21f57031a048:19244:1874160212109696:0@lo:503:mount.lustre.0 00010000:00010000:3.0:1787338916.475078:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787338916.475141:0:19244:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338916.475170:0:18556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212109696 00000100:00100000:3.0:1787338916.475176:0:18556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212109696 00000100:00100000:3.0:1787338916.475214:0:18556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787338916.475223:0:18556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc9550050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4530016f-1c37-4f4c-b7ee-21f57031a048+16:19244:x1874160212109696:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787338916.476866:0:18556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc9550050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4530016f-1c37-4f4c-b7ee-21f57031a048+16:19244:x1874160212109696:12345-0@lo:503:mount.lustre.0 Request processed in 1638us (1719us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338916.476977:0:18556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787338916.477045:0:19244:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbd16a23c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787338916.477071:0:19244:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbedcb5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4530016f-1c37-4f4c-b7ee-21f57031a048:19244:1874160212109696:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787338916.480178:0:19244:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787338916.480274:0:19244:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbedcb5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4530016f-1c37-4f4c-b7ee-21f57031a048:19244:1874160212109824:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787338916.480349:0:19244:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338916.481018:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212109824 00000100:00100000:2.0:1787338916.481027:0:18554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212109824 00000100:00100000:2.0:1787338916.481078:0:18554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787338916.481088:0:18554:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc9552c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4530016f-1c37-4f4c-b7ee-21f57031a048+16:19244:x1874160212109824:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787338916.481613:0:18554:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc9552c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4530016f-1c37-4f4c-b7ee-21f57031a048+16:19244:x1874160212109824:12345-0@lo:502:mount.lustre.0 Request processed in 524us (1261us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338916.481621:0:18554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787338916.482628:0:19244:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbd16a23c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787338916.482666:0:19244:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbedcb5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4530016f-1c37-4f4c-b7ee-21f57031a048:19244:1874160212109824:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787338916.484132:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:3.0:1787338916.484214:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:3.0:1787338916.484253:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:3.0:1787338916.484303:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:3.0:1787338916.484339:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:3.0:1787338916.485531:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:3.0:1787338916.485583:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:3.0:1787338916.485610:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:3.0:1787338916.485647:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:3.0:1787338916.485677:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:3.0:1787338916.485711:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:3.0:1787338916.485757:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:3.0:1787338916.485793:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:3.0:1787338916.485844:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:3.0:1787338916.487735:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:3.0:1787338916.487818:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:3.0:1787338916.487856:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:3.0:1787338916.489059:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:3.0:1787338916.489106:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:3.0:1787338916.489153:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:3.0:1787338916.489207:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:3.0:1787338916.489237:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:3.0:1787338916.489264:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:3.0:1787338916.489304:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:3.0:1787338916.489334:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 128 off12440 00000040:00080000:3.0:1787338916.490007:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12664 00000040:00080000:3.0:1787338916.490075:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12888 00000040:00080000:3.0:1787338916.490127:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off12968 00000040:00080000:3.0:1787338916.490164:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13192 00000040:00080000:3.0:1787338916.490234:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13416 00000040:00080000:3.0:1787338916.490269:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13504 00000040:00080000:3.0:1787338916.490299:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13632 00000040:00080000:3.0:1787338916.490331:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13776 00000040:00080000:3.0:1787338916.492496:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13904 00000040:00080000:3.0:1787338916.492576:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14128 00000040:00080000:3.0:1787338916.492615:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14352 00000040:00080000:3.0:1787338916.492644:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14432 00000040:00080000:3.0:1787338916.492678:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14656 00000040:00080000:3.0:1787338916.492749:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14880 00000040:00080000:3.0:1787338916.492802:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 120 off15000 00000100:00100000:3.0:1787338916.492854:0:19244:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbedcb5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4530016f-1c37-4f4c-b7ee-21f57031a048:19244:1874160212109952:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787338916.494084:0:19244:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338916.494141:0:19244:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbd16a23c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787338916.494240:0:18557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212109952 00000100:00100000:2.0:1787338916.494249:0:18557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212109952 00000100:00100000:2.0:1787338916.494297:0:18557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787338916.494308:0:18557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc9551450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4530016f-1c37-4f4c-b7ee-21f57031a048+16:19244:x1874160212109952:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787338916.495018:0:19244:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbedcb5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4530016f-1c37-4f4c-b7ee-21f57031a048:19244:1874160212109952:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787338916.495146:0:19244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 224 off15224 00000040:00080000:3.0:1787338916.495163:0:19244:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000100:00100000:2.0:1787338916.495475:0:18557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc9551450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4530016f-1c37-4f4c-b7ee-21f57031a048+16:19244:x1874160212109952:12345-0@lo:502:mount.lustre.0 Request processed in 563us (789us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338916.495486:0:18557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000020:01000004:0.0:1787338916.496801:0:19267:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1787338916.496816:0:19267:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff90bbffd819b8) 00000020:00000080:0.0:1787338916.496839:0:19267:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:0.0:1787338916.497041:0:19267:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90bbc96ab000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787338916.497046:0:19267:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90bbc96ab000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787338916.497060:0:19267:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90bbc96ab000 3 00010000:00080000:0.0:1787338916.497092:0:19267:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90bac122a000@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.153@tcp at head 00010000:00010000:0.0:1787338916.498755:0:19267:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:0.0:1787338916.501460:0:19267:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1787338916.501499:0:19267:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787338916.501510:0:19267:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x83671231080c301d 00000100:00080000:0.0:1787338916.501521:0:19267:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787338916.501532:0:19267:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff90bac122a000 using connection 192.168.201.153@tcp/0@lo 00000100:00100000:0.0:1787338916.501567:0:19267:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90bbee080380 x1874160212110080/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787338916.501594:0:19267:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787338916.501711:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787338916.501717:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787338916.501719:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787338916.501728:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787338916.501780:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf5b71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874160212110208:0@lo:400:kworker.0 00000100:00100000:2.0:1787338916.501846:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338916.501921:0:18563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212110208 00000100:00100000:2.0:1787338916.501928:0:18563:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212110208 00000100:00100000:1.0:1787338916.501953:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee080380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3313:1874160212110080:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787338916.501968:0:18563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787338916.501977:0:18563:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf5b71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874160212110208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787338916.501984:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338916.502023:0:18563:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf5b71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874160212110208:12345-0@lo:400:kworker.0 Request processed in 46us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338916.502029:0:18564:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1787338916.502030:0:18563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787338916.502037:0:18564:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1787338916.502043:0:18563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212110080 00000040:00080000:0.0:1787338916.502286:0:19267:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 42 count 42 00000100:00100000:2.0:1787338916.502498:0:18563:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212110080 00000100:00100000:2.0:1787338916.502561:0:18563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787338916.502566:0:18563:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf7ed5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3313:x1874160212110080:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787338916.502597:0:18563:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 569 last 0 00000020:00000080:2.0:1787338916.502631:0:18563:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x83671231080c3024 00000004:00100000:2.0:1787338916.502657:0:18563:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787338916.502699:0:18563:0:(import.c:65:import_set_state_nolock()) ffff90bac1bf3800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787338916.502747:0:18563:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf7ed5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874160212110080:12345-0@lo:38:llog_process_th.0 Request processed in 179us (760us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338916.502754:0:18563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000020:01000000:1.0:1787338916.502795:0:19244:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1787338916.502821:0:19244:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787338916.502836:0:19244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbffef5400/0x83671231080c3008 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c300f expref: -99 pid: 19244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338916.502847:0:19244:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.153@tcp lock: ffff90bbffef5400/0x83671231080c3008 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c300f expref: -99 pid: 19244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:2.0:1787338916.503006:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90bbee080380 x1874160212110080/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787338926 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787338916.503017:0:3313:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787338916.503025:0:3313:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:2.0:1787338916.503032:0:3313:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787338916.503043:0:3313:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787338916.503131:0:3313:0:(import.c:65:import_set_state_nolock()) ffff90bac122a000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787338916.503140:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee080380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3313:1874160212110080:0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787338916.503174:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90bbf5b71c00 x1874160212110208/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787338932 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787338916.503185:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf5b71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874160212110208:0@lo:400:kworker.0 00000020:01000004:1.0:1787338916.503462:0:19244:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787338916.503464:0:19244:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787338916.503465:0:19244:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787338916.503466:0:19244:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787338916.503467:0:19244:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787338916.503468:0:19244:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787338916.503469:0:19244:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787338916.503471:0:19244:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787338916.503472:0:19244:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787338916.503475:0:19244:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1787338916.503477:0:19244:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787338916.503478:0:19244:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787338916.503479:0:19244:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787338916.503479:0:19244:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787338916.503480:0:19244:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787338916.503481:0:19244:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787338916.503481:0:19244:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787338916.503482:0:19244:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787338916.503483:0:19244:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787338916.503499:0:19244:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1787338916.503509:0:19244:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf7ed7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4530016f-1c37-4f4c-b7ee-21f57031a048:19244:1874160212110336:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787338916.503549:0:19244:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338916.503585:0:19244:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbffa4c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787338916.503592:0:18556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212110336 00000100:00100000:2.0:1787338916.503597:0:18556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212110336 00000100:00100000:2.0:1787338916.503775:0:18556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787338916.503784:0:18556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc9552850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4530016f-1c37-4f4c-b7ee-21f57031a048+16:19244:x1874160212110336:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787338916.503815:0:18556:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1787338916.503831:0:18556:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1787338916.540695:0:18556:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787338916.540708:0:18556:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1787338916.540733:0:18578:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787338916.540738:0:18578:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787338916.540759:0:18578:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90bbfbe9d400/0x83671231080c302b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338916.540777:0:18578:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90bbfbe9c200/0x83671231080c2f98 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c2f91 expref: 16 pid: 18554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338916.540786:0:18578:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90bbfbe9d400/0x83671231080c302b lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338916.540831:0:18578:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90bbfbe9c200/0x83671231080c2f98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x83671231080c2f91 expref: 16 pid: 18554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338916.540846:0:18578:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90bbfbe9c200/0x83671231080c2f98 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x83671231080c2f91 expref: 16 pid: 18554 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338916.540860:0:18578:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf7ed6300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:18578:1874160212110464:0@lo:104: 00000100:00100000:1.0:1787338916.540948:0:18578:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338916.540989:0:18578:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbd8782780 going to sleep for 11 seconds 00000100:00100000:1.0:1787338916.541018:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212110464 00000100:00100000:1.0:1787338916.541027:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212110464 00000100:00100000:1.0:1787338916.541072:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787338916.541082:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf7ed7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4530016f-1c37-4f4c-b7ee-21f57031a048+3:18578:x1874160212110464:12345-0@lo:104: 00010000:00010000:1.0:1787338916.541095:0:18546:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9c600/0x83671231080c2f91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x83671231080c2f98 expref: -99 pid: 18559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338916.541161:0:18546:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787338916.541168:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf7ed7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4530016f-1c37-4f4c-b7ee-21f57031a048+3:18578:x1874160212110464:12345-0@lo:104: Request processed in 87us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338916.541191:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1787338916.541215:0:18551:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787338916.541221:0:18551:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9c600/0x83671231080c2f91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x83671231080c2f98 expref: -99 pid: 18559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338916.541228:0:18551:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbfbe9c600 already unused, calling callback (ffffffffc1b2ec20) 10000000:00010000:1.0:1787338916.541232:0:18551:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9c600/0x83671231080c2f91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x83671231080c2f98 expref: -99 pid: 18559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338916.541241:0:18551:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9c600/0x83671231080c2f91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x83671231080c2f98 expref: -99 pid: 18559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787338916.541248:0:18551:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9c600/0x83671231080c2f91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x83671231080c2f98 expref: -99 pid: 18559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787338916.541254:0:18551:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787338916.541282:0:18551:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9c600/0x83671231080c2f91 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c2f98 expref: -99 pid: 18559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338916.541289:0:18551:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787338916.541307:0:18551:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9c600/0x83671231080c2f91 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c2f98 expref: -99 pid: 18559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338916.541313:0:18551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.153@tcp lock: ffff90bbfbe9c600/0x83671231080c2f91 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c2f98 expref: -99 pid: 18559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338916.541329:0:18551:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338916.541331:0:18551:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338916.541333:0:18551:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787338916.541350:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf7ed4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4530016f-1c37-4f4c-b7ee-21f57031a048:3315:1874160212110592:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787338916.541385:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338916.541425:0:18549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212110592 00000100:00100000:1.0:1787338916.541429:0:18549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212110592 00010000:00010000:1.0:1787338916.541768:0:18549:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90bbfbe9c200/0x83671231080c2f98 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x83671231080c2f91 expref: 17 pid: 18554 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338916.541795:0:18549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787338916.541804:0:18549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf7ed5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4530016f-1c37-4f4c-b7ee-21f57031a048+17:3315:x1874160212110592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787338916.541814:0:18549:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787338916.541820:0:18549:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90bbfbe9c200/0x83671231080c2f98 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x83671231080c2f91 expref: 17 pid: 18554 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338916.541830:0:18549:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90bbfbe9c200/0x83671231080c2f98 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x83671231080c2f91 expref: 17 pid: 18554 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338916.541846:0:18549:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90bbfbe9d400/0x83671231080c302b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338916.541853:0:18549:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bbfbe9d400/0x83671231080c302b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787338916.541866:0:18549:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001499691s 00010000:00010000:1.0:1787338916.541870:0:18549:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90bbfbe9d400/0x83671231080c302b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338916.541896:0:18549:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90bbfbe9d400/0x83671231080c302b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338916.541903:0:18549:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90bbfbe9d400/0x83671231080c302b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338916.541921:0:18549:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90bbfbe9d400/0x83671231080c302b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338916.541926:0:18549:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbfbe9d400 already unused, calling callback (ffffffffc1546230) 00010000:00010000:1.0:1787338916.541931:0:18549:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90bbfbe9d400/0x83671231080c302b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338916.541939:0:18549:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90bbfbe9d400/0x83671231080c302b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338916.541947:0:18549:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90bbfbe9d400/0x83671231080c302b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338916.541957:0:18549:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787338916.542014:0:18549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf7ed5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4530016f-1c37-4f4c-b7ee-21f57031a048+17:3315:x1874160212110592:12345-0@lo:103:ldlm_bl.0 Request processed in 212us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338916.542022:0:18549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1787338916.542056:0:18578:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90bbfbe9c200/0x83671231080c2f98 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x83671231080c2f91 expref: 16 pid: 18554 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338916.542067:0:18578:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf7ed6300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:18578:1874160212110464:0@lo:104: 00010000:00010000:1.0:1787338916.542082:0:18578:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90bbfbe9d400/0x83671231080c302b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338916.542091:0:18578:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90bbfbe9d400/0x83671231080c302b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338916.542097:0:18578:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90bbfbe9d400/0x83671231080c302b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338916.542125:0:18578:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90bbfbe9d400/0x83671231080c302b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338916.542288:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf7ed4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4530016f-1c37-4f4c-b7ee-21f57031a048:3315:1874160212110592:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787338916.548423:0:18556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc9552850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4530016f-1c37-4f4c-b7ee-21f57031a048+15:19244:x1874160212110336:12345-0@lo:253:mount.lustre.0 Request processed in 44633us (44865us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338916.548448:0:18556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787338916.548518:0:19244:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf7ed7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4530016f-1c37-4f4c-b7ee-21f57031a048:19244:1874160212110336:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787338916.548531:0:19244:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1787338916.548534:0:19244:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787338916.548535:0:19244:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787338916.548536:0:19244:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787338916.548537:0:19244:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787338916.548538:0:19244:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787338916.548538:0:19244:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787338916.548540:0:19244:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787338916.548541:0:19244:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787338916.548542:0:19244:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787338916.548552:0:19244:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1787338916.548992:0:19244:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1787338916.549183:0:19244:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1787338916.549345:0:19244:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1787338916.549484:0:19244:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1787338916.549585:0:19244:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1787338916.549694:0:19244:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1787338916.550378:0:19244:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:3.0:1787338916.581260:0:19244:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1787338916.581269:0:19244:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1787338916.581309:0:19244:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787338916.581368:0:19244:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.153@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787338916.581384:0:19244:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1787338916.581413:0:19244:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00000040:00080000:0.0:1787338916.790101:0:18597:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787338916.790118:0:18597:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787338916.791032:0:18597:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 1 00000040:00080000:0.0:1787338916.791114:0:18597:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787338916.791956:0:18597:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00010000:00010000:3.0:1787338917.496459:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787338918.269318:0:18559:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787338918.269325:0:18559:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90bbe83a5800 from 10 10000000:01000000:0.0:1787338918.269330:0:18559:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787338918.269390:0:18559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbc0030200/0x83671231080c3032 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338918.269402:0:18559:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.153@tcp lock: ffff90bbc0030200/0x83671231080c3032 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338918.269415:0:18559:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.153@tcp lock: ffff90bbc0030200/0x83671231080c3032 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338918.269439:0:18559:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee081880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4530016f-1c37-4f4c-b7ee-21f57031a048:18559:1874160212110720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787338918.269513:0:18559:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338918.269563:0:18557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212110720 00000100:00100000:0.0:1787338918.269566:0:18559:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc7c24480 going to sleep for 11 seconds 00000100:00100000:1.0:1787338918.269570:0:18557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212110720 00000100:00100000:1.0:1787338918.269625:0:18557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787338918.269636:0:18557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc9553c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4530016f-1c37-4f4c-b7ee-21f57031a048+15:18559:x1874160212110720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787338918.269649:0:18557:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787338918.269662:0:18557:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90bbfbe9d600/0x83671231080c3039 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x83671231080c3032 expref: -99 pid: 18557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338918.269696:0:18557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bbfbe9d600/0x83671231080c3039 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x83671231080c3032 expref: 16 pid: 18557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338918.269707:0:18557:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90bbfbe9d600/0x83671231080c3039 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c3032 expref: 16 pid: 18557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338918.269717:0:18557:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbfbe9d600, rc 0) 00000100:00100000:1.0:1787338918.269761:0:18557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc9553c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4530016f-1c37-4f4c-b7ee-21f57031a048+16:18559:x1874160212110720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338918.269767:0:18557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787338918.269847:0:18559:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee081880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4530016f-1c37-4f4c-b7ee-21f57031a048:18559:1874160212110720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787338918.269861:0:18559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.153@tcp lock: ffff90bbc0030200/0x83671231080c3032 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c3039 expref: -99 pid: 18559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338918.269905:0:18559:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.153@tcp lock: ffff90bbc0030200/0x83671231080c3032 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x83671231080c3039 expref: -99 pid: 18559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338918.269954:0:18559:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee081880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4530016f-1c37-4f4c-b7ee-21f57031a048:18559:1874160212110848:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787338918.269984:0:18559:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338918.270005:0:18559:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc7c24480 going to sleep for 11 seconds 00000100:00100000:2.0:1787338918.270941:0:18556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212110848 00000100:00100000:2.0:1787338918.270949:0:18556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212110848 00000100:00100000:2.0:1787338918.270987:0:18556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787338918.270995:0:18556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbff94b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4530016f-1c37-4f4c-b7ee-21f57031a048+16:18559:x1874160212110848:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787338918.271013:0:18556:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787338918.271028:0:18556:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787338918.271030:0:18556:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:2.0:1787338918.271128:0:18556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbff94b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4530016f-1c37-4f4c-b7ee-21f57031a048+16:18559:x1874160212110848:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 132us (1141us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338918.271135:0:18556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787338918.271232:0:18559:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee081880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4530016f-1c37-4f4c-b7ee-21f57031a048:18559:1874160212110848:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787338918.271296:0:18559:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.153@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787338918.271304:0:18559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbc0030200/0x83671231080c3032 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c3039 expref: -99 pid: 18559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338918.271313:0:18559:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.153@tcp lock: ffff90bbc0030200/0x83671231080c3032 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c3039 expref: -99 pid: 18559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338918.521674:0:18551:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338919.542133:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338920.570086:0:18551:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338921.590323:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787338921.595373:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787338921.595380:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787338921.595383:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787338921.595393:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787338921.595461:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf5b71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4530016f-1c37-4f4c-b7ee-21f57031a048:3316:1874160212110976:0@lo:400:kworker.0 00000100:00100000:2.0:1787338921.596378:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338921.596441:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787338921.596449:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf5b73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874160212111104:0@lo:400:kworker.0 00000100:00100000:2.0:1787338921.596479:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338921.597245:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212110976 00000100:00100000:1.0:1787338921.597254:0:18554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212110976 00000100:00100000:1.0:1787338921.597307:0:18554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787338921.597317:0:18554:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbff949050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4530016f-1c37-4f4c-b7ee-21f57031a048+16:3316:x1874160212110976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787338921.597373:0:18554:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbff949050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4530016f-1c37-4f4c-b7ee-21f57031a048+16:3316:x1874160212110976:12345-0@lo:400:kworker.0 Request processed in 58us (998us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338921.597381:0:18554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787338921.597414:0:19270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212111104 00000100:00100000:1.0:1787338921.597418:0:19270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212111104 00000100:00100000:1.0:1787338921.597446:0:19270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787338921.597453:0:19270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf5b72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874160212111104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787338921.597483:0:19270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf5b72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874160212111104:12345-0@lo:400:kworker.0 Request processed in 31us (1003us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338921.597489:0:19270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787338921.597672:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf5b73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1874160212111232:0@lo:400:kworker.0 00000100:00100000:2.0:1787338921.597702:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338921.598195:0:19270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212111232 00000100:00100000:1.0:1787338921.598199:0:19270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212111232 00000100:00100000:1.0:1787338921.598230:0:19270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1787338921.598231:0:18558:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787338921.598237:0:19270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf5b70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874160212111232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787338921.598285:0:19270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf5b70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874160212111232:12345-0@lo:400:kworker.0 Request processed in 48us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338921.598291:0:19270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1787338921.598444:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90bbf5b73800 x1874160212111232/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787338937 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787338921.598459:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf5b73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1874160212111232:0@lo:400:kworker.0 00010000:00080000:2.0:1787338921.603766:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90bbf5b73b80 x1874160212111104/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787338937 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787338921.603784:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf5b73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874160212111104:0@lo:400:kworker.0 00000100:00100000:2.0:1787338921.603797:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf5b71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4530016f-1c37-4f4c-b7ee-21f57031a048:3316:1874160212110976:0@lo:400:kworker.0 00000001:02000400:1.0:1787338921.754626:0:19614:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg153-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787338922.618698:0:18551:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338923.638608:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338924.662397:0:18551:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338925.686051:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787338926.011807:0:18597:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787338926.710283:0:18551:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787338926.719158:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787338926.719165:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787338926.719168:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787338926.719172:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787338926.719234:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf7ed7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1874160212111616:0@lo:400:kworker.0 00000100:00100000:1.0:1787338926.719297:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338926.719354:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787338926.719360:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf7ed6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874160212111488:0@lo:400:kworker.0 00000100:00100000:1.0:1787338926.719384:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338926.719417:0:19270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212111616 00000100:00100000:1.0:1787338926.719425:0:19270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212111616 00000100:00100000:1.0:1787338926.719473:0:19270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212111488 00000100:00100000:1.0:1787338926.719476:0:19270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212111488 00000100:00100000:3.0:1787338926.719579:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787338926.719589:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf7ed7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4530016f-1c37-4f4c-b7ee-21f57031a048:3314:1874160212111360:0@lo:400:kworker.0 00000100:00100000:3.0:1787338926.719626:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338926.719678:0:19270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787338926.719692:0:19270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf7ed4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874160212111616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787338926.719756:0:19270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf7ed4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874160212111616:12345-0@lo:400:kworker.0 Request processed in 66us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338926.719778:0:19270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787338926.719796:0:19270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787338926.719803:0:19270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf7ed6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874160212111488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787338926.719832:0:19270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf7ed6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874160212111488:12345-0@lo:400:kworker.0 Request processed in 31us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338926.719837:0:19270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1787338926.719858:0:18558:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787338926.719977:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90bbf7ed6300 x1874160212111488/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787338942 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787338926.719990:0:18557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212111360 00000100:00100000:3.0:1787338926.719995:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf7ed6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874160212111488:0@lo:400:kworker.0 00000100:00100000:0.0:1787338926.719998:0:18557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212111360 00010000:00080000:3.0:1787338926.720012:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90bbf7ed7800 x1874160212111616/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787338942 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787338926.720022:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf7ed7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1874160212111616:0@lo:400:kworker.0 00000100:00100000:0.0:1787338926.720041:0:18557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787338926.720052:0:18557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbff94a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4530016f-1c37-4f4c-b7ee-21f57031a048+16:3314:x1874160212111360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787338926.720106:0:18557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbff94a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4530016f-1c37-4f4c-b7ee-21f57031a048+16:3314:x1874160212111360:12345-0@lo:400:kworker.0 Request processed in 58us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338926.720114:0:18557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787338926.720132:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf7ed7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4530016f-1c37-4f4c-b7ee-21f57031a048:3314:1874160212111360:0@lo:400:kworker.0 00010000:00010000:1.0:1787338927.735731:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787338927.990632:0:19964:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787338927.990637:0:19964:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1787338927.990754:0:19964:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff90bbe826c000 00000020:01000004:1.0:1787338927.990770:0:19964:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1787338927.990783:0:19964:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1787338927.990796:0:19964:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff90bbee598000) 00000020:00000080:1.0:1787338927.990991:0:19964:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1787338928.017322:0:19964:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1787338928.017807:0:19964:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1787338928.018813:0:19964:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1787338928.020120:0:19964:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:0.0:1787338928.020574:0:19964:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0xb:0x0] (8/32) 00100000:10000000:0.0:1787338928.021077:0:19964:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 485: rc = 0 00100000:10000000:0.0:1787338928.021312:0:19964:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 485: rc = 0 00100000:10000000:0.0:1787338928.021682:0:19964:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 485: rc = 0 00100000:10000000:0.0:1787338928.022140:0:19964:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 549: rc = 0 00100000:10000000:0.0:1787338928.022657:0:19964:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 549: rc = 0 00100000:10000000:0.0:1787338928.022925:0:19964:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 549: rc = 0 00100000:10000000:1.0:1787338928.024166:0:19964:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 549: rc = 0 00100000:10000000:1.0:1787338928.024602:0:19964:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 549: rc = 0 00100000:10000000:1.0:1787338928.024853:0:19964:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 549: rc = 0 00000020:00000080:1.0:1787338928.026407:0:19964:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1787338928.026420:0:19964:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787338928.026431:0:19964:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x83671231080c3047 00000020:01000004:1.0:1787338928.026438:0:19964:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:1.0:1787338928.026460:0:19964:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.153@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1787338928.026463:0:19964:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.153@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1787338928.026469:0:19964:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1787338928.026489:0:19964:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:1.0:1787338928.026493:0:19964:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.153@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1787338928.036647:0:19964:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.153@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787338928.036688:0:19964:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.153@tcp, index=0001, flags=0x20002 00000020:01000004:1.0:1787338928.036695:0:19964:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787338928.036697:0:19964:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787338928.036698:0:19964:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787338928.036699:0:19964:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787338928.036700:0:19964:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787338928.036701:0:19964:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787338928.036702:0:19964:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787338928.036704:0:19964:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787338928.036705:0:19964:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787338928.036709:0:19964:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:1.0:1787338928.036711:0:19964:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787338928.036712:0:19964:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787338928.036713:0:19964:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787338928.036714:0:19964:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787338928.036714:0:19964:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787338928.036715:0:19964:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787338928.036716:0:19964:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787338928.036717:0:19964:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787338928.036718:0:19964:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787338928.036744:0:19964:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1787338928.036762:0:19964:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf7ed5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4530016f-1c37-4f4c-b7ee-21f57031a048:19964:1874160212111744:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787338928.036865:0:19964:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338928.037061:0:19964:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbd07dd000 going to sleep for 11 seconds 00000100:00100000:2.0:1787338928.037092:0:18556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212111744 00000100:00100000:2.0:1787338928.037098:0:18556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212111744 00000100:00100000:2.0:1787338928.037184:0:18556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787338928.037194:0:18556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbff94a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4530016f-1c37-4f4c-b7ee-21f57031a048+16:19964:x1874160212111744:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787338928.037223:0:18556:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1787338928.037226:0:18556:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1787338928.037230:0:18556:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1787338928.051370:0:18556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbff94a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4530016f-1c37-4f4c-b7ee-21f57031a048+16:19964:x1874160212111744:12345-0@lo:253:mount.lustre.0 Request processed in 14155us (14482us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338928.051386:0:18556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787338928.056594:0:19964:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf7ed5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4530016f-1c37-4f4c-b7ee-21f57031a048:19964:1874160212111744:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787338928.056618:0:19964:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1787338928.056621:0:19964:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787338928.056623:0:19964:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787338928.056624:0:19964:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787338928.056625:0:19964:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787338928.056626:0:19964:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787338928.056628:0:19964:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787338928.056629:0:19964:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787338928.056631:0:19964:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787338928.056633:0:19964:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787338928.057839:0:19964:0:(tgt_mount.c:101:server_register_mount()) register mount ffff90bbe826c000 from lustre-OST0001 10000000:01000000:0.0:1787338928.057934:0:19964:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1787338928.057938:0:19964:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1787338928.057947:0:19964:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff90bbde3eb370 local copy 00010000:00010000:0.0:1787338928.057960:0:19964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbc0030600/0x83671231080c2eb8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c2ebf expref: -99 pid: 18544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338928.058196:0:19964:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee081880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4530016f-1c37-4f4c-b7ee-21f57031a048:19964:1874160212111872:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787338928.058328:0:19964:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338928.058524:0:19964:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc9261180 going to sleep for 11 seconds 00000100:00100000:1.0:1787338928.058626:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212111872 00000100:00100000:1.0:1787338928.058634:0:18554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212111872 00000100:00100000:1.0:1787338928.058712:0:18554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787338928.058731:0:18554:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbff948050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4530016f-1c37-4f4c-b7ee-21f57031a048+16:19964:x1874160212111872:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787338928.058949:0:18554:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbff948050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4530016f-1c37-4f4c-b7ee-21f57031a048+16:19964:x1874160212111872:12345-0@lo:501:mount.lustre.0 Request processed in 219us (620us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787338928.058957:0:18554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787338928.059035:0:19964:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee081880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4530016f-1c37-4f4c-b7ee-21f57031a048:19964:1874160212111872:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1787338928.059053:0:19964:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.153@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787338928.059187:0:19964:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.153@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787338928.059195:0:19964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbc0030600/0x83671231080c2eb8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c2ebf expref: -99 pid: 18544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338928.059210:0:19964:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.153@tcp lock: ffff90bbc0030600/0x83671231080c2eb8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c2ebf expref: -99 pid: 18544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787338928.059232:0:19964:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff90bbe826c000 10000000:01000000:2.0:1787338928.059248:0:19964:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787338928.059253:0:19964:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787338928.059255:0:19964:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787338928.059259:0:19964:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1787338928.059262:0:19964:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1787338928.059287:0:19964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbf40e2400/0x83671231080c304e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338928.059296:0:19964:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.153@tcp lock: ffff90bbf40e2400/0x83671231080c304e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338928.059305:0:19964:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.153@tcp lock: ffff90bbf40e2400/0x83671231080c304e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338928.059319:0:19964:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf5b71c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4530016f-1c37-4f4c-b7ee-21f57031a048:19964:1874160212112000:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787338928.059366:0:19964:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338928.059737:0:19964:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbd8aae0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787338928.059835:0:18557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212112000 00000100:00100000:0.0:1787338928.059841:0:18557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212112000 00000100:00100000:0.0:1787338928.059867:0:18557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787338928.059889:0:18557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc168850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4530016f-1c37-4f4c-b7ee-21f57031a048+16:19964:x1874160212112000:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787338928.059900:0:18557:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787338928.059923:0:18557:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90bbc0031800/0x83671231080c3055 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x83671231080c304e expref: -99 pid: 18557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338928.059953:0:18557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bbc0031800/0x83671231080c3055 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x83671231080c304e expref: 17 pid: 18557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338928.059962:0:18557:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90bbc0031800/0x83671231080c3055 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c304e expref: 17 pid: 18557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338928.059970:0:18557:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbc0031800, rc 0) 00000100:00100000:0.0:1787338928.060011:0:18557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc168850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4530016f-1c37-4f4c-b7ee-21f57031a048+17:19964:x1874160212112000:12345-0@lo:101:mount.lustre.0 Request processed in 138us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338928.060018:0:18557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787338928.060100:0:19964:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf5b71c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4530016f-1c37-4f4c-b7ee-21f57031a048:19964:1874160212112000:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787338928.060113:0:19964:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.153@tcp lock: ffff90bbf40e2400/0x83671231080c304e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c3055 expref: -99 pid: 19964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338928.060122:0:19964:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.153@tcp lock: ffff90bbf40e2400/0x83671231080c304e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x83671231080c3055 expref: -99 pid: 19964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787338928.061146:0:19964:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:2.0:1787338928.062455:0:19964:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787338928.062747:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:2.0:1787338928.062785:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:2.0:1787338928.062811:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:2.0:1787338928.062853:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:2.0:1787338928.062927:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:2.0:1787338928.062958:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:2.0:1787338928.062997:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:2.0:1787338928.063025:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:2.0:1787338928.063061:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:2.0:1787338928.063116:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:2.0:1787338928.063123:0:19964:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:2.0:1787338928.063198:0:19964:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf5b71c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4530016f-1c37-4f4c-b7ee-21f57031a048:19964:1874160212112128:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787338928.063570:0:19964:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338928.063608:0:19964:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbd8aaeb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787338928.063656:0:18557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212112128 00000100:00100000:0.0:1787338928.063663:0:18557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212112128 00000100:00100000:0.0:1787338928.063704:0:18557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787338928.063712:0:18557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc16b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4530016f-1c37-4f4c-b7ee-21f57031a048+17:19964:x1874160212112128:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787338928.064030:0:18557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc16b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4530016f-1c37-4f4c-b7ee-21f57031a048+17:19964:x1874160212112128:12345-0@lo:501:mount.lustre.0 Request processed in 318us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338928.064038:0:18557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787338928.064156:0:19964:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf5b71c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4530016f-1c37-4f4c-b7ee-21f57031a048:19964:1874160212112128:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787338928.064187:0:19964:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf5b71c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4530016f-1c37-4f4c-b7ee-21f57031a048:19964:1874160212112256:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787338928.064224:0:19964:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338928.064308:0:19964:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbd8aaeb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787338928.064348:0:18557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212112256 00000100:00100000:0.0:1787338928.064351:0:18557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212112256 00000100:00100000:0.0:1787338928.064452:0:18557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787338928.064459:0:18557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc16a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4530016f-1c37-4f4c-b7ee-21f57031a048+17:19964:x1874160212112256:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787338928.064749:0:18557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc16a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4530016f-1c37-4f4c-b7ee-21f57031a048+17:19964:x1874160212112256:12345-0@lo:503:mount.lustre.0 Request processed in 290us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338928.064756:0:18557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787338928.064818:0:19964:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf5b71c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4530016f-1c37-4f4c-b7ee-21f57031a048:19964:1874160212112256:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787338928.065353:0:19964:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787338928.065658:0:19964:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf5b71c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4530016f-1c37-4f4c-b7ee-21f57031a048:19964:1874160212112384:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787338928.065713:0:19964:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338928.065981:0:19964:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbfffc1840 going to sleep for 11 seconds 00000100:00100000:3.0:1787338928.066051:0:18556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212112384 00000100:00100000:3.0:1787338928.066057:0:18556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212112384 00000100:00100000:3.0:1787338928.066089:0:18556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787338928.066097:0:18556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc168050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4530016f-1c37-4f4c-b7ee-21f57031a048+17:19964:x1874160212112384:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787338928.066412:0:18556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc168050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4530016f-1c37-4f4c-b7ee-21f57031a048+17:19964:x1874160212112384:12345-0@lo:502:mount.lustre.0 Request processed in 314us (697us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338928.066420:0:18556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787338928.066611:0:19964:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf5b71c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4530016f-1c37-4f4c-b7ee-21f57031a048:19964:1874160212112384:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787338928.066846:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:2.0:1787338928.066947:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:2.0:1787338928.066981:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:2.0:1787338928.067029:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:2.0:1787338928.067067:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:2.0:1787338928.067099:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:2.0:1787338928.067146:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:2.0:1787338928.067183:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:2.0:1787338928.067230:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:2.0:1787338928.067340:0:19964:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf5b71c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4530016f-1c37-4f4c-b7ee-21f57031a048:19964:1874160212112512:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787338928.067441:0:19964:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338928.067469:0:19964:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbd8aaeb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787338928.067602:0:18556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212112512 00000100:00100000:3.0:1787338928.067609:0:18556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212112512 00000100:00100000:3.0:1787338928.067638:0:18556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787338928.067645:0:18556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc16a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4530016f-1c37-4f4c-b7ee-21f57031a048+17:19964:x1874160212112512:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787338928.067805:0:18556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc16a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4530016f-1c37-4f4c-b7ee-21f57031a048+17:19964:x1874160212112512:12345-0@lo:502:mount.lustre.0 Request processed in 160us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338928.067813:0:18556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787338928.067937:0:19964:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf5b71c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4530016f-1c37-4f4c-b7ee-21f57031a048:19964:1874160212112512:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787338928.068005:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:2.0:1787338928.068014:0:19964:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:3.0:1787338928.069320:0:19965:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787338928.069330:0:19965:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1787338928.069336:0:19965:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787338928.069339:0:19965:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1787338928.069345:0:19965:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787338928.069437:0:19965:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff90bbef8a8000) 00000020:00000080:3.0:1787338928.069462:0:19965:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787338928.069468:0:19965:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787338928.069600:0:19965:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90bbe826c000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1787338928.069608:0:19965:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787338928.069616:0:19965:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x83671231080c3063 00010000:00010000:2.0:1787338928.074812:0:19965:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:2.0:1787338928.075559:0:19965:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934598 00080000:10000000:2.0:1787338928.077666:0:19965:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xc:0x0] (8/8/4) registered 00000020:00000080:2.0:1787338928.079154:0:19965:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1787338928.079167:0:19965:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787338928.079174:0:19965:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787338928.079176:0:19965:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1787338928.079181:0:19965:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787338928.079184:0:19965:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787338928.079186:0:19965:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787338928.079189:0:19965:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787338928.079191:0:19965:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787338928.079193:0:19965:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787338928.079195:0:19965:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787338928.079197:0:19965:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787338928.079209:0:19965:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787338928.079211:0:19965:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787338928.079213:0:19965:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787338928.079216:0:19965:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1787338928.080604:0:19965:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787338928.080612:0:19965:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787338928.080614:0:19965:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787338928.080620:0:19965:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:0.0:1787338928.080788:0:19964:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1787338928.080814:0:19964:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.153@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1787338928.080846:0:19964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbf40e2400/0x83671231080c304e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c3055 expref: -99 pid: 19964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338928.080858:0:19964:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.153@tcp lock: ffff90bbf40e2400/0x83671231080c304e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c3055 expref: -99 pid: 19964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787338928.080867:0:19964:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90bbe826c000 from 1 10000000:01000000:0.0:1787338928.080869:0:19964:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787338928.080935:0:19964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbc0031a00/0x83671231080c306a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338928.080944:0:19964:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.153@tcp lock: ffff90bbc0031a00/0x83671231080c306a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338928.080955:0:19964:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.153@tcp lock: ffff90bbc0031a00/0x83671231080c306a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338928.080978:0:19964:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee083100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4530016f-1c37-4f4c-b7ee-21f57031a048:19964:1874160212112640:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787338928.081044:0:19964:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338928.082363:0:19964:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbd0ceae40 going to sleep for 11 seconds 00000100:00100000:3.0:1787338928.082704:0:18556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212112640 00000100:00100000:3.0:1787338928.082713:0:18556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212112640 00000100:00100000:3.0:1787338928.082817:0:18556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787338928.082827:0:18556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc168c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4530016f-1c37-4f4c-b7ee-21f57031a048+17:19964:x1874160212112640:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787338928.082842:0:18556:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787338928.082856:0:18556:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90bbffef5600/0x83671231080c3071 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x83671231080c306a expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338928.082905:0:18556:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bbffef5600/0x83671231080c3071 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x83671231080c306a expref: 18 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338928.082926:0:18556:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90bbffef5600/0x83671231080c3071 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c306a expref: 18 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338928.082935:0:18556:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbffef5600, rc 0) 00000100:00100000:3.0:1787338928.082990:0:18556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc168c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4530016f-1c37-4f4c-b7ee-21f57031a048+18:19964:x1874160212112640:12345-0@lo:101:mount.lustre.0 Request processed in 165us (1945us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338928.082997:0:18556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787338928.083080:0:19964:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee083100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4530016f-1c37-4f4c-b7ee-21f57031a048:19964:1874160212112640:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787338928.083097:0:19964:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.153@tcp lock: ffff90bbc0031a00/0x83671231080c306a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c3071 expref: -99 pid: 19964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338928.083106:0:19964:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.153@tcp lock: ffff90bbc0031a00/0x83671231080c306a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x83671231080c3071 expref: -99 pid: 19964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787338928.084437:0:19964:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000040:00080000:2.0:1787338928.085772:0:19964:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787338928.086585:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:2.0:1787338928.086641:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:2.0:1787338928.086685:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:2.0:1787338928.086739:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:2.0:1787338928.086775:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:2.0:1787338928.086833:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:2.0:1787338928.086870:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:2.0:1787338928.086940:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:2.0:1787338928.087014:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:2.0:1787338928.087022:0:19964:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 9 count 10 00000100:00100000:2.0:1787338928.087107:0:19964:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf5b71c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4530016f-1c37-4f4c-b7ee-21f57031a048:19964:1874160212112768:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787338928.087172:0:19964:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338928.091848:0:19964:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbff9b73c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787338928.092027:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212112768 00000100:00100000:0.0:1787338928.092037:0:18554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212112768 00000100:00100000:0.0:1787338928.092075:0:18554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787338928.092084:0:18554:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc169850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4530016f-1c37-4f4c-b7ee-21f57031a048+18:19964:x1874160212112768:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787338928.092397:0:18554:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc169850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4530016f-1c37-4f4c-b7ee-21f57031a048+18:19964:x1874160212112768:12345-0@lo:501:mount.lustre.0 Request processed in 312us (5222us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338928.092406:0:18554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787338928.092628:0:19964:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf5b71c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4530016f-1c37-4f4c-b7ee-21f57031a048:19964:1874160212112768:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787338928.092681:0:19964:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf5b71c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4530016f-1c37-4f4c-b7ee-21f57031a048:19964:1874160212112896:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787338928.092725:0:19964:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338928.092751:0:19964:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbff9b73c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787338928.092796:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212112896 00000100:00100000:0.0:1787338928.092799:0:18554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212112896 00000100:00100000:0.0:1787338928.092821:0:18554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787338928.092826:0:18554:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc169450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4530016f-1c37-4f4c-b7ee-21f57031a048+18:19964:x1874160212112896:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787338928.092987:0:18554:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc169450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4530016f-1c37-4f4c-b7ee-21f57031a048+18:19964:x1874160212112896:12345-0@lo:503:mount.lustre.0 Request processed in 159us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338928.092993:0:18554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787338928.093080:0:19964:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf5b71c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4530016f-1c37-4f4c-b7ee-21f57031a048:19964:1874160212112896:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787338928.093723:0:19964:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787338928.093783:0:19964:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf5b71c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4530016f-1c37-4f4c-b7ee-21f57031a048:19964:1874160212113024:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787338928.093828:0:19964:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338928.093862:0:19964:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbd87f60c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787338928.093996:0:18556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212113024 00000100:00100000:3.0:1787338928.094001:0:18556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212113024 00000100:00100000:3.0:1787338928.094033:0:18556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787338928.094041:0:18556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc16ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4530016f-1c37-4f4c-b7ee-21f57031a048+18:19964:x1874160212113024:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787338928.094204:0:18556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc16ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4530016f-1c37-4f4c-b7ee-21f57031a048+18:19964:x1874160212113024:12345-0@lo:502:mount.lustre.0 Request processed in 163us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338928.094210:0:18556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787338928.094471:0:19964:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf5b71c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4530016f-1c37-4f4c-b7ee-21f57031a048:19964:1874160212113024:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787338928.094723:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:2.0:1787338928.094768:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:2.0:1787338928.094809:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:2.0:1787338928.094846:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:2.0:1787338928.094944:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:2.0:1787338928.094994:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:2.0:1787338928.095027:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:2.0:1787338928.095054:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000100:00100000:2.0:1787338928.095083:0:19964:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf5b71c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4530016f-1c37-4f4c-b7ee-21f57031a048:19964:1874160212113152:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787338928.095133:0:19964:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338928.095169:0:19964:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbd87f60c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787338928.095448:0:18556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212113152 00000100:00100000:3.0:1787338928.095455:0:18556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212113152 00000100:00100000:3.0:1787338928.095503:0:18556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787338928.095512:0:18556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf4118c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4530016f-1c37-4f4c-b7ee-21f57031a048+18:19964:x1874160212113152:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787338928.095682:0:18556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf4118c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4530016f-1c37-4f4c-b7ee-21f57031a048+18:19964:x1874160212113152:12345-0@lo:502:mount.lustre.0 Request processed in 170us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338928.095696:0:18556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787338928.095864:0:19964:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf5b71c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4530016f-1c37-4f4c-b7ee-21f57031a048:19964:1874160212113152:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787338928.096045:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:2.0:1787338928.096056:0:19964:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1787338928.097470:0:19969:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787338928.097548:0:19969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787338928.097551:0:19969:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787338928.097558:0:19969:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90bbe826c000 00000020:00000080:0.0:1787338928.097560:0:19969:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787338928.097568:0:19969:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787338928.097570:0:19969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787338928.097572:0:19969:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1787338928.097574:0:19969:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787338928.097576:0:19969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787338928.097577:0:19969:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787338928.097580:0:19969:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90bbe826c000 00000020:00000080:0.0:1787338928.097582:0:19969:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787338928.097645:0:19969:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787338928.097648:0:19969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787338928.097649:0:19969:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1787338928.097651:0:19969:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787338928.097654:0:19969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787338928.097655:0:19969:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787338928.097658:0:19969:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90bbe826c000 00000020:00000080:0.0:1787338928.097660:0:19969:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787338928.097691:0:19969:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787338928.097694:0:19969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787338928.097696:0:19969:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1787338928.097699:0:19969:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 10 count 10 00000020:01000000:2.0:1787338928.103430:0:19964:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1787338928.103623:0:19964:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787338928.103650:0:19964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbc0031a00/0x83671231080c306a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c3071 expref: -99 pid: 19964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338928.103671:0:19964:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.153@tcp lock: ffff90bbc0031a00/0x83671231080c306a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c3071 expref: -99 pid: 19964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787338928.103721:0:19964:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787338928.103723:0:19964:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff90bbe826c000 10000000:01000000:2.0:1787338928.103727:0:19964:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff90bbe826c000 10000000:01000000:2.0:1787338928.103730:0:19964:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787338928.103736:0:19964:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90bbe826c000 from 1 10000000:01000000:2.0:1787338928.103739:0:19964:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787338928.103774:0:19964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbf40e2800/0x83671231080c3078 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338928.103783:0:19964:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.153@tcp lock: ffff90bbf40e2800/0x83671231080c3078 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338928.103795:0:19964:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.153@tcp lock: ffff90bbf40e2800/0x83671231080c3078 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338928.103820:0:19964:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf5b71c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4530016f-1c37-4f4c-b7ee-21f57031a048:19964:1874160212113280:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787338928.103935:0:19964:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338928.103973:0:19964:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbd87f6480 going to sleep for 11 seconds 00000100:00100000:3.0:1787338928.104038:0:18556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212113280 00000100:00100000:3.0:1787338928.104045:0:18556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212113280 00000100:00100000:3.0:1787338928.104095:0:18556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787338928.104104:0:18556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf4119850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4530016f-1c37-4f4c-b7ee-21f57031a048+18:19964:x1874160212113280:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787338928.104117:0:18556:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787338928.104129:0:18556:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90bbffef4800/0x83671231080c307f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x83671231080c3078 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338928.104154:0:18556:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bbffef4800/0x83671231080c307f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x83671231080c3078 expref: 19 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338928.104165:0:18556:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90bbffef4800/0x83671231080c307f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c3078 expref: 19 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338928.104173:0:18556:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbffef4800, rc 0) 00000100:00100000:3.0:1787338928.104209:0:18556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf4119850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4530016f-1c37-4f4c-b7ee-21f57031a048+19:19964:x1874160212113280:12345-0@lo:101:mount.lustre.0 Request processed in 106us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338928.104217:0:18556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787338928.105464:0:19964:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf5b71c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4530016f-1c37-4f4c-b7ee-21f57031a048:19964:1874160212113280:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787338928.105547:0:19964:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.153@tcp lock: ffff90bbf40e2800/0x83671231080c3078 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c307f expref: -99 pid: 19964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338928.105559:0:19964:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.153@tcp lock: ffff90bbf40e2800/0x83671231080c3078 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x83671231080c307f expref: -99 pid: 19964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787338928.106164:0:19964:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000040:00080000:2.0:1787338928.110040:0:19964:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787338928.111773:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:2.0:1787338928.111852:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:2.0:1787338928.111931:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:2.0:1787338928.111984:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:2.0:1787338928.112023:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:2.0:1787338928.112075:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:2.0:1787338928.112115:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:2.0:1787338928.112147:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:2.0:1787338928.112214:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:2.0:1787338928.114681:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:2.0:1787338928.114753:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:2.0:1787338928.114826:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:2.0:1787338928.114861:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:2.0:1787338928.115444:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:2.0:1787338928.115526:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:2.0:1787338928.115565:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:2.0:1787338928.115600:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:2.0:1787338928.115647:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:2.0:1787338928.115683:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:2.0:1787338928.115715:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:2.0:1787338928.115763:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:2.0:1787338928.115800:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:2.0:1787338928.115832:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:2.0:1787338928.115898:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:2.0:1787338928.115968:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 128 off12440 00000040:00080000:2.0:1787338928.115999:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12664 00000040:00080000:2.0:1787338928.116043:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12888 00000040:00080000:2.0:1787338928.116075:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off12968 00000040:00080000:2.0:1787338928.116109:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13192 00000040:00080000:2.0:1787338928.116168:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13416 00000040:00080000:2.0:1787338928.116205:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13504 00000040:00080000:2.0:1787338928.116256:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13632 00000040:00080000:2.0:1787338928.116290:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13776 00000040:00080000:2.0:1787338928.116354:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13904 00000040:00080000:2.0:1787338928.116392:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14128 00000040:00080000:2.0:1787338928.116456:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14352 00000040:00080000:2.0:1787338928.116496:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14432 00000040:00080000:2.0:1787338928.116529:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14656 00000040:00080000:2.0:1787338928.116574:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14880 00000040:00080000:2.0:1787338928.116609:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 120 off15000 00000040:00080000:2.0:1787338928.116719:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 224 off15224 00000040:00080000:2.0:1787338928.116728:0:19964:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 41 count 42 00000100:00100000:2.0:1787338928.116827:0:19964:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf5b71c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4530016f-1c37-4f4c-b7ee-21f57031a048:19964:1874160212113408:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787338928.116933:0:19964:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338928.116981:0:19964:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbd87f6480 going to sleep for 11 seconds 00000100:00100000:2.0:1787338928.121286:0:18557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212113408 00000100:00100000:2.0:1787338928.121356:0:18557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212113408 00000100:00100000:2.0:1787338928.121428:0:18557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787338928.121440:0:18557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbff90d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4530016f-1c37-4f4c-b7ee-21f57031a048+19:19964:x1874160212113408:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787338928.121842:0:18557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbff90d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4530016f-1c37-4f4c-b7ee-21f57031a048+19:19964:x1874160212113408:12345-0@lo:501:mount.lustre.0 Request processed in 402us (4907us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338928.121851:0:18557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787338928.121943:0:19964:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf5b71c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4530016f-1c37-4f4c-b7ee-21f57031a048:19964:1874160212113408:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787338928.121996:0:19964:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf5b71c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4530016f-1c37-4f4c-b7ee-21f57031a048:19964:1874160212113536:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787338928.122045:0:19964:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338928.122074:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212113536 00000100:00100000:2.0:1787338928.122078:0:18554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212113536 00000100:00100000:2.0:1787338928.122111:0:18554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787338928.122119:0:18554:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbff90c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4530016f-1c37-4f4c-b7ee-21f57031a048+19:19964:x1874160212113536:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787338928.123453:0:18554:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbff90c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4530016f-1c37-4f4c-b7ee-21f57031a048+19:19964:x1874160212113536:12345-0@lo:503:mount.lustre.0 Request processed in 1327us (1400us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338928.123465:0:18554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787338928.123604:0:19964:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbd87f6480 going to sleep for 11 seconds 00000100:00100000:3.0:1787338928.123628:0:19964:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf5b71c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4530016f-1c37-4f4c-b7ee-21f57031a048:19964:1874160212113536:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787338928.127016:0:19964:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787338928.127113:0:19964:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbedcb5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4530016f-1c37-4f4c-b7ee-21f57031a048:19964:1874160212113664:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787338928.127197:0:19964:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338928.127647:0:18556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212113664 00000100:00100000:2.0:1787338928.127656:0:18556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212113664 00000100:00100000:2.0:1787338928.127709:0:18556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787338928.127719:0:18556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbff90e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4530016f-1c37-4f4c-b7ee-21f57031a048+19:19964:x1874160212113664:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787338928.127986:0:18556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbff90e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4530016f-1c37-4f4c-b7ee-21f57031a048+19:19964:x1874160212113664:12345-0@lo:502:mount.lustre.0 Request processed in 268us (788us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338928.127994:0:18556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787338928.130424:0:19964:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc7c849c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787338928.130471:0:19964:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbedcb5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4530016f-1c37-4f4c-b7ee-21f57031a048:19964:1874160212113664:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787338928.130828:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:3.0:1787338928.130905:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:3.0:1787338928.130956:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:3.0:1787338928.131002:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:3.0:1787338928.131034:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:3.0:1787338928.131076:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:3.0:1787338928.131107:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:3.0:1787338928.131136:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:3.0:1787338928.131181:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:3.0:1787338928.131215:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:3.0:1787338928.133447:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:3.0:1787338928.134017:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:3.0:1787338928.134056:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:3.0:1787338928.134092:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:3.0:1787338928.134140:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:3.0:1787338928.134175:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:3.0:1787338928.134205:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:3.0:1787338928.134996:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:3.0:1787338928.135050:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:3.0:1787338928.135083:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:3.0:1787338928.135125:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:3.0:1787338928.135158:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:3.0:1787338928.135189:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:3.0:1787338928.136452:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:3.0:1787338928.136594:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 128 off12440 00000040:00080000:3.0:1787338928.136631:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12664 00000040:00080000:3.0:1787338928.136680:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12888 00000040:00080000:3.0:1787338928.136716:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off12968 00000040:00080000:3.0:1787338928.136753:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13192 00000040:00080000:3.0:1787338928.136804:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13416 00000040:00080000:3.0:1787338928.136839:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13504 00000040:00080000:3.0:1787338928.136889:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13632 00000040:00080000:3.0:1787338928.136949:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13776 00000040:00080000:3.0:1787338928.136999:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13904 00000040:00080000:3.0:1787338928.137034:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14128 00000040:00080000:3.0:1787338928.137080:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14352 00000040:00080000:3.0:1787338928.137111:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14432 00000040:00080000:3.0:1787338928.137138:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14656 00000040:00080000:3.0:1787338928.137179:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14880 00000040:00080000:3.0:1787338928.137229:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 120 off15000 00000100:00100000:3.0:1787338928.138008:0:19964:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbedcb5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4530016f-1c37-4f4c-b7ee-21f57031a048:19964:1874160212113792:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787338928.138093:0:19964:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338928.138141:0:19964:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc7c849c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787338928.138223:0:18557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212113792 00000100:00100000:2.0:1787338928.138231:0:18557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212113792 00000100:00100000:2.0:1787338928.138595:0:18557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787338928.138605:0:18557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbff90c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4530016f-1c37-4f4c-b7ee-21f57031a048+19:19964:x1874160212113792:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787338928.138924:0:18557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbff90c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4530016f-1c37-4f4c-b7ee-21f57031a048+19:19964:x1874160212113792:12345-0@lo:502:mount.lustre.0 Request processed in 319us (830us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338928.138932:0:18557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787338928.142680:0:19964:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbedcb5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4530016f-1c37-4f4c-b7ee-21f57031a048:19964:1874160212113792:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787338928.143014:0:19964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 224 off15224 00000040:00080000:2.0:1787338928.143030:0:19964:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1787338928.150749:0:19974:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1787338928.150767:0:19974:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff90bbd1730000) 00000020:00000080:2.0:1787338928.150790:0:19974:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:2.0:1787338928.151227:0:19974:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90bbe826c000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787338928.151543:0:19974:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90bbe826c000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787338928.151548:0:19974:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90bbe826c000 3 00010000:00080000:2.0:1787338928.151591:0:19974:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90bac1bf5000@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.153@tcp at head 00010000:00010000:2.0:1787338928.153799:0:19974:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:2.0:1787338928.154147:0:19974:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1787338928.154185:0:19974:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787338928.154198:0:19974:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x83671231080c308d 00000100:00080000:2.0:1787338928.154208:0:19974:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787338928.154214:0:19974:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff90bac1bf5000 using connection 192.168.201.153@tcp/0@lo 00000100:00100000:2.0:1787338928.154387:0:19974:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90bbf5b73b80 x1874160212113920/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787338928.154414:0:19974:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787338928.154448:0:13151:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787338928.154452:0:13151:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787338928.154454:0:13151:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787338928.154457:0:13151:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787338928.154582:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf5b73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1874160212114176:0@lo:400:kworker.0 00000100:00100000:2.0:1787338928.154650:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338928.154687:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787338928.154694:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf5b71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874160212114048:0@lo:400:kworker.0 00000100:00100000:2.0:1787338928.154715:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338928.154813:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf5b73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3313:1874160212113920:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787338928.154846:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338928.154973:0:18562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212114176 00000100:00100000:2.0:1787338928.154980:0:18562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212114176 00000100:00100000:2.0:1787338928.155035:0:18562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212114048 00000100:00100000:2.0:1787338928.155038:0:18562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212114048 00000100:00100000:2.0:1787338928.155051:0:18562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212113920 00000100:00100000:2.0:1787338928.155054:0:18562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212113920 00000100:00100000:2.0:1787338928.155067:0:18562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787338928.155077:0:18562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf5b71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874160212114176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787338928.155154:0:18562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf5b71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874160212114176:12345-0@lo:400:kworker.0 Request processed in 78us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338928.155162:0:18562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787338928.155179:0:18562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787338928.155184:0:18562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf5b70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874160212114048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787338928.155209:0:18562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf5b70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874160212114048:12345-0@lo:400:kworker.0 Request processed in 25us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338928.155214:0:18562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787338928.155226:0:18562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787338928.155230:0:18562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbedcb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3313:x1874160212113920:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787338928.155619:0:18562:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 580 last 0 00000020:00000080:2.0:1787338928.155660:0:18562:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x83671231080c3094 00000004:00100000:2.0:1787338928.155677:0:18562:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787338928.155707:0:18562:0:(import.c:65:import_set_state_nolock()) ffff90bac2391000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787338928.155757:0:18562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbedcb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874160212113920:12345-0@lo:38:llog_process_th.0 Request processed in 525us (909us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338928.155764:0:18562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787338928.155800:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90bbf5b71500 x1874160212114048/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787338944 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787338928.155815:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf5b71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874160212114048:0@lo:400:kworker.0 00010000:00080000:2.0:1787338928.155827:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90bbf5b73480 x1874160212114176/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787338944 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787338928.155836:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf5b73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1874160212114176:0@lo:400:kworker.0 00000100:00080000:3.0:1787338928.155990:0:18558:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:2.0:1787338928.156267:0:19974:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 42 count 42 00000020:01000000:2.0:1787338928.156789:0:19964:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1787338928.156819:0:19964:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787338928.156842:0:19964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbf40e2800/0x83671231080c3078 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c307f expref: -99 pid: 19964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338928.156854:0:19964:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.153@tcp lock: ffff90bbf40e2800/0x83671231080c3078 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c307f expref: -99 pid: 19964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787338928.156936:0:19964:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787338928.156938:0:19964:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787338928.156940:0:19964:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787338928.156941:0:19964:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787338928.156942:0:19964:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787338928.156944:0:19964:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787338928.156946:0:19964:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787338928.156948:0:19964:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787338928.156950:0:19964:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787338928.156953:0:19964:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1787338928.156956:0:19964:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787338928.156957:0:19964:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787338928.156958:0:19964:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787338928.156959:0:19964:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787338928.156960:0:19964:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787338928.156961:0:19964:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787338928.156962:0:19964:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787338928.156963:0:19964:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787338928.156964:0:19964:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787338928.156986:0:19964:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787338928.157002:0:19964:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf5b73480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4530016f-1c37-4f4c-b7ee-21f57031a048:19964:1874160212114304:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787338928.157056:0:19964:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338928.157089:0:19964:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc61b8b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787338928.157111:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212114304 00000100:00100000:2.0:1787338928.157116:0:18554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212114304 00000100:00100000:2.0:1787338928.157151:0:18554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787338928.157159:0:18554:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbff90fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4530016f-1c37-4f4c-b7ee-21f57031a048+19:19964:x1874160212114304:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787338928.157201:0:18554:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1787338928.157215:0:18554:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:0.0:1787338928.157501:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90bbf5b73b80 x1874160212113920/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787338938 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787338928.157512:0:3313:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787338928.157519:0:3313:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:0.0:1787338928.157526:0:3313:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787338928.157531:0:3313:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787338928.157533:0:3313:0:(import.c:65:import_set_state_nolock()) ffff90bac1bf5000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787338928.157540:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf5b73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3313:1874160212113920:0@lo:38:llog_process_th.0 20000000:01000000:3.0:1787338928.198690:0:18554:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787338928.198711:0:18554:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1787338928.200331:0:18578:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787338928.200339:0:18578:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787338928.200361:0:18578:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90bbc0030a00/0x83671231080c309b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338928.200379:0:18578:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90bbfbe9d600/0x83671231080c3039 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c3032 expref: 19 pid: 18557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338928.200388:0:18578:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90bbc0030a00/0x83671231080c309b lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338928.200430:0:18578:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90bbfbe9d600/0x83671231080c3039 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x83671231080c3032 expref: 19 pid: 18557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338928.200443:0:18578:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90bbfbe9d600/0x83671231080c3039 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x83671231080c3032 expref: 19 pid: 18557 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338928.200457:0:18578:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee082d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:18578:1874160212114432:0@lo:104: 00000100:00100000:0.0:1787338928.200532:0:18578:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338928.200584:0:18578:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbf7e2eb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787338928.200761:0:18545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212114432 00000100:00100000:3.0:1787338928.200768:0:18545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212114432 00000100:00100000:3.0:1787338928.200818:0:18545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787338928.200828:0:18545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee081c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4530016f-1c37-4f4c-b7ee-21f57031a048+3:18578:x1874160212114432:12345-0@lo:104: 00010000:00010000:3.0:1787338928.200841:0:18545:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.153@tcp lock: ffff90bbc0030200/0x83671231080c3032 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x83671231080c3039 expref: -99 pid: 18559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338928.200932:0:18545:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787338928.200939:0:18545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee081c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4530016f-1c37-4f4c-b7ee-21f57031a048+3:18578:x1874160212114432:12345-0@lo:104: Request processed in 113us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338928.200946:0:18545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1787338928.200968:0:18551:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787338928.200973:0:18551:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.153@tcp lock: ffff90bbc0030200/0x83671231080c3032 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x83671231080c3039 expref: -99 pid: 18559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338928.200987:0:18551:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbc0030200 already unused, calling callback (ffffffffc1b2ec20) 10000000:00010000:3.0:1787338928.200991:0:18551:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.153@tcp lock: ffff90bbc0030200/0x83671231080c3032 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x83671231080c3039 expref: -99 pid: 18559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338928.200999:0:18551:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.153@tcp lock: ffff90bbc0030200/0x83671231080c3032 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x83671231080c3039 expref: -99 pid: 18559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787338928.201006:0:18551:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.153@tcp lock: ffff90bbc0030200/0x83671231080c3032 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x83671231080c3039 expref: -99 pid: 18559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787338928.201011:0:18551:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787338928.201040:0:18551:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.153@tcp lock: ffff90bbc0030200/0x83671231080c3032 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c3039 expref: -99 pid: 18559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338928.201046:0:18551:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787338928.201064:0:18551:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.153@tcp lock: ffff90bbc0030200/0x83671231080c3032 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c3039 expref: -99 pid: 18559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338928.201070:0:18551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.153@tcp lock: ffff90bbc0030200/0x83671231080c3032 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c3039 expref: -99 pid: 18559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338928.201087:0:18551:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338928.201089:0:18551:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338928.201091:0:18551:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787338928.201098:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787338928.201109:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbedcb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4530016f-1c37-4f4c-b7ee-21f57031a048:3317:1874160212114560:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787338928.201138:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338928.201352:0:18578:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee082d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:18578:1874160212114432:0@lo:104: 00010000:00010000:0.0:1787338928.201373:0:18578:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90bbc0030a00/0x83671231080c309b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338928.202565:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212114560 00000100:00100000:2.0:1787338928.202574:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212114560 00010000:00010000:2.0:1787338928.202601:0:18547:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90bbfbe9d600/0x83671231080c3039 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x83671231080c3032 expref: 20 pid: 18557 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338928.202628:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787338928.202637:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbedcb6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4530016f-1c37-4f4c-b7ee-21f57031a048+20:3317:x1874160212114560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787338928.202650:0:18547:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787338928.202656:0:18547:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90bbfbe9d600/0x83671231080c3039 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x83671231080c3032 expref: 20 pid: 18557 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338928.202666:0:18547:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90bbfbe9d600/0x83671231080c3039 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x83671231080c3032 expref: 20 pid: 18557 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338928.202683:0:18547:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90bbfbe9d600/0x83671231080c3039 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x83671231080c3032 expref: 20 pid: 18557 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338928.202699:0:18547:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90bbc0030a00/0x83671231080c309b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338928.202706:0:18547:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bbc0030a00/0x83671231080c309b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787338928.202720:0:18547:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002382414s 00010000:00010000:2.0:1787338928.202725:0:18547:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90bbc0030a00/0x83671231080c309b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338928.202731:0:18547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90bbc0030a00/0x83671231080c309b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338928.202750:0:18547:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90bbc0030a00/0x83671231080c309b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338928.202756:0:18547:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90bbc0030a00/0x83671231080c309b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338928.202761:0:18547:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbc0030a00 already unused, calling callback (ffffffffc1546230) 00010000:00010000:2.0:1787338928.202766:0:18547:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90bbc0030a00/0x83671231080c309b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338928.202773:0:18547:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90bbc0030a00/0x83671231080c309b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338928.202788:0:18547:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90bbc0030a00/0x83671231080c309b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338928.202798:0:18547:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787338928.202854:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbedcb6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4530016f-1c37-4f4c-b7ee-21f57031a048+19:3317:x1874160212114560:12345-0@lo:103:ldlm_bl.0 Request processed in 218us (1714us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338928.202861:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1787338928.202917:0:18578:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90bbc0030a00/0x83671231080c309b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338928.202926:0:18578:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90bbc0030a00/0x83671231080c309b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338928.202933:0:18578:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90bbc0030a00/0x83671231080c309b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338928.202969:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbedcb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4530016f-1c37-4f4c-b7ee-21f57031a048:3317:1874160212114560:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787338928.206530:0:18554:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbff90fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4530016f-1c37-4f4c-b7ee-21f57031a048+18:19964:x1874160212114304:12345-0@lo:253:mount.lustre.0 Request processed in 49362us (49464us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338928.206546:0:18554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787338928.206711:0:19964:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf5b73480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4530016f-1c37-4f4c-b7ee-21f57031a048:19964:1874160212114304:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787338928.206741:0:19964:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1787338928.206745:0:19964:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787338928.206746:0:19964:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787338928.206748:0:19964:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787338928.206749:0:19964:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787338928.206750:0:19964:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787338928.206751:0:19964:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787338928.206753:0:19964:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787338928.206755:0:19964:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787338928.206756:0:19964:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787338928.206772:0:19964:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787338928.207206:0:19964:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1787338928.207621:0:19964:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787338928.207782:0:19964:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1787338928.207994:0:19964:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787338928.208134:0:19964:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1787338928.208396:0:19964:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1787338928.209733:0:19964:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:0.0:1787338928.263858:0:19964:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1787338928.263867:0:19964:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1787338928.263932:0:19964:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787338928.263988:0:19964:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.153@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787338928.264002:0:19964:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1787338928.264033:0:19964:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1787338928.758086:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787338929.216467:0:3313:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787338914/real 1787338914] req@ffff90bbedcb4a80 x1874160212107392/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787338929 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787338929.216500:0:3313:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90bbedcb4a80 x1874160212107392/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787338929 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787338929.216512:0:3313:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787338914/real 1787338914] req@ffff90bbedcb4e00 x1874160212107520/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787338929 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787338929.216525:0:3313:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90bbedcb4e00 x1874160212107520/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787338929 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787338929.216544:0:3313:0:(import.c:65:import_set_state_nolock()) ffff90bbd888e800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787338929.216606:0:3313:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787338929.216620:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbedcb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1874160212107392:0@lo:8:kworker.0 00000100:00080000:3.0:1787338929.216626:0:3313:0:(import.c:65:import_set_state_nolock()) ffff90bbc2e83000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787338929.217723:0:13151:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787338929.217728:0:13151:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1787338929.217731:0:13151:0:(import.c:65:import_set_state_nolock()) ffff90bbd888e800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787338929.217737:0:13151:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 567 00000100:00080000:2.0:1787338929.217743:0:13151:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787338929.217750:0:13151:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff90bbd888e800 using connection 192.168.201.153@tcp/0@lo 00000100:00100000:2.0:1787338929.217772:0:13151:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90bbf5b71180 x1874160212114816/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787338929.217783:0:13151:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787338929.217786:0:13151:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787338929.217788:0:13151:0:(import.c:65:import_set_state_nolock()) ffff90bbc2e83000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787338929.217791:0:13151:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 567 00000100:00080000:2.0:1787338929.217793:0:13151:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787338929.217797:0:13151:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff90bbc2e83000 using connection 192.168.201.153@tcp/0@lo 00000100:00100000:2.0:1787338929.217808:0:13151:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90bbf5b72680 x1874160212114944/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787338929.217867:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf5b71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4530016f-1c37-4f4c-b7ee-21f57031a048:3317:1874160212114688:0@lo:400:kworker.0 00000100:00100000:2.0:1787338929.217980:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338929.218029:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787338929.218035:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf5b72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1874160212115328:0@lo:400:kworker.0 00000100:00100000:2.0:1787338929.218418:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338929.218495:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf5b73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1874160212115200:0@lo:400:kworker.0 00000100:00100000:2.0:1787338929.218521:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338929.218543:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787338929.218548:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf5b70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874160212115072:0@lo:400:kworker.0 00000100:00100000:2.0:1787338929.218568:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338929.220102:0:18562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212115328 00000100:00100000:0.0:1787338929.220112:0:18562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212115328 00000100:00100000:0.0:1787338929.220175:0:18562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212115200 00000100:00100000:0.0:1787338929.220178:0:18562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212115200 00000100:00100000:0.0:1787338929.220188:0:18562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212115072 00000100:00100000:0.0:1787338929.220190:0:18562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212115072 00000100:00100000:0.0:1787338929.220205:0:18562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787338929.220213:0:18562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf5b70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1874160212115328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787338929.220286:0:18562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf5b70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1874160212115328:12345-0@lo:400:kworker.0 Request processed in 73us (1867us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338929.220292:0:18562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787338929.220309:0:18562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787338929.220315:0:18562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf5b72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874160212115200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787338929.220349:0:18562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf5b72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874160212115200:12345-0@lo:400:kworker.0 Request processed in 34us (1827us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338929.220355:0:18562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787338929.220367:0:18562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787338929.220373:0:18562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf5b70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874160212115072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787338929.220399:0:18562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf5b70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874160212115072:12345-0@lo:400:kworker.0 Request processed in 27us (1831us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338929.220413:0:18562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1787338929.220455:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbf5b72a00 x1874160212115328/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787338945 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787338929.220470:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf5b72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1874160212115328:0@lo:400:kworker.0 00010000:00080000:0.0:1787338929.220506:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbf5b70700 x1874160212115072/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787338945 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787338929.220516:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf5b70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874160212115072:0@lo:400:kworker.0 00010000:00080000:0.0:1787338929.220543:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbf5b73100 x1874160212115200/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787338945 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787338929.220551:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf5b73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1874160212115200:0@lo:400:kworker.0 00000100:00080000:3.0:1787338929.221133:0:3313:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787338929.221141:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbedcb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1874160212107520:0@lo:8:kworker.0 00000100:00080000:3.0:1787338929.221169:0:18558:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787338929.221191:0:18556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212114688 00000100:00100000:3.0:1787338929.221196:0:18556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212114688 00000100:00100000:3.0:1787338929.221232:0:18556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787338929.221240:0:18556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbff90f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4530016f-1c37-4f4c-b7ee-21f57031a048+18:3317:x1874160212114688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787338929.221290:0:18556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbff90f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4530016f-1c37-4f4c-b7ee-21f57031a048+18:3317:x1874160212114688:12345-0@lo:400:kworker.0 Request processed in 51us (3320us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338929.221297:0:18556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787338929.221331:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf5b71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1874160212114816:0@lo:8:kworker.0 00000100:00100000:3.0:1787338929.221364:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338929.221384:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf5b72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1874160212114944:0@lo:8:kworker.0 00000100:00100000:3.0:1787338929.221408:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338929.222176:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf5b71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4530016f-1c37-4f4c-b7ee-21f57031a048:3317:1874160212114688:0@lo:400:kworker.0 00000100:00100000:0.0:1787338929.222210:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212114816 00000100:00100000:0.0:1787338929.222215:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212114816 00000100:00100000:0.0:1787338929.222239:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212114944 00000100:00100000:0.0:1787338929.222242:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212114944 00000100:00100000:0.0:1787338929.222253:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787338929.222258:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbedcb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3313:x1874160212114816:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1787338929.222281:0:19246:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 582 last 0 00000020:00000080:0.0:1787338929.222307:0:19246:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x83671231080c30a2 00002000:00100000:0.0:1787338929.222320:0:19246:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff90bac122a800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211392c ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1787338929.222324:0:19246:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1787338929.222327:0:19246:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787338929.222659:0:19246:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787338929.222694:0:19246:0:(import.c:65:import_set_state_nolock()) ffff90bac122f000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787338929.222769:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbedcb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3313:x1874160212114816:12345-0@lo:8:kworker.0 Request processed in 507us (1402us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338929.222777:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787338929.222794:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787338929.222799:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbedcb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3313:x1874160212114944:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1787338929.222812:0:19246:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 582 last 0 00000020:00000080:0.0:1787338929.222826:0:19246:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x83671231080c30a9 00002000:00100000:0.0:1787338929.222832:0:19246:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff90bac122d000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211392c ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1787338929.222835:0:19246:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1787338929.222837:0:19246:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00010000:00080000:1.0:1787338929.224177:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbf5b71180 x1874160212114816/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787338949 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787338929.224192:0:3313:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787338929.224201:0:3313:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:1.0:1787338929.224209:0:3313:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787338929.224214:0:3313:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1787338929.224218:0:3313:0:(import.c:65:import_set_state_nolock()) ffff90bbd888e800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787338929.224239:0:3313:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787338929.224246:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf5b71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1874160212114816:0@lo:8:kworker.0 00000004:00080000:1.0:1787338929.224259:0:18584:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787338929.224524:0:18584:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 582065649440ns, next at 0ns, rc = 0 00000004:00080000:3.0:1787338929.225199:0:18585:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x22:0x0] 00000100:00100000:3.0:1787338929.225224:0:18585:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbedcb7100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:18585:1874160212115584:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1787338929.225280:0:18585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338929.225304:0:18585:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbd16493c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787338929.225528:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787338929.225540:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbedcb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874160212115456:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787338929.225569:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338929.225601:0:19248:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1787338929.225608:0:19248:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1787338929.225783:0:19248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212115584 00000100:00100000:3.0:1787338929.225798:0:19248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212115584 00000100:00080000:3.0:1787338929.225848:0:18558:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787338929.225939:0:20031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787338929.225948:0:20031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbedcb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:18585:x1874160212115584:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1787338929.226222:0:19246:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787338929.226252:0:19246:0:(import.c:65:import_set_state_nolock()) ffff90bac122c000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787338929.226305:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbedcb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3313:x1874160212114944:12345-0@lo:8:kworker.0 Request processed in 3505us (4896us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338929.226313:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787338929.226482:0:19249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212115456 00000100:00100000:1.0:1787338929.226488:0:19249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212115456 00000100:00100000:1.0:1787338929.226520:0:19249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787338929.226529:0:19249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbedcb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3316:x1874160212115456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787338929.226555:0:19249:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787338929.226599:0:19249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbedcb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3316:x1874160212115456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (1029us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338929.226607:0:19249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787338929.226650:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbedcb5c00 x1874160212115456/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787338945 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787338929.226688:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbedcb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874160212115456:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1787338929.226727:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbf5b72680 x1874160212114944/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787338949 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787338929.226737:0:3313:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787338929.226744:0:3313:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:1.0:1787338929.226754:0:3313:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787338929.226760:0:3313:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1787338929.226762:0:3313:0:(import.c:65:import_set_state_nolock()) ffff90bbc2e83000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787338929.226784:0:3313:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787338929.226790:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf5b72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1874160212114944:0@lo:8:kworker.0 00000004:00080000:1.0:1787338929.226834:0:18587:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x22:0x0] 00000100:00100000:1.0:1787338929.226850:0:18587:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf7ed7b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:18587:1874160212115840:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1787338929.226909:0:18587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338929.226929:0:18587:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc7c24840 going to sleep for 11 seconds 00000100:00100000:1.0:1787338929.226945:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf7ed5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874160212115712:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787338929.226968:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1787338929.228201:0:18586:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787338929.228516:0:18586:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 582069641573ns, next at 0ns, rc = 0 00000100:00100000:1.0:1787338929.229218:0:19248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212115840 00000100:00100000:1.0:1787338929.229226:0:19248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212115840 00000100:00100000:1.0:1787338929.229280:0:19248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787338929.229291:0:19248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf7ed5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:18587:x1874160212115840:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1787338929.240939:0:19248:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1787338929.240951:0:19248:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:1.0:1787338929.240957:0:19248:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:35 to 0x280000400:65) 00002000:00080000:3.0:1787338929.241966:0:20031:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1787338929.244135:0:20031:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:3.0:1787338929.244141:0:20031:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:35 to 0x240000400:65) 00000100:00100000:1.0:1787338929.251772:0:19249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212115712 00000100:00100000:1.0:1787338929.251806:0:19249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212115712 00000100:00100000:1.0:1787338929.251870:0:19249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787338929.251918:0:19249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf7ed7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1874160212115712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787338929.251959:0:19249:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787338929.252043:0:19249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf7ed7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1874160212115712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 127us (25073us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338929.252051:0:19249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1787338929.252072:0:18558:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787338929.252116:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbf7ed5880 x1874160212115712/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787338945 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787338929.252138:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf7ed5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874160212115712:0@lo:13:osp-pre-1-0.0 00002000:00010000:1.0:1787338929.252574:0:19248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787338929.252584:0:19248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036bdb84e/0x83671231080c30b0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.252602:0:19248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x41:0x0].0x0 since=582s v=(0 0) 00010000:00010000:1.0:1787338929.252606:0:19248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787338929.252613:0:19248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000036bdb84e/0x83671231080c30b0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.252632:0:19248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000036bdb84e/0x83671231080c30b0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.252643:0:19248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036bdb84e/0x83671231080c30b0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.252651:0:19248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000036bdb84e/0x83671231080c30b0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.252688:0:19248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787338929.259128:0:18551:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787338929.259143:0:18551:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000036bdb84e/0x83671231080c30b0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338929.259158:0:18551:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbfbe9de00 already unused, calling callback (ffffffffc1546230) 00010000:00010000:2.0:1787338929.259164:0:18551:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000036bdb84e/0x83671231080c30b0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338929.259176:0:18551:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000036bdb84e/0x83671231080c30b0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338929.259201:0:18551:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000036bdb84e/0x83671231080c30b0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338929.259209:0:18551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000036bdb84e/0x83671231080c30b0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338929.259231:0:18551:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787338929.259232:0:18551:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787338929.259234:0:18551:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787338929.259756:0:19248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787338929.259764:0:19248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ba203ef/0x83671231080c30b7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.259776:0:19248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x40:0x0].0x0 since=582s v=(0 0) 00010000:00010000:1.0:1787338929.259781:0:19248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787338929.259787:0:19248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004ba203ef/0x83671231080c30b7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.259800:0:19248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004ba203ef/0x83671231080c30b7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.259810:0:19248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ba203ef/0x83671231080c30b7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.259818:0:19248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004ba203ef/0x83671231080c30b7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.259849:0:19248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787338929.261495:0:18550:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787338929.261507:0:18550:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004ba203ef/0x83671231080c30b7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338929.261534:0:18550:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbfbe9d600 already unused, calling callback (ffffffffc1546230) 00010000:00010000:2.0:1787338929.261538:0:18550:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004ba203ef/0x83671231080c30b7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338929.261548:0:18550:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004ba203ef/0x83671231080c30b7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338929.261568:0:18550:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004ba203ef/0x83671231080c30b7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338929.261574:0:18550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004ba203ef/0x83671231080c30b7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338929.261595:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787338929.261597:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787338929.261599:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787338929.265617:0:19248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787338929.265631:0:19248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000578f476e/0x83671231080c30be lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.265647:0:19248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3f:0x0].0x0 since=582s v=(0 0) 00010000:00010000:1.0:1787338929.265658:0:19248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787338929.265665:0:19248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000578f476e/0x83671231080c30be lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.265679:0:19248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000578f476e/0x83671231080c30be lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.265690:0:19248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000578f476e/0x83671231080c30be lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.265698:0:19248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000578f476e/0x83671231080c30be lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.265718:0:19248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787338929.265730:0:18551:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787338929.265736:0:18551:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000578f476e/0x83671231080c30be lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.265744:0:18551:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbfbe9d000 already unused, calling callback (ffffffffc1546230) 00010000:00010000:1.0:1787338929.265749:0:18551:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000578f476e/0x83671231080c30be lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.265758:0:18551:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000578f476e/0x83671231080c30be lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.265773:0:18551:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000578f476e/0x83671231080c30be lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.265791:0:18551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000578f476e/0x83671231080c30be lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.265808:0:18551:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338929.265810:0:18551:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338929.265811:0:18551:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787338929.269830:0:19248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787338929.269844:0:19248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b60a6430/0x83671231080c30c5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.269861:0:19248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3e:0x0].0x0 since=582s v=(0 0) 00010000:00010000:1.0:1787338929.269866:0:19248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787338929.269917:0:19248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b60a6430/0x83671231080c30c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.269933:0:19248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b60a6430/0x83671231080c30c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.269944:0:19248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b60a6430/0x83671231080c30c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.269952:0:19248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b60a6430/0x83671231080c30c5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.272898:0:19248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787338929.272922:0:18550:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787338929.272938:0:18550:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b60a6430/0x83671231080c30c5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.272951:0:18550:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbfbe9da00 already unused, calling callback (ffffffffc1546230) 00010000:00010000:1.0:1787338929.272955:0:18550:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b60a6430/0x83671231080c30c5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.272966:0:18550:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b60a6430/0x83671231080c30c5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.274139:0:18550:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b60a6430/0x83671231080c30c5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.274149:0:18550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b60a6430/0x83671231080c30c5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.274171:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338929.274174:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338929.274176:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787338929.278504:0:19248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787338929.278517:0:19248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000afd2d83a/0x83671231080c30cc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.278533:0:19248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3d:0x0].0x0 since=582s v=(0 0) 00010000:00010000:1.0:1787338929.278538:0:19248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787338929.278557:0:19248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000afd2d83a/0x83671231080c30cc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.278584:0:19248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000afd2d83a/0x83671231080c30cc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.278595:0:19248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000afd2d83a/0x83671231080c30cc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.278604:0:19248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000afd2d83a/0x83671231080c30cc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.278622:0:19248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787338929.278633:0:18551:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787338929.278638:0:18551:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000afd2d83a/0x83671231080c30cc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.278646:0:18551:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbfbe9c600 already unused, calling callback (ffffffffc1546230) 00010000:00010000:1.0:1787338929.278650:0:18551:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000afd2d83a/0x83671231080c30cc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.278660:0:18551:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000afd2d83a/0x83671231080c30cc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.278676:0:18551:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000afd2d83a/0x83671231080c30cc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.278683:0:18551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000afd2d83a/0x83671231080c30cc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.278709:0:18551:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338929.278710:0:18551:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338929.278712:0:18551:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787338929.279196:0:19248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787338929.279203:0:19248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007e681ccb/0x83671231080c30d3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.279211:0:19248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3c:0x0].0x0 since=582s v=(0 0) 00010000:00010000:1.0:1787338929.279215:0:19248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787338929.279219:0:19248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007e681ccb/0x83671231080c30d3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.279228:0:19248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007e681ccb/0x83671231080c30d3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.279236:0:19248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007e681ccb/0x83671231080c30d3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.279242:0:19248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007e681ccb/0x83671231080c30d3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.279256:0:19248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787338929.279264:0:18550:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787338929.279268:0:18550:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007e681ccb/0x83671231080c30d3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.279285:0:18550:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbfbe9c200 already unused, calling callback (ffffffffc1546230) 00010000:00010000:1.0:1787338929.279288:0:18550:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007e681ccb/0x83671231080c30d3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.279296:0:18550:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007e681ccb/0x83671231080c30d3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.279307:0:18550:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007e681ccb/0x83671231080c30d3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.279315:0:18550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007e681ccb/0x83671231080c30d3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.279328:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338929.279330:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338929.279331:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787338929.279716:0:19248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787338929.279723:0:19248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003146de23/0x83671231080c30da lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.279731:0:19248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3b:0x0].0x0 since=582s v=(0 0) 00010000:00010000:1.0:1787338929.279734:0:19248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787338929.279738:0:19248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003146de23/0x83671231080c30da lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.279748:0:19248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003146de23/0x83671231080c30da lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.279762:0:19248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003146de23/0x83671231080c30da lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.279769:0:19248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003146de23/0x83671231080c30da lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.279782:0:19248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787338929.279790:0:18551:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787338929.279794:0:18551:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003146de23/0x83671231080c30da lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.279801:0:18551:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbfbe9d400 already unused, calling callback (ffffffffc1546230) 00010000:00010000:1.0:1787338929.279804:0:18551:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003146de23/0x83671231080c30da lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.279812:0:18551:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003146de23/0x83671231080c30da lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.279823:0:18551:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003146de23/0x83671231080c30da lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.279830:0:18551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003146de23/0x83671231080c30da lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.279844:0:18551:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338929.279851:0:18551:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338929.279853:0:18551:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787338929.280279:0:19248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787338929.280285:0:19248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b18d103/0x83671231080c30e1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.280293:0:19248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3a:0x0].0x0 since=582s v=(0 0) 00010000:00010000:1.0:1787338929.280297:0:19248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787338929.280301:0:19248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007b18d103/0x83671231080c30e1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.280311:0:19248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007b18d103/0x83671231080c30e1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.280318:0:19248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b18d103/0x83671231080c30e1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.280325:0:19248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007b18d103/0x83671231080c30e1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.280339:0:19248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787338929.280347:0:18550:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787338929.280350:0:18550:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007b18d103/0x83671231080c30e1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.280357:0:18550:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbfbe9d200 already unused, calling callback (ffffffffc1546230) 00010000:00010000:1.0:1787338929.280360:0:18550:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007b18d103/0x83671231080c30e1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.280378:0:18550:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007b18d103/0x83671231080c30e1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.280389:0:18550:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007b18d103/0x83671231080c30e1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.280396:0:18550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007b18d103/0x83671231080c30e1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.280408:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338929.280410:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338929.280411:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787338929.280801:0:19248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787338929.280807:0:19248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f8e51d1/0x83671231080c30e8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.280815:0:19248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x39:0x0].0x0 since=582s v=(0 0) 00010000:00010000:1.0:1787338929.280819:0:19248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787338929.280822:0:19248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f8e51d1/0x83671231080c30e8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.280832:0:19248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004f8e51d1/0x83671231080c30e8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.280840:0:19248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f8e51d1/0x83671231080c30e8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.280852:0:19248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004f8e51d1/0x83671231080c30e8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.280865:0:19248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787338929.291132:0:20031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787338929.291145:0:20031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001134f0ef/0x83671231080c30ef lrc: 3/0,1 mode: --/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.291162:0:20031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x41:0x0].0x0 since=582s v=(0 0) 00010000:00010000:3.0:1787338929.291167:0:20031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787338929.291174:0:20031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001134f0ef/0x83671231080c30ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.291191:0:20031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001134f0ef/0x83671231080c30ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.291202:0:20031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001134f0ef/0x83671231080c30ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.291211:0:20031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001134f0ef/0x83671231080c30ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.291229:0:20031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1787338929.291753:0:20031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787338929.291760:0:20031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ae237a6/0x83671231080c30f6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.291769:0:20031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x40:0x0].0x0 since=582s v=(0 0) 00010000:00010000:3.0:1787338929.291772:0:20031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787338929.291777:0:20031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ae237a6/0x83671231080c30f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.291786:0:20031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ae237a6/0x83671231080c30f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.291795:0:20031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ae237a6/0x83671231080c30f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.291803:0:20031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ae237a6/0x83671231080c30f6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.291811:0:20031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1787338929.292223:0:20031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787338929.292229:0:20031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8f4a49d/0x83671231080c30fd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.292238:0:20031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3f:0x0].0x0 since=582s v=(0 0) 00010000:00010000:3.0:1787338929.292240:0:20031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787338929.292243:0:20031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a8f4a49d/0x83671231080c30fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.292262:0:20031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a8f4a49d/0x83671231080c30fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.292270:0:20031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8f4a49d/0x83671231080c30fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.292277:0:20031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a8f4a49d/0x83671231080c30fd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.292285:0:20031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1787338929.292726:0:20031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787338929.292732:0:20031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b77f5d0/0x83671231080c3104 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.292742:0:20031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3e:0x0].0x0 since=582s v=(0 0) 00010000:00010000:3.0:1787338929.292745:0:20031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787338929.292748:0:20031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b77f5d0/0x83671231080c3104 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.292757:0:20031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b77f5d0/0x83671231080c3104 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.292765:0:20031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b77f5d0/0x83671231080c3104 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.292782:0:20031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b77f5d0/0x83671231080c3104 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.292805:0:20031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:3.0:1787338929.293240:0:20031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787338929.293247:0:20031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7b76f89/0x83671231080c310b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.293256:0:20031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3d:0x0].0x0 since=582s v=(0 0) 00010000:00010000:3.0:1787338929.293259:0:20031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787338929.293263:0:20031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7b76f89/0x83671231080c310b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.293272:0:20031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f7b76f89/0x83671231080c310b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.293279:0:20031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7b76f89/0x83671231080c310b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.293286:0:20031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f7b76f89/0x83671231080c310b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.293295:0:20031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:3.0:1787338929.293649:0:20031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787338929.293655:0:20031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f9d2ca8/0x83671231080c3112 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.293669:0:20031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3c:0x0].0x0 since=582s v=(0 0) 00010000:00010000:3.0:1787338929.293672:0:20031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787338929.293676:0:20031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006f9d2ca8/0x83671231080c3112 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.293685:0:20031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006f9d2ca8/0x83671231080c3112 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.293692:0:20031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f9d2ca8/0x83671231080c3112 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.293700:0:20031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006f9d2ca8/0x83671231080c3112 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.293708:0:20031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00010000:00010000:1.0:1787338929.295385:0:18550:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1787338929.295396:0:18550:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004f8e51d1/0x83671231080c30e8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.295409:0:18550:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbfbe9ce00 already unused, calling callback (ffffffffc1546230) 00010000:00010000:1.0:1787338929.295414:0:18550:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004f8e51d1/0x83671231080c30e8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.295425:0:18550:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004f8e51d1/0x83671231080c30e8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.295447:0:18550:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004f8e51d1/0x83671231080c30e8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.295455:0:18550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f8e51d1/0x83671231080c30e8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.295493:0:18550:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1787338929.295498:0:18550:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001134f0ef/0x83671231080c30ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.295522:0:18550:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbffef4a00 already unused, calling callback (ffffffffc1546230) 00010000:00010000:1.0:1787338929.295526:0:18550:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001134f0ef/0x83671231080c30ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.295534:0:18550:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001134f0ef/0x83671231080c30ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.295549:0:18550:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001134f0ef/0x83671231080c30ef lrc: 1/0,0 mode: --/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.295557:0:18550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001134f0ef/0x83671231080c30ef lrc: 0/0,0 mode: --/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.295587:0:18550:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1787338929.295591:0:18550:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ae237a6/0x83671231080c30f6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.295597:0:18550:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbffef5c00 already unused, calling callback (ffffffffc1546230) 00010000:00010000:1.0:1787338929.295600:0:18550:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ae237a6/0x83671231080c30f6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.295608:0:18550:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ae237a6/0x83671231080c30f6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.295618:0:18550:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ae237a6/0x83671231080c30f6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.295632:0:18550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ae237a6/0x83671231080c30f6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.295645:0:18550:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1787338929.295649:0:18550:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a8f4a49d/0x83671231080c30fd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.295656:0:18550:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbffef4000 already unused, calling callback (ffffffffc1546230) 00010000:00010000:1.0:1787338929.295659:0:18550:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8f4a49d/0x83671231080c30fd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.295667:0:18550:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8f4a49d/0x83671231080c30fd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.295678:0:18550:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a8f4a49d/0x83671231080c30fd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.295684:0:18550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a8f4a49d/0x83671231080c30fd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.295696:0:18550:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787338929.295699:0:18550:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b77f5d0/0x83671231080c3104 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.295706:0:18550:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbffef4200 already unused, calling callback (ffffffffc1546230) 00010000:00010000:1.0:1787338929.295718:0:18550:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b77f5d0/0x83671231080c3104 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.295726:0:18550:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b77f5d0/0x83671231080c3104 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.295737:0:18550:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b77f5d0/0x83671231080c3104 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.295744:0:18550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b77f5d0/0x83671231080c3104 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.295756:0:18550:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787338929.295759:0:18550:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f7b76f89/0x83671231080c310b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.295765:0:18550:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbffef4c00 already unused, calling callback (ffffffffc1546230) 00010000:00010000:1.0:1787338929.295768:0:18550:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7b76f89/0x83671231080c310b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.295775:0:18550:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7b76f89/0x83671231080c310b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.295785:0:18550:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f7b76f89/0x83671231080c310b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.295792:0:18550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f7b76f89/0x83671231080c310b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.295813:0:18550:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787338929.295816:0:18550:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006f9d2ca8/0x83671231080c3112 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.295822:0:18550:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbffef4400 already unused, calling callback (ffffffffc1546230) 00010000:00010000:1.0:1787338929.295825:0:18550:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006f9d2ca8/0x83671231080c3112 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.295832:0:18550:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006f9d2ca8/0x83671231080c3112 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.295843:0:18550:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006f9d2ca8/0x83671231080c3112 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.295850:0:18550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006f9d2ca8/0x83671231080c3112 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.295862:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338929.295864:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338929.295866:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787338929.296929:0:18551:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787338929.303453:0:19248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787338929.303478:0:19248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb7e3e45/0x83671231080c3119 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.303497:0:19248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x38:0x0].0x0 since=582s v=(0 0) 00010000:00010000:1.0:1787338929.303509:0:19248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787338929.303517:0:19248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb7e3e45/0x83671231080c3119 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.303532:0:19248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb7e3e45/0x83671231080c3119 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.303544:0:19248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb7e3e45/0x83671231080c3119 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.303552:0:19248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb7e3e45/0x83671231080c3119 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.303569:0:19248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787338929.303582:0:18550:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787338929.303587:0:18550:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb7e3e45/0x83671231080c3119 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.303594:0:18550:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbfbe9dc00 already unused, calling callback (ffffffffc1546230) 00010000:00010000:1.0:1787338929.303599:0:18550:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb7e3e45/0x83671231080c3119 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.303607:0:18550:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb7e3e45/0x83671231080c3119 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.303623:0:18550:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb7e3e45/0x83671231080c3119 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.303641:0:18550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb7e3e45/0x83671231080c3119 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.303663:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338929.303665:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338929.303667:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787338929.305525:0:19248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787338929.305536:0:19248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062af652d/0x83671231080c3120 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.305550:0:19248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x37:0x0].0x0 since=582s v=(0 0) 00010000:00010000:1.0:1787338929.305554:0:19248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787338929.305560:0:19248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062af652d/0x83671231080c3120 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.305571:0:19248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000062af652d/0x83671231080c3120 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.305581:0:19248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062af652d/0x83671231080c3120 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.305589:0:19248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000062af652d/0x83671231080c3120 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.305611:0:19248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787338929.307403:0:18551:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787338929.307415:0:18551:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000062af652d/0x83671231080c3120 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338929.307428:0:18551:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbfbe9ca00 already unused, calling callback (ffffffffc1546230) 00010000:00010000:2.0:1787338929.307432:0:18551:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000062af652d/0x83671231080c3120 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338929.307442:0:18551:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000062af652d/0x83671231080c3120 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338929.307476:0:18551:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000062af652d/0x83671231080c3120 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338929.307483:0:18551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000062af652d/0x83671231080c3120 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338929.307507:0:18551:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787338929.307509:0:18551:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787338929.307510:0:18551:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787338929.308690:0:19248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787338929.308700:0:19248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000008a3dc47/0x83671231080c3127 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.308713:0:19248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x36:0x0].0x0 since=582s v=(0 0) 00010000:00010000:3.0:1787338929.308717:0:19248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787338929.308723:0:19248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000008a3dc47/0x83671231080c3127 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.308751:0:19248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000008a3dc47/0x83671231080c3127 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.308770:0:19248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000008a3dc47/0x83671231080c3127 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.308778:0:19248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000008a3dc47/0x83671231080c3127 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.308793:0:19248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787338929.308803:0:18550:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787338929.308808:0:18550:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000008a3dc47/0x83671231080c3127 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.308815:0:18550:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbffef5e00 already unused, calling callback (ffffffffc1546230) 00010000:00010000:3.0:1787338929.308820:0:18550:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000008a3dc47/0x83671231080c3127 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.308828:0:18550:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000008a3dc47/0x83671231080c3127 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.308840:0:18550:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000008a3dc47/0x83671231080c3127 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.308847:0:18550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000008a3dc47/0x83671231080c3127 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.308862:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338929.308868:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338929.308869:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787338929.309414:0:19248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787338929.309421:0:19248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6452a34/0x83671231080c312e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.309429:0:19248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x35:0x0].0x0 since=582s v=(0 0) 00010000:00010000:3.0:1787338929.309432:0:19248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787338929.309437:0:19248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e6452a34/0x83671231080c312e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.309446:0:19248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e6452a34/0x83671231080c312e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.309651:0:19248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6452a34/0x83671231080c312e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.309662:0:19248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e6452a34/0x83671231080c312e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.309686:0:19248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787338929.310239:0:19248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787338929.310245:0:19248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002f1aabf/0x83671231080c3135 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.310254:0:19248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x34:0x0].0x0 since=582s v=(0 0) 00010000:00010000:3.0:1787338929.310258:0:19248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787338929.310262:0:19248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002f1aabf/0x83671231080c3135 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.310392:0:19248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002f1aabf/0x83671231080c3135 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.310402:0:19248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002f1aabf/0x83671231080c3135 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.310411:0:19248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000002f1aabf/0x83671231080c3135 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.310426:0:19248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787338929.310438:0:18550:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787338929.310442:0:18550:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e6452a34/0x83671231080c312e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.310449:0:18550:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbffef5a00 already unused, calling callback (ffffffffc1546230) 00010000:00010000:3.0:1787338929.310453:0:18550:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6452a34/0x83671231080c312e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.310470:0:18550:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6452a34/0x83671231080c312e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.310483:0:18550:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e6452a34/0x83671231080c312e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.310492:0:18550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e6452a34/0x83671231080c312e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.310512:0:18550:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787338929.310516:0:18550:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000002f1aabf/0x83671231080c3135 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.310522:0:18550:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea4800 already unused, calling callback (ffffffffc1546230) 00010000:00010000:3.0:1787338929.310525:0:18550:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000002f1aabf/0x83671231080c3135 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.310533:0:18550:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000002f1aabf/0x83671231080c3135 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.310542:0:18550:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000002f1aabf/0x83671231080c3135 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.310549:0:18550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002f1aabf/0x83671231080c3135 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.310559:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338929.310560:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338929.310562:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787338929.311195:0:19248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787338929.311203:0:19248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007edf8508/0x83671231080c313c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.311213:0:19248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x33:0x0].0x0 since=582s v=(0 0) 00010000:00010000:3.0:1787338929.311222:0:19248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787338929.311227:0:19248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007edf8508/0x83671231080c313c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.311236:0:19248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007edf8508/0x83671231080c313c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.311245:0:19248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007edf8508/0x83671231080c313c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.311251:0:19248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007edf8508/0x83671231080c313c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.311265:0:19248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787338929.311274:0:18550:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787338929.311278:0:18550:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007edf8508/0x83671231080c313c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.311359:0:18550:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea5000 already unused, calling callback (ffffffffc1546230) 00010000:00010000:3.0:1787338929.311363:0:18550:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007edf8508/0x83671231080c313c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.311370:0:18550:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007edf8508/0x83671231080c313c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.311381:0:18550:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007edf8508/0x83671231080c313c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.311399:0:18550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007edf8508/0x83671231080c313c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.311415:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338929.311417:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338929.311418:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787338929.311869:0:19248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787338929.311907:0:19248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd0f5b9e/0x83671231080c3143 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.311915:0:19248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x32:0x0].0x0 since=582s v=(0 0) 00010000:00010000:3.0:1787338929.311918:0:19248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787338929.311923:0:19248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd0f5b9e/0x83671231080c3143 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.311932:0:19248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd0f5b9e/0x83671231080c3143 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.311939:0:19248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd0f5b9e/0x83671231080c3143 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.311947:0:19248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dd0f5b9e/0x83671231080c3143 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.311960:0:19248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787338929.312737:0:18550:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787338929.312751:0:18550:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dd0f5b9e/0x83671231080c3143 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.312760:0:18550:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea4000 already unused, calling callback (ffffffffc1546230) 00010000:00010000:3.0:1787338929.312764:0:18550:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd0f5b9e/0x83671231080c3143 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.312772:0:18550:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd0f5b9e/0x83671231080c3143 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.312786:0:18550:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dd0f5b9e/0x83671231080c3143 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.312793:0:18550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd0f5b9e/0x83671231080c3143 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.312808:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338929.312810:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338929.312811:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787338929.312927:0:18551:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787338929.317838:0:19248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787338929.317851:0:19248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0a3b5f7/0x83671231080c314a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.317869:0:19248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x31:0x0].0x0 since=582s v=(0 0) 00010000:00010000:3.0:1787338929.318636:0:19248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787338929.318644:0:19248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0a3b5f7/0x83671231080c314a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.318678:0:19248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a0a3b5f7/0x83671231080c314a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.318689:0:19248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0a3b5f7/0x83671231080c314a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.318698:0:19248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a0a3b5f7/0x83671231080c314a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.318753:0:19248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787338929.319332:0:19248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787338929.319339:0:19248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000316c4f2c/0x83671231080c3151 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.319350:0:19248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x30:0x0].0x0 since=582s v=(0 0) 00010000:00010000:3.0:1787338929.319353:0:19248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787338929.319358:0:19248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000316c4f2c/0x83671231080c3151 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.319367:0:19248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000316c4f2c/0x83671231080c3151 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.319377:0:19248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000316c4f2c/0x83671231080c3151 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.319396:0:19248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000316c4f2c/0x83671231080c3151 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787338929.321596:0:20031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787338929.321608:0:20031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d81b2a98/0x83671231080c3158 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338929.321623:0:20031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3b:0x0].0x0 since=582s v=(0 0) 00010000:00010000:2.0:1787338929.321629:0:20031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787338929.321634:0:20031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d81b2a98/0x83671231080c3158 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338929.321648:0:20031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d81b2a98/0x83671231080c3158 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338929.321658:0:20031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d81b2a98/0x83671231080c3158 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338929.321665:0:20031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d81b2a98/0x83671231080c3158 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.321806:0:18550:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787338929.321819:0:18550:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a0a3b5f7/0x83671231080c314a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.321828:0:18550:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea5200 already unused, calling callback (ffffffffc1546230) 00010000:00010000:1.0:1787338929.321832:0:18550:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0a3b5f7/0x83671231080c314a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.321840:0:18550:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0a3b5f7/0x83671231080c314a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.321858:0:18550:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a0a3b5f7/0x83671231080c314a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.321864:0:18550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a0a3b5f7/0x83671231080c314a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.321904:0:18550:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787338929.321909:0:18550:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000316c4f2c/0x83671231080c3151 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.321916:0:18550:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea4a00 already unused, calling callback (ffffffffc1546230) 00010000:00010000:1.0:1787338929.321918:0:18550:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000316c4f2c/0x83671231080c3151 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.321926:0:18550:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000316c4f2c/0x83671231080c3151 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.321949:0:18550:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000316c4f2c/0x83671231080c3151 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.321957:0:18550:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787338929.321961:0:18550:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d81b2a98/0x83671231080c3158 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.321967:0:18550:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e3000 already unused, calling callback (ffffffffc1546230) 00010000:00010000:1.0:1787338929.321970:0:18550:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d81b2a98/0x83671231080c3158 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.321976:0:18550:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d81b2a98/0x83671231080c3158 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.321985:0:18550:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d81b2a98/0x83671231080c3158 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.321993:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338929.321994:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338929.321996:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338929.322214:0:19248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787338929.322220:0:19248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000316c4f2c/0x83671231080c3151 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338929.322229:0:20031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787338929.322233:0:20031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d81b2a98/0x83671231080c3158 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338929.322250:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338929.322586:0:18551:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787338929.322849:0:19248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787338929.322856:0:19248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd0f5b9e/0x83671231080c315f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.322866:0:19248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2f:0x0].0x0 since=582s v=(0 0) 00010000:00010000:3.0:1787338929.322869:0:19248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787338929.322909:0:19248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd0f5b9e/0x83671231080c315f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.322919:0:19248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd0f5b9e/0x83671231080c315f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.322927:0:19248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd0f5b9e/0x83671231080c315f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.322934:0:19248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dd0f5b9e/0x83671231080c315f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.322961:0:19248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787338929.323417:0:19248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787338929.323423:0:19248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007edf8508/0x83671231080c3166 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.323432:0:19248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2e:0x0].0x0 since=582s v=(0 0) 00010000:00010000:3.0:1787338929.323435:0:19248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787338929.323439:0:19248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007edf8508/0x83671231080c3166 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.323449:0:19248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007edf8508/0x83671231080c3166 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.323529:0:19248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007edf8508/0x83671231080c3166 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.323536:0:19248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007edf8508/0x83671231080c3166 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.323547:0:19248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787338929.324051:0:18550:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787338929.324058:0:18550:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dd0f5b9e/0x83671231080c315f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.324066:0:18550:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea4000 already unused, calling callback (ffffffffc1546230) 00010000:00010000:1.0:1787338929.324077:0:18550:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd0f5b9e/0x83671231080c315f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.324087:0:18550:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd0f5b9e/0x83671231080c315f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.324102:0:18550:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dd0f5b9e/0x83671231080c315f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.324109:0:18550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd0f5b9e/0x83671231080c315f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.324125:0:18550:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787338929.324130:0:18550:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007edf8508/0x83671231080c3166 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.324136:0:18550:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea5000 already unused, calling callback (ffffffffc1546230) 00010000:00010000:1.0:1787338929.324139:0:18550:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007edf8508/0x83671231080c3166 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.324146:0:18550:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007edf8508/0x83671231080c3166 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.324155:0:18550:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007edf8508/0x83671231080c3166 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.324162:0:18550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007edf8508/0x83671231080c3166 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.324182:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338929.324184:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338929.324186:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338929.324192:0:18551:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787338929.324245:0:20031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787338929.324252:0:20031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000086725c57/0x83671231080c316d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338929.324260:0:20031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3a:0x0].0x0 since=582s v=(0 0) 00010000:00010000:2.0:1787338929.324263:0:20031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787338929.324267:0:20031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000086725c57/0x83671231080c316d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338929.324276:0:20031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000086725c57/0x83671231080c316d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787338929.324574:0:19248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787338929.324581:0:19248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002f1aabf/0x83671231080c3174 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.324589:0:19248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2d:0x0].0x0 since=582s v=(0 0) 00010000:00010000:3.0:1787338929.324598:0:19248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787338929.324603:0:19248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002f1aabf/0x83671231080c3174 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.324613:0:19248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002f1aabf/0x83671231080c3174 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.324622:0:19248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002f1aabf/0x83671231080c3174 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.324629:0:19248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000002f1aabf/0x83671231080c3174 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.324687:0:19248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787338929.324698:0:20031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000086725c57/0x83671231080c316d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338929.324706:0:20031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000086725c57/0x83671231080c316d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787338929.325999:0:19248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787338929.326010:0:19248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e1f24e3/0x83671231080c317b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.326023:0:19248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2c:0x0].0x0 since=582s v=(0 0) 00010000:00010000:3.0:1787338929.326027:0:19248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787338929.326033:0:19248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006e1f24e3/0x83671231080c317b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.326046:0:19248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006e1f24e3/0x83671231080c317b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.326055:0:19248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e1f24e3/0x83671231080c317b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.326070:0:19248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006e1f24e3/0x83671231080c317b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.326128:0:18550:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787338929.326136:0:18550:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000002f1aabf/0x83671231080c3174 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.326144:0:18550:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea4800 already unused, calling callback (ffffffffc1546230) 00010000:00010000:1.0:1787338929.326149:0:18550:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000002f1aabf/0x83671231080c3174 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.326157:0:18550:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000002f1aabf/0x83671231080c3174 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.326173:0:18550:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000002f1aabf/0x83671231080c3174 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.326180:0:18550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002f1aabf/0x83671231080c3174 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.326197:0:18550:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787338929.326201:0:18550:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000086725c57/0x83671231080c316d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.326209:0:18550:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e3c00 already unused, calling callback (ffffffffc1546230) 00010000:00010000:1.0:1787338929.326219:0:18550:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000086725c57/0x83671231080c316d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.326227:0:18550:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000086725c57/0x83671231080c316d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.326238:0:18550:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000086725c57/0x83671231080c316d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.326246:0:18550:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787338929.326250:0:18550:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006e1f24e3/0x83671231080c317b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.326256:0:18550:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea4400 already unused, calling callback (ffffffffc1546230) 00010000:00010000:1.0:1787338929.326259:0:18550:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006e1f24e3/0x83671231080c317b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.326266:0:18550:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006e1f24e3/0x83671231080c317b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.326276:0:18550:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006e1f24e3/0x83671231080c317b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.327417:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338929.327420:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338929.327423:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787338929.330467:0:20031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787338929.330482:0:20031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000086725c57/0x83671231080c316d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338929.330541:0:18551:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1787338929.332252:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:3.0:1787338929.332410:0:19248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787338929.332420:0:19248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006e1f24e3/0x83671231080c317b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.332516:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787338929.333011:0:19248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787338929.333019:0:19248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a4e7ed48/0x83671231080c3182 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.333034:0:19248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=582s v=(0 0) 00010000:00010000:3.0:1787338929.333039:0:19248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787338929.333045:0:19248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a4e7ed48/0x83671231080c3182 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.333059:0:19248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a4e7ed48/0x83671231080c3182 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.333068:0:19248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a4e7ed48/0x83671231080c3182 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.333076:0:19248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a4e7ed48/0x83671231080c3182 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.333102:0:19248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787338929.334179:0:18551:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787338929.334188:0:18551:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a4e7ed48/0x83671231080c3182 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338929.334199:0:18551:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea5e00 already unused, calling callback (ffffffffc1546230) 00010000:00010000:2.0:1787338929.334204:0:18551:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a4e7ed48/0x83671231080c3182 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338929.334213:0:18551:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a4e7ed48/0x83671231080c3182 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338929.334232:0:18551:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a4e7ed48/0x83671231080c3182 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338929.334239:0:18551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a4e7ed48/0x83671231080c3182 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338929.334257:0:18551:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787338929.334258:0:18551:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787338929.334260:0:18551:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787338929.335392:0:19248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787338929.335405:0:19248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003ae84a4/0x83671231080c3189 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.335419:0:19248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2a:0x0].0x0 since=582s v=(0 0) 00010000:00010000:3.0:1787338929.335424:0:19248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787338929.335430:0:19248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000003ae84a4/0x83671231080c3189 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.335442:0:19248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000003ae84a4/0x83671231080c3189 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.335452:0:19248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003ae84a4/0x83671231080c3189 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.335519:0:19248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000003ae84a4/0x83671231080c3189 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.337125:0:19248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787338929.337689:0:19248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787338929.337698:0:19248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000337a423a/0x83671231080c3190 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.337713:0:19248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x29:0x0].0x0 since=582s v=(0 0) 00010000:00010000:3.0:1787338929.337724:0:19248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787338929.337731:0:19248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000337a423a/0x83671231080c3190 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.337745:0:19248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000337a423a/0x83671231080c3190 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.337755:0:19248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000337a423a/0x83671231080c3190 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.337762:0:19248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000337a423a/0x83671231080c3190 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338929.338852:0:18550:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787338929.338862:0:18550:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000003ae84a4/0x83671231080c3189 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338929.338899:0:18550:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea5c00 already unused, calling callback (ffffffffc1546230) 00010000:00010000:0.0:1787338929.338904:0:18550:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000003ae84a4/0x83671231080c3189 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338929.338925:0:18550:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000003ae84a4/0x83671231080c3189 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338929.338946:0:18550:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000003ae84a4/0x83671231080c3189 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338929.338954:0:18550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000003ae84a4/0x83671231080c3189 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338929.338974:0:18550:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787338929.338979:0:18550:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000337a423a/0x83671231080c3190 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338929.338986:0:18550:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea5600 already unused, calling callback (ffffffffc1546230) 00010000:00010000:0.0:1787338929.338989:0:18550:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000337a423a/0x83671231080c3190 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338929.338998:0:18550:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000337a423a/0x83671231080c3190 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338929.339007:0:18550:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000337a423a/0x83671231080c3190 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338929.339014:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787338929.339016:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787338929.339023:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338929.341576:0:19248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787338929.341591:0:19248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000337a423a/0x83671231080c3190 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787338929.342277:0:19248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787338929.342297:0:19248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f3186d5/0x83671231080c3197 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.342312:0:19248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x28:0x0].0x0 since=582s v=(0 0) 00010000:00010000:3.0:1787338929.342317:0:19248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787338929.342323:0:19248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f3186d5/0x83671231080c3197 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.342337:0:19248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002f3186d5/0x83671231080c3197 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.342354:0:19248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f3186d5/0x83671231080c3197 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.342361:0:19248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002f3186d5/0x83671231080c3197 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338929.345559:0:18551:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787338929.345574:0:18551:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002f3186d5/0x83671231080c3197 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338929.345588:0:18551:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea5a00 already unused, calling callback (ffffffffc1546230) 00010000:00010000:0.0:1787338929.345594:0:18551:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002f3186d5/0x83671231080c3197 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338929.345604:0:18551:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002f3186d5/0x83671231080c3197 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338929.345625:0:18551:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002f3186d5/0x83671231080c3197 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338929.345656:0:18551:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787338929.345658:0:18551:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787338929.345660:0:18551:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338929.346063:0:19248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787338929.346072:0:19248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002f3186d5/0x83671231080c3197 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.346489:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787338929.347639:0:20031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787338929.347650:0:20031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ccd4cd8/0x83671231080c319e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338929.347666:0:20031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=582s v=(0 0) 00010000:00010000:2.0:1787338929.347689:0:20031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787338929.347695:0:20031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ccd4cd8/0x83671231080c319e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338929.347709:0:20031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ccd4cd8/0x83671231080c319e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338929.347720:0:20031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ccd4cd8/0x83671231080c319e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338929.347728:0:20031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ccd4cd8/0x83671231080c319e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338929.347943:0:20031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787338929.348727:0:18551:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787338929.348736:0:18551:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ccd4cd8/0x83671231080c319e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.348746:0:18551:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e2000 already unused, calling callback (ffffffffc1546230) 00010000:00010000:3.0:1787338929.348751:0:18551:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ccd4cd8/0x83671231080c319e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.348760:0:18551:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ccd4cd8/0x83671231080c319e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.348778:0:18551:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ccd4cd8/0x83671231080c319e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.348786:0:18551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ccd4cd8/0x83671231080c319e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.348814:0:18551:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338929.348816:0:18551:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338929.348817:0:18551:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787338929.352678:0:20031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787338929.352691:0:20031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e1f24e3/0x83671231080c31a5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.352707:0:20031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x38:0x0].0x0 since=582s v=(0 0) 00010000:00010000:3.0:1787338929.352712:0:20031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787338929.352718:0:20031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e1f24e3/0x83671231080c31a5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.352732:0:20031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006e1f24e3/0x83671231080c31a5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.352743:0:20031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e1f24e3/0x83671231080c31a5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.352750:0:20031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006e1f24e3/0x83671231080c31a5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.352769:0:20031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787338929.352779:0:18550:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787338929.352785:0:18550:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006e1f24e3/0x83671231080c31a5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.352805:0:18550:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea4400 already unused, calling callback (ffffffffc1546230) 00010000:00010000:3.0:1787338929.352809:0:18550:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006e1f24e3/0x83671231080c31a5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.352817:0:18550:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006e1f24e3/0x83671231080c31a5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.352833:0:18550:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006e1f24e3/0x83671231080c31a5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.352841:0:18550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006e1f24e3/0x83671231080c31a5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.352857:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338929.352859:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338929.352861:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787338929.353812:0:19248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787338929.353822:0:19248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006cc20cec/0x83671231080c31ac lrc: 3/0,1 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338929.353836:0:19248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27:0x0].0x0 since=582s v=(0 0) 00010000:00010000:0.0:1787338929.353839:0:19248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787338929.353844:0:19248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006cc20cec/0x83671231080c31ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338929.353854:0:19248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006cc20cec/0x83671231080c31ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338929.353869:0:19248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006cc20cec/0x83671231080c31ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338929.353910:0:19248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006cc20cec/0x83671231080c31ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338929.353925:0:19248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787338929.355730:0:18551:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787338929.355814:0:18551:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006cc20cec/0x83671231080c31ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338929.355826:0:18551:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbc0030200 already unused, calling callback (ffffffffc1546230) 00010000:00010000:2.0:1787338929.355830:0:18551:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006cc20cec/0x83671231080c31ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787338929.355836:0:19248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787338929.355840:0:18551:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006cc20cec/0x83671231080c31ac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338929.355843:0:19248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000697ce498/0x83671231080c31b3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338929.355853:0:19248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26:0x0].0x0 since=582s v=(0 0) 00010000:00010000:0.0:1787338929.355857:0:19248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787338929.355859:0:18551:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006cc20cec/0x83671231080c31ac lrc: 1/0,0 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338929.355862:0:19248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000697ce498/0x83671231080c31b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338929.355895:0:19248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000697ce498/0x83671231080c31b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338929.355904:0:18551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006cc20cec/0x83671231080c31ac lrc: 0/0,0 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338929.355906:0:19248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000697ce498/0x83671231080c31b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338929.355914:0:19248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000697ce498/0x83671231080c31b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338929.355923:0:18551:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787338929.355925:0:18551:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787338929.355927:0:18551:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787338929.355942:0:19248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787338929.355949:0:18550:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787338929.355952:0:18550:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000697ce498/0x83671231080c31b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338929.355959:0:18550:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbc0030a00 already unused, calling callback (ffffffffc1546230) 00010000:00010000:2.0:1787338929.355962:0:18550:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000697ce498/0x83671231080c31b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338929.356816:0:18550:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000697ce498/0x83671231080c31b3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338929.356834:0:18550:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000697ce498/0x83671231080c31b3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338929.356842:0:18550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000697ce498/0x83671231080c31b3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338929.356859:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787338929.356861:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787338929.356863:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787338929.357806:0:20031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787338929.357817:0:20031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000316c4f2c/0x83671231080c31ba lrc: 3/0,1 mode: --/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.357830:0:20031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x37:0x0].0x0 since=582s v=(0 0) 00010000:00010000:3.0:1787338929.357834:0:20031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787338929.357840:0:20031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000316c4f2c/0x83671231080c31ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.357851:0:20031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000316c4f2c/0x83671231080c31ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.357867:0:20031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000316c4f2c/0x83671231080c31ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.357900:0:20031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000316c4f2c/0x83671231080c31ba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.357914:0:20031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787338929.358539:0:19248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787338929.358546:0:19248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa313dfa/0x83671231080c31c1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338929.358556:0:19248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25:0x0].0x0 since=582s v=(0 0) 00010000:00010000:0.0:1787338929.358559:0:19248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787338929.358564:0:19248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fa313dfa/0x83671231080c31c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338929.358574:0:19248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fa313dfa/0x83671231080c31c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338929.358581:0:19248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa313dfa/0x83671231080c31c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338929.358589:0:19248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fa313dfa/0x83671231080c31c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338929.358606:0:19248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787338929.358613:0:18550:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787338929.358619:0:18550:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000316c4f2c/0x83671231080c31ba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338929.358626:0:18550:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea4a00 already unused, calling callback (ffffffffc1546230) 00010000:00010000:0.0:1787338929.358635:0:18550:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000316c4f2c/0x83671231080c31ba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338929.358644:0:18550:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000316c4f2c/0x83671231080c31ba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338929.358659:0:18550:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000316c4f2c/0x83671231080c31ba lrc: 1/0,0 mode: --/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338929.358667:0:18550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000316c4f2c/0x83671231080c31ba lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338929.358681:0:18550:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787338929.358685:0:18550:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fa313dfa/0x83671231080c31c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338929.358691:0:18550:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bac3b93e00 already unused, calling callback (ffffffffc1546230) 00010000:00010000:0.0:1787338929.358694:0:18550:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa313dfa/0x83671231080c31c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338929.358702:0:18550:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa313dfa/0x83671231080c31c1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338929.358710:0:18550:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fa313dfa/0x83671231080c31c1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338929.358716:0:18550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fa313dfa/0x83671231080c31c1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338929.358732:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787338929.358733:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787338929.358735:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787338929.359106:0:19248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787338929.359111:0:19248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054206b01/0x83671231080c31c8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338929.359120:0:19248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=582s v=(0 0) 00010000:00010000:0.0:1787338929.359123:0:19248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787338929.359127:0:19248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054206b01/0x83671231080c31c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338929.359136:0:19248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000054206b01/0x83671231080c31c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338929.359144:0:19248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054206b01/0x83671231080c31c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338929.359151:0:19248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000054206b01/0x83671231080c31c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338929.359163:0:19248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787338929.359169:0:18550:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787338929.359172:0:18550:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000054206b01/0x83671231080c31c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338929.359188:0:18550:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bac3b93600 already unused, calling callback (ffffffffc1546230) 00010000:00010000:0.0:1787338929.359192:0:18550:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000054206b01/0x83671231080c31c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338929.359200:0:18550:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000054206b01/0x83671231080c31c8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338929.359210:0:18550:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000054206b01/0x83671231080c31c8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338929.359217:0:18550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000054206b01/0x83671231080c31c8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338929.359229:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787338929.359231:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787338929.359232:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787338929.360600:0:18551:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787338929.360736:0:20031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787338929.360745:0:20031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f3186d5/0x83671231080c31cf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.360760:0:20031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x36:0x0].0x0 since=582s v=(0 0) 00010000:00010000:3.0:1787338929.360763:0:20031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787338929.360769:0:20031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f3186d5/0x83671231080c31cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.360780:0:20031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f3186d5/0x83671231080c31cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.360789:0:20031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f3186d5/0x83671231080c31cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.360797:0:20031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f3186d5/0x83671231080c31cf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.360832:0:20031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787338929.361029:0:18550:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787338929.361036:0:18550:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f3186d5/0x83671231080c31cf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338929.361045:0:18550:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea5a00 already unused, calling callback (ffffffffc1546230) 00010000:00010000:2.0:1787338929.361049:0:18550:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f3186d5/0x83671231080c31cf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338929.361058:0:18550:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f3186d5/0x83671231080c31cf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338929.361075:0:18550:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f3186d5/0x83671231080c31cf lrc: 1/0,0 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338929.361082:0:18550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f3186d5/0x83671231080c31cf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338929.361098:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787338929.361100:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787338929.361102:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787338929.364399:0:20031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787338929.364416:0:20031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000337a423a/0x83671231080c31d6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.364434:0:20031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x35:0x0].0x0 since=582s v=(0 0) 00010000:00010000:3.0:1787338929.364440:0:20031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787338929.364446:0:20031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000337a423a/0x83671231080c31d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.364474:0:20031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000337a423a/0x83671231080c31d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.364487:0:20031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000337a423a/0x83671231080c31d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.364495:0:20031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000337a423a/0x83671231080c31d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.364515:0:20031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787338929.365005:0:20031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787338929.365013:0:20031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000699ae558/0x83671231080c31dd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.365021:0:20031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x34:0x0].0x0 since=582s v=(0 0) 00010000:00010000:3.0:1787338929.365032:0:20031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787338929.365037:0:20031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000699ae558/0x83671231080c31dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.365048:0:20031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000699ae558/0x83671231080c31dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.365056:0:20031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000699ae558/0x83671231080c31dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.365062:0:20031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000699ae558/0x83671231080c31dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.365078:0:20031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787338929.365090:0:18550:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787338929.365096:0:18550:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000337a423a/0x83671231080c31d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.365104:0:18550:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea5600 already unused, calling callback (ffffffffc1546230) 00010000:00010000:3.0:1787338929.365109:0:18550:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000337a423a/0x83671231080c31d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.365118:0:18550:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000337a423a/0x83671231080c31d6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.365134:0:18550:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000337a423a/0x83671231080c31d6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.365155:0:18550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000337a423a/0x83671231080c31d6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.365173:0:18550:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787338929.365177:0:18550:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000699ae558/0x83671231080c31dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.365184:0:18550:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea4e00 already unused, calling callback (ffffffffc1546230) 00010000:00010000:3.0:1787338929.365187:0:18550:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000699ae558/0x83671231080c31dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.365195:0:18550:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000699ae558/0x83671231080c31dd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.365206:0:18550:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000699ae558/0x83671231080c31dd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.365214:0:18550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000699ae558/0x83671231080c31dd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.365226:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338929.365229:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338929.365230:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787338929.365627:0:20031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787338929.365634:0:20031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088b888d5/0x83671231080c31e4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.365649:0:20031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x33:0x0].0x0 since=582s v=(0 0) 00010000:00010000:3.0:1787338929.365653:0:20031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787338929.365657:0:20031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088b888d5/0x83671231080c31e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.365668:0:20031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088b888d5/0x83671231080c31e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.365676:0:20031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088b888d5/0x83671231080c31e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.365684:0:20031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088b888d5/0x83671231080c31e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.365699:0:20031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787338929.365708:0:18550:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787338929.365712:0:18550:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088b888d5/0x83671231080c31e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.365719:0:18550:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea5800 already unused, calling callback (ffffffffc1546230) 00010000:00010000:3.0:1787338929.365722:0:18550:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088b888d5/0x83671231080c31e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.365731:0:18550:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088b888d5/0x83671231080c31e4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.365754:0:18550:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088b888d5/0x83671231080c31e4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.365760:0:18550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088b888d5/0x83671231080c31e4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.365773:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338929.365774:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338929.365776:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787338929.366159:0:20031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787338929.366164:0:20031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfc126b2/0x83671231080c31eb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.366170:0:20031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x32:0x0].0x0 since=582s v=(0 0) 00010000:00010000:3.0:1787338929.366173:0:20031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787338929.366175:0:20031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfc126b2/0x83671231080c31eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.366181:0:20031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfc126b2/0x83671231080c31eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.366186:0:20031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfc126b2/0x83671231080c31eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.366190:0:20031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfc126b2/0x83671231080c31eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.366206:0:20031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787338929.366212:0:18550:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787338929.366214:0:18550:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfc126b2/0x83671231080c31eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.366219:0:18550:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea4c00 already unused, calling callback (ffffffffc1546230) 00010000:00010000:3.0:1787338929.366221:0:18550:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfc126b2/0x83671231080c31eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.366225:0:18550:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfc126b2/0x83671231080c31eb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.366232:0:18550:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfc126b2/0x83671231080c31eb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.366236:0:18550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfc126b2/0x83671231080c31eb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.366245:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338929.366246:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338929.366247:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787338929.366565:0:20031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787338929.366569:0:20031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099903cb8/0x83671231080c31f2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.366575:0:20031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x31:0x0].0x0 since=582s v=(0 0) 00010000:00010000:3.0:1787338929.366580:0:20031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787338929.366583:0:20031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000099903cb8/0x83671231080c31f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.366589:0:20031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000099903cb8/0x83671231080c31f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.366595:0:20031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099903cb8/0x83671231080c31f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.366599:0:20031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000099903cb8/0x83671231080c31f2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.366607:0:20031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787338929.366613:0:18550:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787338929.366615:0:18550:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000099903cb8/0x83671231080c31f2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.366619:0:18550:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea5400 already unused, calling callback (ffffffffc1546230) 00010000:00010000:3.0:1787338929.366621:0:18550:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000099903cb8/0x83671231080c31f2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.366626:0:18550:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000099903cb8/0x83671231080c31f2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.366632:0:18550:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000099903cb8/0x83671231080c31f2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.366642:0:18550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000099903cb8/0x83671231080c31f2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.366651:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338929.366652:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338929.366653:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787338929.369643:0:18551:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787338929.374133:0:19248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787338929.374145:0:19248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb7e3e45/0x83671231080c31f9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.374163:0:19248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=582s v=(0 0) 00010000:00010000:1.0:1787338929.374168:0:19248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787338929.374174:0:19248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb7e3e45/0x83671231080c31f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.374188:0:19248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb7e3e45/0x83671231080c31f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.374198:0:19248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb7e3e45/0x83671231080c31f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.374206:0:19248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb7e3e45/0x83671231080c31f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.374231:0:19248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787338929.374244:0:18550:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787338929.374251:0:18550:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb7e3e45/0x83671231080c31f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.374259:0:18550:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbfbe9dc00 already unused, calling callback (ffffffffc1546230) 00010000:00010000:1.0:1787338929.374264:0:18550:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb7e3e45/0x83671231080c31f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.374301:0:18550:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb7e3e45/0x83671231080c31f9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.374318:0:18550:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb7e3e45/0x83671231080c31f9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.374326:0:18550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb7e3e45/0x83671231080c31f9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.374343:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338929.374345:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338929.374347:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1787338929.374542:0:19248:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:34 00000100:00100000:1.0:1787338929.374634:0:19248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf7ed5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:18587:x1874160212115840:12345-0@lo:5:osp-pre-1-0.0 Request processed in 145342us (147720us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338929.374643:0:19248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787338929.374699:0:18587:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf7ed7b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:18587:1874160212115840:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1787338929.374714:0:18587:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x22:0x0] 00000100:00100000:1.0:1787338929.374757:0:18587:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf7ed7b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:18587:1874160212115968:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1787338929.374789:0:18587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338929.374828:0:18587:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc33d33c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787338929.374850:0:19247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212115968 00000100:00100000:1.0:1787338929.374856:0:19247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212115968 00000100:00100000:1.0:1787338929.374924:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787338929.374934:0:19247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf7ed5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:18587:x1874160212115968:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1787338929.374978:0:19247:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 66 00002000:00010000:2.0:1787338929.383065:0:20031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787338929.383078:0:20031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000086725c57/0x83671231080c3200 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338929.383095:0:20031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x30:0x0].0x0 since=582s v=(0 0) 00010000:00010000:2.0:1787338929.383100:0:20031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787338929.383113:0:20031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000086725c57/0x83671231080c3200 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338929.383127:0:20031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000086725c57/0x83671231080c3200 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338929.383139:0:20031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000086725c57/0x83671231080c3200 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338929.383147:0:20031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000086725c57/0x83671231080c3200 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338929.383168:0:20031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787338929.383388:0:18551:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787338929.383396:0:18551:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000086725c57/0x83671231080c3200 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.383405:0:18551:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e3c00 already unused, calling callback (ffffffffc1546230) 00010000:00010000:3.0:1787338929.383410:0:18551:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000086725c57/0x83671231080c3200 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.383418:0:18551:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000086725c57/0x83671231080c3200 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.383436:0:18551:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000086725c57/0x83671231080c3200 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.383443:0:18551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000086725c57/0x83671231080c3200 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.383528:0:18551:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338929.383530:0:18551:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338929.383531:0:18551:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787338929.384867:0:19247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf7ed5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:18587:x1874160212115968:12345-0@lo:5:osp-pre-1-0.0 Request processed in 9929us (10072us total) trans 12884901889 rc 0/0 00000100:00100000:1.0:1787338929.384913:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787338929.384974:0:18587:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf7ed7b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:18587:1874160212115968:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1787338929.384989:0:18587:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00002000:00010000:2.0:1787338929.385953:0:20031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787338929.385963:0:20031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d81b2a98/0x83671231080c3207 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338929.385977:0:20031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2f:0x0].0x0 since=582s v=(0 0) 00010000:00010000:2.0:1787338929.385982:0:20031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787338929.385987:0:20031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d81b2a98/0x83671231080c3207 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338929.385999:0:20031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d81b2a98/0x83671231080c3207 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338929.386010:0:20031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d81b2a98/0x83671231080c3207 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338929.386028:0:20031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d81b2a98/0x83671231080c3207 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338929.386052:0:20031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787338929.386625:0:20031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787338929.386632:0:20031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007bcb55fc/0x83671231080c320e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338929.386640:0:20031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2e:0x0].0x0 since=582s v=(0 0) 00010000:00010000:2.0:1787338929.386644:0:20031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787338929.386648:0:20031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007bcb55fc/0x83671231080c320e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338929.386656:0:20031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007bcb55fc/0x83671231080c320e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338929.386664:0:20031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007bcb55fc/0x83671231080c320e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338929.386671:0:20031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007bcb55fc/0x83671231080c320e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338929.386685:0:20031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787338929.387407:0:18550:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787338929.387415:0:18550:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d81b2a98/0x83671231080c3207 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.387425:0:18550:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e3000 already unused, calling callback (ffffffffc1546230) 00010000:00010000:1.0:1787338929.387429:0:18550:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d81b2a98/0x83671231080c3207 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.387437:0:18550:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d81b2a98/0x83671231080c3207 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.387520:0:18550:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d81b2a98/0x83671231080c3207 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.387528:0:18550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d81b2a98/0x83671231080c3207 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.387546:0:18550:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787338929.387549:0:18550:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007bcb55fc/0x83671231080c320e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.387568:0:18550:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e2200 already unused, calling callback (ffffffffc1546230) 00010000:00010000:1.0:1787338929.387571:0:18550:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007bcb55fc/0x83671231080c320e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.387578:0:18550:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007bcb55fc/0x83671231080c320e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.387589:0:18550:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007bcb55fc/0x83671231080c320e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.387596:0:18550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007bcb55fc/0x83671231080c320e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.387609:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338929.387610:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338929.387612:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338929.388817:0:18551:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787338929.403678:0:20031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787338929.403694:0:20031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000098649397/0x83671231080c3215 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338929.403716:0:20031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2d:0x0].0x0 since=582s v=(0 0) 00010000:00010000:2.0:1787338929.403722:0:20031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787338929.403728:0:20031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000098649397/0x83671231080c3215 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338929.403743:0:20031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000098649397/0x83671231080c3215 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338929.403754:0:20031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000098649397/0x83671231080c3215 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338929.403761:0:20031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000098649397/0x83671231080c3215 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338929.403787:0:20031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787338929.404955:0:18550:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787338929.404965:0:18550:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000098649397/0x83671231080c3215 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.404976:0:18550:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e3600 already unused, calling callback (ffffffffc1546230) 00010000:00010000:3.0:1787338929.404980:0:18550:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000098649397/0x83671231080c3215 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.404990:0:18550:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000098649397/0x83671231080c3215 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.405008:0:18550:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000098649397/0x83671231080c3215 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.405015:0:18550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000098649397/0x83671231080c3215 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.405036:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338929.405038:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338929.405040:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787338929.406085:0:20031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787338929.406095:0:20031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b0b9c1b0/0x83671231080c321c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338929.406110:0:20031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2c:0x0].0x0 since=582s v=(0 0) 00010000:00010000:2.0:1787338929.406114:0:20031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787338929.406120:0:20031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b0b9c1b0/0x83671231080c321c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338929.406132:0:20031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b0b9c1b0/0x83671231080c321c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338929.406155:0:20031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b0b9c1b0/0x83671231080c321c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338929.406162:0:20031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b0b9c1b0/0x83671231080c321c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338929.406179:0:20031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787338929.406846:0:18551:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787338929.406854:0:18551:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b0b9c1b0/0x83671231080c321c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.406863:0:18551:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e2a00 already unused, calling callback (ffffffffc1546230) 00010000:00010000:3.0:1787338929.406868:0:18551:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b0b9c1b0/0x83671231080c321c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.406914:0:18551:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b0b9c1b0/0x83671231080c321c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.406932:0:18551:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b0b9c1b0/0x83671231080c321c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.406940:0:18551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b0b9c1b0/0x83671231080c321c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.406960:0:18551:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338929.406962:0:18551:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338929.406963:0:18551:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787338929.409930:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:3.0:1787338929.412719:0:20031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787338929.412732:0:20031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099903cb8/0x83671231080c3223 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.412748:0:20031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2b:0x0].0x0 since=582s v=(0 0) 00010000:00010000:3.0:1787338929.412753:0:20031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787338929.412759:0:20031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000099903cb8/0x83671231080c3223 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.412774:0:20031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000099903cb8/0x83671231080c3223 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.412785:0:20031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099903cb8/0x83671231080c3223 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.412801:0:20031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000099903cb8/0x83671231080c3223 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.412819:0:20031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787338929.412831:0:18550:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787338929.412837:0:18550:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000099903cb8/0x83671231080c3223 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.412845:0:18550:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea5400 already unused, calling callback (ffffffffc1546230) 00010000:00010000:3.0:1787338929.412849:0:18550:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000099903cb8/0x83671231080c3223 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.412859:0:18550:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000099903cb8/0x83671231080c3223 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.412901:0:18550:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000099903cb8/0x83671231080c3223 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.412909:0:18550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000099903cb8/0x83671231080c3223 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.412926:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338929.412928:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338929.412930:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787338929.414896:0:20031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787338929.414914:0:20031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfc126b2/0x83671231080c322a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.414928:0:20031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2a:0x0].0x0 since=582s v=(0 0) 00010000:00010000:3.0:1787338929.414933:0:20031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787338929.414938:0:20031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfc126b2/0x83671231080c322a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.414951:0:20031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfc126b2/0x83671231080c322a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.414961:0:20031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfc126b2/0x83671231080c322a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.414969:0:20031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfc126b2/0x83671231080c322a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.414992:0:20031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787338929.416413:0:18551:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787338929.416423:0:18551:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfc126b2/0x83671231080c322a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338929.416435:0:18551:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea4c00 already unused, calling callback (ffffffffc1546230) 00010000:00010000:2.0:1787338929.416440:0:18551:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfc126b2/0x83671231080c322a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338929.416450:0:18551:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfc126b2/0x83671231080c322a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338929.416481:0:18551:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfc126b2/0x83671231080c322a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338929.416489:0:18551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfc126b2/0x83671231080c322a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338929.416520:0:18551:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787338929.416522:0:18551:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787338929.416524:0:18551:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787338929.420203:0:20031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787338929.420217:0:20031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088b888d5/0x83671231080c3231 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.420236:0:20031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x29:0x0].0x0 since=582s v=(0 0) 00010000:00010000:3.0:1787338929.420241:0:20031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787338929.420247:0:20031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088b888d5/0x83671231080c3231 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.420261:0:20031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088b888d5/0x83671231080c3231 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.420436:0:20031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088b888d5/0x83671231080c3231 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.420447:0:20031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088b888d5/0x83671231080c3231 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.420529:0:20031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787338929.420545:0:18550:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787338929.420551:0:18550:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088b888d5/0x83671231080c3231 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.420559:0:18550:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea5800 already unused, calling callback (ffffffffc1546230) 00010000:00010000:3.0:1787338929.420564:0:18550:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088b888d5/0x83671231080c3231 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.420573:0:18550:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088b888d5/0x83671231080c3231 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.420591:0:18550:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088b888d5/0x83671231080c3231 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.420599:0:18550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088b888d5/0x83671231080c3231 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.420615:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338929.420622:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338929.420624:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787338929.423252:0:20031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787338929.423266:0:20031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000699ae558/0x83671231080c3238 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.423588:0:20031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x28:0x0].0x0 since=582s v=(0 0) 00010000:00010000:3.0:1787338929.423594:0:20031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787338929.423601:0:20031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000699ae558/0x83671231080c3238 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.423617:0:20031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000699ae558/0x83671231080c3238 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.423629:0:20031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000699ae558/0x83671231080c3238 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.423636:0:20031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000699ae558/0x83671231080c3238 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.423654:0:20031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787338929.424156:0:20031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787338929.424163:0:20031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000337a423a/0x83671231080c323f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.424172:0:20031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x27:0x0].0x0 since=582s v=(0 0) 00010000:00010000:3.0:1787338929.424175:0:20031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787338929.424179:0:20031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000337a423a/0x83671231080c323f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.424196:0:20031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000337a423a/0x83671231080c323f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.424204:0:20031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000337a423a/0x83671231080c323f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.424212:0:20031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000337a423a/0x83671231080c323f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.424228:0:20031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787338929.424243:0:18550:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787338929.424249:0:18550:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000699ae558/0x83671231080c3238 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.424257:0:18550:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea4e00 already unused, calling callback (ffffffffc1546230) 00010000:00010000:3.0:1787338929.424262:0:18550:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000699ae558/0x83671231080c3238 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.424270:0:18550:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000699ae558/0x83671231080c3238 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.425658:0:18550:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000699ae558/0x83671231080c3238 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.425673:0:18550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000699ae558/0x83671231080c3238 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.425705:0:18550:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787338929.425710:0:18550:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000337a423a/0x83671231080c323f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.425718:0:18550:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea5600 already unused, calling callback (ffffffffc1546230) 00010000:00010000:3.0:1787338929.425722:0:18550:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000337a423a/0x83671231080c323f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.425731:0:18550:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000337a423a/0x83671231080c323f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.425743:0:18550:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000337a423a/0x83671231080c323f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.425749:0:18550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000337a423a/0x83671231080c323f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.425761:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338929.425762:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338929.425764:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787338929.427576:0:18551:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787338929.428371:0:20031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787338929.428384:0:20031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e1f24e3/0x83671231080c3246 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.428401:0:20031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x26:0x0].0x0 since=582s v=(0 0) 00010000:00010000:3.0:1787338929.428414:0:20031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787338929.428421:0:20031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e1f24e3/0x83671231080c3246 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.428437:0:20031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006e1f24e3/0x83671231080c3246 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.428448:0:20031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e1f24e3/0x83671231080c3246 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.428522:0:20031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006e1f24e3/0x83671231080c3246 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.428550:0:20031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787338929.428587:0:18550:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787338929.428594:0:18550:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006e1f24e3/0x83671231080c3246 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338929.428601:0:18550:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea4400 already unused, calling callback (ffffffffc1546230) 00010000:00010000:0.0:1787338929.428606:0:18550:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006e1f24e3/0x83671231080c3246 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338929.428615:0:18550:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006e1f24e3/0x83671231080c3246 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338929.428636:0:18550:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006e1f24e3/0x83671231080c3246 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338929.428643:0:18550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006e1f24e3/0x83671231080c3246 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338929.428660:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787338929.428661:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787338929.428663:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787338929.432522:0:20031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787338929.432538:0:20031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006043dd54/0x83671231080c324d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.432556:0:20031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x25:0x0].0x0 since=582s v=(0 0) 00010000:00010000:3.0:1787338929.432561:0:20031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787338929.432568:0:20031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006043dd54/0x83671231080c324d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.432584:0:20031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006043dd54/0x83671231080c324d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.432595:0:20031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006043dd54/0x83671231080c324d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.432611:0:20031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006043dd54/0x83671231080c324d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.432638:0:20031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787338929.432664:0:18551:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787338929.432671:0:18551:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006043dd54/0x83671231080c324d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338929.432680:0:18551:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea4600 already unused, calling callback (ffffffffc1546230) 00010000:00010000:0.0:1787338929.432685:0:18551:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006043dd54/0x83671231080c324d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338929.432693:0:18551:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006043dd54/0x83671231080c324d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338929.432709:0:18551:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006043dd54/0x83671231080c324d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338929.432716:0:18551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006043dd54/0x83671231080c324d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338929.432816:0:18551:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787338929.432817:0:18551:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787338929.432819:0:18551:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787338929.433207:0:20031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787338929.433213:0:20031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000884f449/0x83671231080c3254 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.433222:0:20031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x24:0x0].0x0 since=582s v=(0 0) 00010000:00010000:3.0:1787338929.433226:0:20031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787338929.433230:0:20031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000884f449/0x83671231080c3254 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.433239:0:20031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000884f449/0x83671231080c3254 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.433246:0:20031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000884f449/0x83671231080c3254 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.433252:0:20031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000884f449/0x83671231080c3254 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.433267:0:20031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787338929.433425:0:18550:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787338929.433430:0:18550:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000884f449/0x83671231080c3254 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338929.433438:0:18550:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea4200 already unused, calling callback (ffffffffc1546230) 00010000:00010000:0.0:1787338929.433442:0:18550:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000884f449/0x83671231080c3254 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338929.433449:0:18550:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000884f449/0x83671231080c3254 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338929.433461:0:18550:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000884f449/0x83671231080c3254 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338929.433468:0:18550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000884f449/0x83671231080c3254 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338929.433480:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787338929.433482:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787338929.433483:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787338929.435045:0:20031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787338929.435055:0:20031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000316c4f2c/0x83671231080c325b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.435073:0:20031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x23:0x0].0x0 since=582s v=(0 0) 00010000:00010000:3.0:1787338929.435077:0:20031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787338929.435083:0:20031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000316c4f2c/0x83671231080c325b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.435093:0:20031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000316c4f2c/0x83671231080c325b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.435103:0:20031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000316c4f2c/0x83671231080c325b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.435111:0:20031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000316c4f2c/0x83671231080c325b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.435870:0:20031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1787338929.436113:0:20031:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:34 00000100:00100000:3.0:1787338929.436216:0:20031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbedcb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:18585:x1874160212115584:12345-0@lo:5:osp-pre-0-0.0 Request processed in 210265us (210932us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338929.436226:0:20031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787338929.436391:0:18585:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbedcb7100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:18585:1874160212115584:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1787338929.436409:0:18585:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x41:0x0] from OST, last_created [0x240000400:0x41:0x0]last_used is [0x240000400:0x22:0x0] 00000100:00100000:3.0:1787338929.436515:0:18585:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbedcb7100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:18585:1874160212116096:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1787338929.436553:0:18585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338929.436588:0:18585:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbffa4c000 going to sleep for 11 seconds 00000100:00100000:3.0:1787338929.436618:0:20031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212116096 00000100:00100000:3.0:1787338929.436624:0:20031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212116096 00000100:00100000:3.0:1787338929.436663:0:20031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787338929.436672:0:20031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbedcb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:18585:x1874160212116096:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1787338929.436709:0:20031:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 66 00010000:00010000:0.0:1787338929.437210:0:18551:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787338929.437220:0:18551:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000316c4f2c/0x83671231080c325b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338929.437243:0:18551:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea4a00 already unused, calling callback (ffffffffc1546230) 00010000:00010000:0.0:1787338929.437249:0:18551:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000316c4f2c/0x83671231080c325b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338929.437258:0:18551:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000316c4f2c/0x83671231080c325b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338929.437276:0:18551:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000316c4f2c/0x83671231080c325b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338929.437283:0:18551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000316c4f2c/0x83671231080c325b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338929.437306:0:18551:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787338929.437308:0:18551:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787338929.437310:0:18551:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787338929.452041:0:20031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbedcb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:18585:x1874160212116096:12345-0@lo:5:osp-pre-0-0.0 Request processed in 15363us (15481us total) trans 12884901889 rc 0/0 00000100:00100000:1.0:1787338929.452054:0:20031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787338929.452222:0:18585:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbedcb7100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:18585:1874160212116096:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1787338929.452236:0:18585:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x41:0x0]-[0x240000400:0x61:0x0] 00010000:00010000:0.0:1787338929.782595:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787338929.845953:0:18559:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787338929.845962:0:18559:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90bbe83a5800 from 11 10000000:01000000:3.0:1787338929.845968:0:18559:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787338929.846015:0:18559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbf7ea4e00/0x83671231080c3262 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.846026:0:18559:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.153@tcp lock: ffff90bbf7ea4e00/0x83671231080c3262 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338929.846038:0:18559:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.153@tcp lock: ffff90bbf7ea4e00/0x83671231080c3262 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338929.846076:0:18559:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbedcb5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4530016f-1c37-4f4c-b7ee-21f57031a048:18559:1874160212116224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787338929.846144:0:18559:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338929.846198:0:18559:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbffa4c000 going to sleep for 11 seconds 00000100:00100000:0.0:1787338929.848188:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212116224 00000100:00100000:0.0:1787338929.848202:0:18554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212116224 00000100:00100000:0.0:1787338929.848366:0:18554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787338929.848377:0:18554:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbff90c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4530016f-1c37-4f4c-b7ee-21f57031a048+18:18559:x1874160212116224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787338929.848393:0:18554:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787338929.848412:0:18554:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90bac3b92400/0x83671231080c3269 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x83671231080c3262 expref: -99 pid: 18554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338929.849315:0:18554:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bac3b92400/0x83671231080c3269 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x83671231080c3262 expref: 19 pid: 18554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338929.849334:0:18554:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90bac3b92400/0x83671231080c3269 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c3262 expref: 19 pid: 18554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338929.849345:0:18554:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bac3b92400, rc 0) 00000100:00100000:0.0:1787338929.849424:0:18554:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbff90c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4530016f-1c37-4f4c-b7ee-21f57031a048+19:18559:x1874160212116224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1048us (3278us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338929.849431:0:18554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787338929.849588:0:18559:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbedcb5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4530016f-1c37-4f4c-b7ee-21f57031a048:18559:1874160212116224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787338929.849608:0:18559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.153@tcp lock: ffff90bbf7ea4e00/0x83671231080c3262 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c3269 expref: -99 pid: 18559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338929.849617:0:18559:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.153@tcp lock: ffff90bbf7ea4e00/0x83671231080c3262 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x83671231080c3269 expref: -99 pid: 18559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338929.849694:0:18559:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf7ed7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4530016f-1c37-4f4c-b7ee-21f57031a048:18559:1874160212116352:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787338929.849739:0:18559:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338929.849769:0:18559:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc33d3f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787338929.849785:0:18557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212116352 00000100:00100000:1.0:1787338929.849790:0:18557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212116352 00000100:00100000:1.0:1787338929.849818:0:18557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787338929.849826:0:18557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbff90f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4530016f-1c37-4f4c-b7ee-21f57031a048+19:18559:x1874160212116352:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787338929.849842:0:18557:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787338929.849859:0:18557:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787338929.849863:0:18557:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:1.0:1787338929.861608:0:18557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbff90f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4530016f-1c37-4f4c-b7ee-21f57031a048+19:18559:x1874160212116352:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 11773us (11860us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338929.861623:0:18557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787338929.863030:0:18559:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf7ed7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4530016f-1c37-4f4c-b7ee-21f57031a048:18559:1874160212116352:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787338929.863555:0:18559:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.153@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787338929.863565:0:18559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bbf7ea4e00/0x83671231080c3262 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c3269 expref: -99 pid: 18559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338929.863577:0:18559:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.153@tcp lock: ffff90bbf7ea4e00/0x83671231080c3262 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c3269 expref: -99 pid: 18559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338930.812113:0:18551:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338931.830959:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787338931.987451:0:6714:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1787338931.987487:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00010000:00010000:1.0:1787338932.854160:0:18551:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787338933.435386:0:7651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1787338933.435403:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00010000:00010000:3.0:1787338933.882172:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787338934.392479:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf5b71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874160212116608:0@lo:400:kworker.0 00000100:00100000:2.0:1787338934.392547:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338934.392590:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf5b72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1874160212117120:0@lo:400:kworker.0 00000100:00100000:2.0:1787338934.392613:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338934.392634:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787338934.392639:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf5b71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874160212116736:0@lo:400:kworker.0 00000100:00100000:2.0:1787338934.392657:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338934.395279:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf5b72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4530016f-1c37-4f4c-b7ee-21f57031a048:3315:1874160212116480:0@lo:400:kworker.0 00000100:00100000:0.0:1787338934.395347:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338934.395385:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf5b70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1874160212116992:0@lo:400:kworker.0 00000100:00100000:0.0:1787338934.395408:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338934.395431:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787338934.395444:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf5b73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874160212116864:0@lo:400:kworker.0 00000100:00100000:0.0:1787338934.395463:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338934.395489:0:18562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212117120 00000100:00100000:0.0:1787338934.395496:0:18562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212117120 00000100:00100000:0.0:1787338934.395542:0:18562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212116992 00000100:00100000:0.0:1787338934.395545:0:18562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212116992 00000100:00100000:0.0:1787338934.395556:0:18562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212116864 00000100:00100000:0.0:1787338934.395558:0:18562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212116864 00000100:00100000:0.0:1787338934.395572:0:18562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787338934.395580:0:18562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf5b73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874160212117120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787338934.395632:0:18562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf5b73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874160212117120:12345-0@lo:400:kworker.0 Request processed in 52us (3016us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338934.395638:0:18562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787338934.395653:0:18562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787338934.395658:0:18562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee082d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874160212116992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787338934.395683:0:18562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee082d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874160212116992:12345-0@lo:400:kworker.0 Request processed in 25us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338934.395688:0:18562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787338934.395697:0:18562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787338934.395702:0:18562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee080000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874160212116864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787338934.395721:0:18562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee080000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874160212116864:12345-0@lo:400:kworker.0 Request processed in 19us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338934.395726:0:18562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787338934.395741:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212116608 00000100:00100000:0.0:1787338934.395745:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212116608 00000100:00100000:0.0:1787338934.395766:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212116736 00000100:00100000:0.0:1787338934.395769:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212116736 00000100:00100000:0.0:1787338934.395789:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787338934.395814:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf5b73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1874160212116608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787338934.395847:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf5b73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1874160212116608:12345-0@lo:400:kworker.0 Request processed in 46us (3300us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338934.395852:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787338934.395863:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787338934.395868:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf5b71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1874160212116736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787338934.395918:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf5b71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1874160212116736:12345-0@lo:400:kworker.0 Request processed in 50us (3259us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338934.395924:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787338934.395942:0:18556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212116480 00000100:00100000:0.0:1787338934.395945:0:18556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212116480 00000100:00100000:0.0:1787338934.395965:0:18556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787338934.395969:0:18556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbff90f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4530016f-1c37-4f4c-b7ee-21f57031a048+19:3315:x1874160212116480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787338934.395993:0:18556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbff90f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4530016f-1c37-4f4c-b7ee-21f57031a048+19:3315:x1874160212116480:12345-0@lo:400:kworker.0 Request processed in 24us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338934.395998:0:18556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787338934.396047:0:3316:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901889 gen 2 00000100:00100000:0.0:1787338934.396063:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf5b71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874160212116736:0@lo:400:kworker.0 00000100:00100000:0.0:1787338934.396071:0:3316:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901889 gen 2 00000100:00100000:0.0:1787338934.396077:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf5b71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874160212116608:0@lo:400:kworker.0 00010000:00080000:0.0:1787338934.396087:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbf5b72a00 x1874160212117120/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787338950 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787338934.396098:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf5b72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1874160212117120:0@lo:400:kworker.0 00010000:00080000:0.0:1787338934.396120:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbf5b73100 x1874160212116864/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787338950 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787338934.396134:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf5b73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874160212116864:0@lo:400:kworker.0 00000100:00100000:0.0:1787338934.396143:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf5b72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4530016f-1c37-4f4c-b7ee-21f57031a048:3315:1874160212116480:0@lo:400:kworker.0 00010000:00080000:0.0:1787338934.396150:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90bbf5b70700 x1874160212116992/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787338950 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787338934.396156:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf5b70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1874160212116992:0@lo:400:kworker.0 00000100:00080000:0.0:1787338934.396219:0:18558:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787338934.396223:0:18558:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787338934.396225:0:18558:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787338934.398136:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787338934.398156:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee080e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874160212117248:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787338934.398225:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338934.398353:0:19249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212117248 00000100:00100000:1.0:1787338934.398360:0:19249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212117248 00000100:00100000:1.0:1787338934.398410:0:19249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787338934.398419:0:19249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee081f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874160212117248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787338934.398452:0:19249:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787338934.398497:0:19249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee081f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874160212117248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338934.398504:0:19249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787338934.398546:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee080e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874160212117248:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787338934.398705:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbedcb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874160212117376:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787338934.398735:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338934.398816:0:19250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212117376 00000100:00100000:0.0:1787338934.398821:0:19250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212117376 00000100:00100000:0.0:1787338934.398839:0:19250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787338934.398844:0:19250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbedcb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874160212117376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787338934.398863:0:19250:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787338934.398928:0:19250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbedcb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874160212117376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338934.398936:0:19250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787338934.399027:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbedcb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874160212117376:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1787338934.530550:0:20321:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg153-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787338934.903094:0:18551:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338935.927726:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787338936.247610:0:18597:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787338936.637162:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338936.637261:0:18557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192215680 00000100:00100000:3.0:1787338936.637272:0:18557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192215680 00000100:00100000:3.0:1787338936.643551:0:18557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 75 00000100:00100000:3.0:1787338936.643587:0:18557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbff90ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2355:x1874160192215680:12345-192.168.201.53@tcp:250:mount.lustre.0 00010000:00080000:3.0:1787338936.643620:0:18557:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from f6691873-d8b0-4399-ba40-203a8aa11ea0@192.168.201.53@tcp t0 exp 0000000000000000 cur 589 last 0 00000020:00000080:3.0:1787338936.643651:0:18557:0:(genops.c:1385:class_connect()) connect: client f6691873-d8b0-4399-ba40-203a8aa11ea0, cookie 0x83671231080c3270 00000100:00080000:3.0:1787338936.643833:0:18557:0:(import.c:65:import_set_state_nolock()) ffff90bac1c36800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787338936.643940:0:18557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbff90ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6691873-d8b0-4399-ba40-203a8aa11ea0+5:2355:x1874160192215680:12345-192.168.201.53@tcp:250:mount.lustre.0 Request processed in 354us (6788us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338936.643949:0:18557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 75 00000100:00100000:2.0:1787338936.666293:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338936.667994:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192215808 00000100:00100000:0.0:1787338936.668009:0:18554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192215808 00000100:00100000:2.0:1787338936.671680:0:18554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 76 00000100:00100000:2.0:1787338936.671696:0:18554:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbff90d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6691873-d8b0-4399-ba40-203a8aa11ea0+5:16801:x1874160192215808:12345-192.168.201.53@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787338936.671715:0:18554:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787338936.671734:0:18554:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90bbf40e3600/0x83671231080c3277 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x81bcb3edadabce1 expref: -99 pid: 18554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338936.671774:0:18554:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bbf40e3600/0x83671231080c3277 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabce1 expref: 6 pid: 18554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338936.671785:0:18554:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90bbf40e3600/0x83671231080c3277 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabce1 expref: 6 pid: 18554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338936.671804:0:18554:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf40e3600, rc 0) 00000100:00100000:2.0:1787338936.671911:0:18554:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbff90d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6691873-d8b0-4399-ba40-203a8aa11ea0+6:16801:x1874160192215808:12345-192.168.201.53@tcp:101:mount.lustre.0 Request processed in 218us (5628us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338936.671918:0:18554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 76 00000100:00100000:2.0:1787338936.683625:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338936.686541:0:18557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192215936 00000100:00100000:3.0:1787338936.686557:0:18557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192215936 00000100:00100000:3.0:1787338936.686618:0:18557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 77 00000100:00100000:3.0:1787338936.686630:0:18557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbff90e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6691873-d8b0-4399-ba40-203a8aa11ea0+6:16801:x1874160192215936:12345-192.168.201.53@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787338936.698095:0:18557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbff90e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6691873-d8b0-4399-ba40-203a8aa11ea0+6:16801:x1874160192215936:12345-192.168.201.53@tcp:501:mount.lustre.0 Request processed in 11439us (14451us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787338936.698135:0:18557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 77 00000100:00100000:1.0:1787338936.700752:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338936.700934:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192216064 00000100:00100000:2.0:1787338936.700957:0:18554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192216064 00000100:00100000:2.0:1787338936.701071:0:18554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 78 00000100:00100000:2.0:1787338936.701097:0:18554:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbff90d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6691873-d8b0-4399-ba40-203a8aa11ea0+6:16801:x1874160192216064:12345-192.168.201.53@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787338936.701129:0:18554:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787338936.701166:0:18554:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90bbf40e2600/0x83671231080c327e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x81bcb3edadabce8 expref: -99 pid: 18554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338936.701224:0:18554:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bbf40e2600/0x83671231080c327e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabce8 expref: 7 pid: 18554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338936.701237:0:18554:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90bbf40e2600/0x83671231080c327e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabce8 expref: 7 pid: 18554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338936.701262:0:18554:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf40e2600, rc 0) 00000100:00100000:2.0:1787338936.701946:0:18554:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbff90d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6691873-d8b0-4399-ba40-203a8aa11ea0+7:16801:x1874160192216064:12345-192.168.201.53@tcp:101:mount.lustre.0 Request processed in 857us (1201us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338936.701954:0:18554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 78 00000100:00100000:2.0:1787338936.707545:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338936.708489:0:18557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192216192 00000100:00100000:1.0:1787338936.708500:0:18557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192216192 00000100:00100000:1.0:1787338936.708559:0:18557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 79 00000100:00100000:1.0:1787338936.708569:0:18557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbff90dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6691873-d8b0-4399-ba40-203a8aa11ea0+7:16801:x1874160192216192:12345-192.168.201.53@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787338936.708942:0:18557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbff90dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6691873-d8b0-4399-ba40-203a8aa11ea0+8:16801:x1874160192216192:12345-192.168.201.53@tcp:501:mount.lustre.0 Request processed in 373us (1406us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338936.708950:0:18557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 79 00000100:00100000:0.0:1787338936.722273:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338936.722588:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192216320 00000100:00100000:2.0:1787338936.722599:0:18554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192216320 00000100:00100000:2.0:1787338936.722658:0:18554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 80 00000100:00100000:2.0:1787338936.722670:0:18554:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbef28b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6691873-d8b0-4399-ba40-203a8aa11ea0+8:16801:x1874160192216320:12345-192.168.201.53@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787338936.723122:0:18554:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbef28b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6691873-d8b0-4399-ba40-203a8aa11ea0+8:16801:x1874160192216320:12345-192.168.201.53@tcp:503:mount.lustre.0 Request processed in 453us (858us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338936.723131:0:18554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 80 00000100:00100000:0.0:1787338936.740577:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338936.740812:0:18556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192216448 00000100:00100000:3.0:1787338936.740822:0:18556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192216448 00000100:00100000:3.0:1787338936.740908:0:18556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 81 00000100:00100000:3.0:1787338936.740919:0:18556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbef28a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6691873-d8b0-4399-ba40-203a8aa11ea0+8:16820:x1874160192216448:12345-192.168.201.53@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787338936.741255:0:18556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbef28a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6691873-d8b0-4399-ba40-203a8aa11ea0+8:16820:x1874160192216448:12345-192.168.201.53@tcp:502:llog_process_th.0 Request processed in 337us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338936.741263:0:18556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 81 00000100:00100000:3.0:1787338936.767410:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338936.767554:0:18557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192216576 00000100:00100000:1.0:1787338936.767563:0:18557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192216576 00000100:00100000:1.0:1787338936.767618:0:18557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 82 00000100:00100000:1.0:1787338936.767629:0:18557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbef288c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6691873-d8b0-4399-ba40-203a8aa11ea0+8:16820:x1874160192216576:12345-192.168.201.53@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787338936.767985:0:18557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbef288c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6691873-d8b0-4399-ba40-203a8aa11ea0+8:16820:x1874160192216576:12345-192.168.201.53@tcp:502:llog_process_th.0 Request processed in 357us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338936.767994:0:18557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 82 00000100:00100000:0.0:1787338936.776079:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338936.776469:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192216704 00000100:00100000:2.0:1787338936.776479:0:18554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192216704 00000100:00100000:2.0:1787338936.776532:0:18554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 83 00000100:00100000:2.0:1787338936.776542:0:18554:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbef289450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6691873-d8b0-4399-ba40-203a8aa11ea0+8:16801:x1874160192216704:12345-192.168.201.53@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787338936.776557:0:18554:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787338936.776574:0:18554:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90bbf40e2c00/0x83671231080c3285 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x81bcb3edadabd12 expref: -99 pid: 18554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338936.776601:0:18554:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bbf40e2c00/0x83671231080c3285 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabd12 expref: 9 pid: 18554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338936.776611:0:18554:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90bbf40e2c00/0x83671231080c3285 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabd12 expref: 9 pid: 18554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338936.776619:0:18554:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf40e2c00, rc 0) 00000100:00100000:2.0:1787338936.776677:0:18554:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbef289450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6691873-d8b0-4399-ba40-203a8aa11ea0+9:16801:x1874160192216704:12345-192.168.201.53@tcp:101:mount.lustre.0 Request processed in 137us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338936.776684:0:18554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 83 00000100:00100000:0.0:1787338936.780924:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338936.781015:0:18556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192216832 00000100:00100000:3.0:1787338936.781025:0:18556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192216832 00000100:00100000:3.0:1787338936.781085:0:18556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 84 00000100:00100000:3.0:1787338936.781096:0:18556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbef288450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6691873-d8b0-4399-ba40-203a8aa11ea0+9:16801:x1874160192216832:12345-192.168.201.53@tcp:256:mount.lustre.0 20000000:01000000:3.0:1787338936.781136:0:18556:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1787338936.781174:0:18556:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1787338936.781185:0:18556:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1787338936.781188:0:18556:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1787338936.781191:0:18556:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 11 00000100:00100000:0.0:1787338936.782816:0:18556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbef288450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6691873-d8b0-4399-ba40-203a8aa11ea0+9:16801:x1874160192216832:12345-192.168.201.53@tcp:256:mount.lustre.0 Request processed in 1713us (1932us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338936.782830:0:18556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 84 00000100:00100000:0.0:1787338936.789633:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338936.789726:0:18557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192216960 00000100:00100000:1.0:1787338936.789736:0:18557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192216960 00000100:00100000:1.0:1787338936.789797:0:18557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 85 00000100:00100000:1.0:1787338936.789808:0:18557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbef28b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6691873-d8b0-4399-ba40-203a8aa11ea0+9:16801:x1874160192216960:12345-192.168.201.53@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787338936.789824:0:18557:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787338936.789856:0:18557:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90bbfbe9d600/0x83671231080c328c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x81bcb3edadabd19 expref: -99 pid: 18557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338936.789912:0:18557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bbfbe9d600/0x83671231080c328c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabd19 expref: 10 pid: 18557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338936.789924:0:18557:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90bbfbe9d600/0x83671231080c328c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabd19 expref: 10 pid: 18557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338936.789935:0:18557:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbfbe9d600, rc 0) 00000100:00100000:1.0:1787338936.790001:0:18557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbef28b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6691873-d8b0-4399-ba40-203a8aa11ea0+10:16801:x1874160192216960:12345-192.168.201.53@tcp:101:mount.lustre.0 Request processed in 194us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338936.790007:0:18557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 85 00000100:00100000:1.0:1787338936.802609:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338936.802713:0:18556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192217088 00000100:00100000:0.0:1787338936.802725:0:18556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192217088 00000100:00100000:0.0:1787338936.802792:0:18556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 86 00000100:00100000:0.0:1787338936.802803:0:18556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbef289850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6691873-d8b0-4399-ba40-203a8aa11ea0+10:16801:x1874160192217088:12345-192.168.201.53@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787338936.803596:0:18556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbef289850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6691873-d8b0-4399-ba40-203a8aa11ea0+10:16801:x1874160192217088:12345-192.168.201.53@tcp:501:mount.lustre.0 Request processed in 789us (993us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338936.803605:0:18556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 86 00000100:00100000:3.0:1787338936.819974:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338936.820077:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192217216 00000100:00100000:2.0:1787338936.820086:0:18554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192217216 00000100:00100000:2.0:1787338936.820317:0:18554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 87 00000100:00100000:2.0:1787338936.820337:0:18554:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbef28b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6691873-d8b0-4399-ba40-203a8aa11ea0+10:16801:x1874160192217216:12345-192.168.201.53@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787338936.820628:0:18554:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbef28b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6691873-d8b0-4399-ba40-203a8aa11ea0+10:16801:x1874160192217216:12345-192.168.201.53@tcp:503:mount.lustre.0 Request processed in 301us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338936.823054:0:18554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 87 00000100:00100000:2.0:1787338936.826577:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338936.826675:0:18557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192217344 00000100:00100000:1.0:1787338936.826686:0:18557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192217344 00000100:00100000:1.0:1787338936.826745:0:18557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 88 00000100:00100000:1.0:1787338936.826755:0:18557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbef289c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6691873-d8b0-4399-ba40-203a8aa11ea0+10:16825:x1874160192217344:12345-192.168.201.53@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787338936.827116:0:18557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbef289c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6691873-d8b0-4399-ba40-203a8aa11ea0+10:16825:x1874160192217344:12345-192.168.201.53@tcp:502:llog_process_th.0 Request processed in 361us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338936.827124:0:18557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 88 00000100:00100000:1.0:1787338936.840100:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338936.840317:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192217472 00000100:00100000:2.0:1787338936.840327:0:18554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192217472 00000100:00100000:2.0:1787338936.840387:0:18554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 89 00000100:00100000:2.0:1787338936.840398:0:18554:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbef28bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6691873-d8b0-4399-ba40-203a8aa11ea0+10:16825:x1874160192217472:12345-192.168.201.53@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787338936.840664:0:18554:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbef28bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6691873-d8b0-4399-ba40-203a8aa11ea0+10:16825:x1874160192217472:12345-192.168.201.53@tcp:502:llog_process_th.0 Request processed in 266us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338936.840673:0:18554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 89 00000100:00100000:3.0:1787338936.857850:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338936.858393:0:18562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192217600 00000100:00100000:0.0:1787338936.858405:0:18562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192217600 00000100:00100000:0.0:1787338936.858457:0:18562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 4 00000100:00100000:0.0:1787338936.858465:0:18562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbedcb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2355:x1874160192217600:12345-192.168.201.53@tcp:38:mount.lustre.0 00010000:00080000:0.0:1787338936.858492:0:18562:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from f11a8df7-6b86-4272-87dd-120efc0a0f31@192.168.201.53@tcp t0 exp 0000000000000000 cur 589 last 0 00000020:00000080:0.0:1787338936.858540:0:18562:0:(genops.c:1385:class_connect()) connect: client f11a8df7-6b86-4272-87dd-120efc0a0f31, cookie 0x83671231080c3293 00000004:00100000:0.0:1787338936.858571:0:18562:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1787338936.858576:0:18562:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000100:00080000:0.0:1787338936.895699:0:18562:0:(import.c:65:import_set_state_nolock()) ffff90bac1229800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787338936.895799:0:18562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbedcb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f11a8df7-6b86-4272-87dd-120efc0a0f31+6:2355:x1874160192217600:12345-192.168.201.53@tcp:38:mount.lustre.0 Request processed in 37331us (37959us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338936.895812:0:18562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 4 00000100:00100000:0.0:1787338936.898325:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338936.898395:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338936.899950:0:19270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192217856 00000100:00100000:3.0:1787338936.899964:0:19270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192217856 00000100:00100000:3.0:1787338936.900033:0:19270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192217728 00000100:00100000:3.0:1787338936.900037:0:19270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192217728 00000100:00100000:3.0:1787338936.900063:0:19270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 5 00000100:00100000:3.0:1787338936.900074:0:19270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee080e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f11a8df7-6b86-4272-87dd-120efc0a0f31+7:16801:x1874160192217856:12345-192.168.201.53@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787338936.900116:0:19270:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787338936.900201:0:19270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee080e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f11a8df7-6b86-4272-87dd-120efc0a0f31+7:16801:x1874160192217856:12345-192.168.201.53@tcp:41:mount.lustre.0 Request processed in 129us (1884us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338936.900208:0:19270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 5 00000100:00100000:3.0:1787338936.900223:0:19270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 6 00000100:00100000:3.0:1787338936.900227:0:19270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee083100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f11a8df7-6b86-4272-87dd-120efc0a0f31+6:0:x1874160192217728:12345-192.168.201.53@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787338936.900235:0:19270:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787338936.900251:0:19270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee083100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f11a8df7-6b86-4272-87dd-120efc0a0f31+6:0:x1874160192217728:12345-192.168.201.53@tcp:41:mount.lustre.0 Request processed in 24us (1856us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338936.900255:0:19270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 6 00000100:00080000:0.0:1787338936.900723:0:18558:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787338936.906289:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338936.906548:0:19270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192217984 00000100:00100000:3.0:1787338936.906612:0:19270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192217984 00000100:00100000:3.0:1787338936.906728:0:19270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 7 00000100:00100000:3.0:1787338936.906740:0:19270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf7ed6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f11a8df7-6b86-4272-87dd-120efc0a0f31+6:16801:x1874160192217984:12345-192.168.201.53@tcp:40:mount.lustre.0 00000100:00100000:3.0:1787338936.906846:0:19270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf7ed6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f11a8df7-6b86-4272-87dd-120efc0a0f31+6:16801:x1874160192217984:12345-192.168.201.53@tcp:40:mount.lustre.0 Request processed in 108us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338936.906868:0:19270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 7 00000100:00100000:3.0:1787338936.924165:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338936.924195:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338936.924222:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338936.924292:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192218112 00000100:00100000:1.0:1787338936.924301:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192218112 00000100:00100000:1.0:1787338936.924332:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192218240 00000100:00100000:1.0:1787338936.924334:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192218240 00000100:00100000:1.0:1787338936.924346:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 6 00000100:00100000:1.0:1787338936.924352:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbedcb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2355:x1874160192218112:12345-192.168.201.53@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787338936.924389:0:19246:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from f11a8df7-6b86-4272-87dd-120efc0a0f31@192.168.201.53@tcp t0 exp 0000000000000000 cur 589 last 0 00000020:00000080:1.0:1787338936.924413:0:19246:0:(genops.c:1385:class_connect()) connect: client f11a8df7-6b86-4272-87dd-120efc0a0f31, cookie 0x83671231080c329a 00002000:00100000:1.0:1787338936.924421:0:19246:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli f11a8df7-6b86-4272-87dd-120efc0a0f31/ffff90bbe826f000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787338936.924440:0:19246:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787338936.924753:0:19246:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787338936.924794:0:19246:0:(import.c:65:import_set_state_nolock()) ffff90bbe826a800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787338936.924902:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbedcb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f11a8df7-6b86-4272-87dd-120efc0a0f31+6:2355:x1874160192218112:12345-192.168.201.53@tcp:8:mount.lustre.0 Request processed in 519us (675us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338936.924911:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 6 00000100:00100000:1.0:1787338936.924931:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 7 00000100:00100000:1.0:1787338936.924935:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbedcb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2355:x1874160192218240:12345-192.168.201.53@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787338936.924952:0:19246:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from f11a8df7-6b86-4272-87dd-120efc0a0f31@192.168.201.53@tcp t0 exp 0000000000000000 cur 589 last 0 00000020:00000080:1.0:1787338936.924966:0:19246:0:(genops.c:1385:class_connect()) connect: client f11a8df7-6b86-4272-87dd-120efc0a0f31, cookie 0x83671231080c32a1 00002000:00100000:1.0:1787338936.924971:0:19246:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli f11a8df7-6b86-4272-87dd-120efc0a0f31/ffff90bbe826d800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787338936.924985:0:19246:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787338936.925148:0:19246:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787338936.925167:0:19246:0:(import.c:65:import_set_state_nolock()) ffff90bbe826d000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787338936.925191:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbedcb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f11a8df7-6b86-4272-87dd-120efc0a0f31+6:2355:x1874160192218240:12345-192.168.201.53@tcp:8:mount.lustre.0 Request processed in 254us (968us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338936.925198:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 7 00000100:00100000:0.0:1787338936.926974:0:18565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192218368 00000100:00100000:0.0:1787338936.926987:0:18565:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192218368 00000100:00100000:0.0:1787338936.927049:0:18565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 0 00000100:00100000:0.0:1787338936.927058:0:18565:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbedcb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f11a8df7-6b86-4272-87dd-120efc0a0f31+6:16801:x1874160192218368:12345-192.168.201.53@tcp:33:mount.lustre.0 00000004:00080000:1.0:1787338936.931127:0:18565:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 4010us 00000004:00200000:1.0:1787338936.941653:0:18565:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:1.0:1787338936.941834:0:18565:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbedcb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f11a8df7-6b86-4272-87dd-120efc0a0f31+6:16801:x1874160192218368:12345-192.168.201.53@tcp:33:mount.lustre.0 Request processed in 14771us (17670us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338936.941864:0:18565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 0 00010000:00010000:1.0:1787338936.950191:0:18551:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787338937.041501:0:6714:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f11a8df7-6b86-4272-87dd-120efc0a0f31 00000100:00100000:3.0:1787338937.261860:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338937.262050:0:18562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192218496 00000100:00100000:0.0:1787338937.262060:0:18562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192218496 00000100:00100000:0.0:1787338937.262124:0:18562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 8 00000100:00100000:0.0:1787338937.262135:0:18562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbedcb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f11a8df7-6b86-4272-87dd-120efc0a0f31+6:16846:x1874160192218496:12345-192.168.201.53@tcp:101:mkdir.0 00010000:00010000:0.0:1787338937.262166:0:18562:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787338937.262233:0:18562:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93200/0x83671231080c32a8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadabd43 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338937.262300:0:18562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b92800/0x83671231080c32af lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338937.262315:0:18562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b92800/0x83671231080c32af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338937.262329:0:18562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b92800/0x83671231080c32af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18562 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787338937.262808:0:18562:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787338937.262814:0:18562:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:0.0:1787338937.262950:0:18562:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b92800/0x83671231080c32af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338937.262981:0:18562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93200/0x83671231080c32a8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabd43 expref: 8 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338937.263042:0:18562:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b92800/0x83671231080c32af lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabd43 expref: 7 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338937.263052:0:18562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90bbeb14d800) 00010000:00010000:0.0:1787338937.263056:0:18562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787338937.263060:0:18562:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bac3b92800, rc 0) 00000100:00100000:0.0:1787338937.264272:0:18562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbedcb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f11a8df7-6b86-4272-87dd-120efc0a0f31+7:16846:x1874160192218496:12345-192.168.201.53@tcp:101:mkdir.0 Request processed in 2133us (2416us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338937.264283:0:18562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 8 00010000:00010000:3.0:1787338937.974158:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787338938.595700:0:7651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f11a8df7-6b86-4272-87dd-120efc0a0f31 00010000:00010000:1.0:1787338938.998108:0:18551:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787338939.197706:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338939.215106:0:18564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192218624 00000100:00100000:0.0:1787338939.215120:0:18564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192218624 00000100:00100000:0.0:1787338939.215204:0:18564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 9 00000100:00100000:0.0:1787338939.215215:0:18564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf5b73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f11a8df7-6b86-4272-87dd-120efc0a0f31+7:16898:x1874160192218624:12345-192.168.201.53@tcp:41:lfs.0 00000004:00000024:0.0:1787338939.215258:0:18564:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787338939.215358:0:18564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf5b73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f11a8df7-6b86-4272-87dd-120efc0a0f31+7:16898:x1874160192218624:12345-192.168.201.53@tcp:41:lfs.0 Request processed in 144us (17661us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338939.215366:0:18564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 9 00000100:00080000:1.0:1787338939.216112:0:18558:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787338939.225650:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338939.225767:0:19250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192218752 00000100:00100000:0.0:1787338939.225779:0:19250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192218752 00000100:00100000:0.0:1787338939.225857:0:19250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 4 00000100:00100000:0.0:1787338939.225867:0:19250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbedcb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f11a8df7-6b86-4272-87dd-120efc0a0f31+5:16898:x1874160192218752:12345-192.168.201.53@tcp:13:lfs.0 00002000:00000024:0.0:1787338939.225941:0:19250:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787338939.226013:0:19250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbedcb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f11a8df7-6b86-4272-87dd-120efc0a0f31+5:16898:x1874160192218752:12345-192.168.201.53@tcp:13:lfs.0 Request processed in 147us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338939.226020:0:19250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 4 00000100:00080000:1.0:1787338939.226107:0:18558:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787338939.234400:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338939.234510:0:19250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192218880 00000100:00100000:2.0:1787338939.234521:0:19250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192218880 00000100:00100000:2.0:1787338939.234666:0:19250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 5 00000100:00100000:2.0:1787338939.234678:0:19250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee081880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f11a8df7-6b86-4272-87dd-120efc0a0f31+5:16898:x1874160192218880:12345-192.168.201.53@tcp:13:lfs.0 00002000:00000024:2.0:1787338939.234711:0:19250:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787338939.234806:0:19250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee081880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f11a8df7-6b86-4272-87dd-120efc0a0f31+5:16898:x1874160192218880:12345-192.168.201.53@tcp:13:lfs.0 Request processed in 131us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338939.234813:0:19250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 5 00000100:00080000:1.0:1787338939.236181:0:18558:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787338939.512803:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf5b72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874160212117888:0@lo:400:kworker.0 00000100:00100000:0.0:1787338939.512818:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf5b72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874160212117632:0@lo:400:kworker.0 00000100:00100000:3.0:1787338939.512919:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf5b70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4530016f-1c37-4f4c-b7ee-21f57031a048:3315:1874160212117504:0@lo:400:kworker.0 00000100:00100000:2.0:1787338939.512997:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf5b73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874160212117760:0@lo:400:kworker.0 00000100:00100000:0.0:1787338939.517536:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338939.517612:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf5b71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1874160212118144:0@lo:400:kworker.0 00000100:00100000:0.0:1787338939.517650:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338939.517738:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212117632 00000100:00100000:0.0:1787338939.517746:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212117632 00000100:00100000:0.0:1787338939.517810:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787338939.517819:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee082a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1874160212117632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787338939.517871:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee082a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1874160212117632:12345-0@lo:400:kworker.0 Request processed in 53us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338939.517892:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787338939.517932:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf5b72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874160212117632:0@lo:400:kworker.0 00000100:00100000:0.0:1787338939.517961:0:18563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212118144 00000100:00100000:0.0:1787338939.517964:0:18563:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212118144 00000100:00100000:0.0:1787338939.517987:0:18563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787338939.517994:0:18563:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee082680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874160212118144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787338939.518028:0:18563:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee082680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874160212118144:12345-0@lo:400:kworker.0 Request processed in 34us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338939.518034:0:18563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787338939.518060:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf5b71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1874160212118144:0@lo:400:kworker.0 00000100:00080000:0.0:1787338939.518084:0:18558:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787338939.518089:0:18558:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787338939.518669:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338939.518699:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc4095f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874160212118400:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787338939.518743:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338939.518916:0:18564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212117888 00000100:00100000:0.0:1787338939.518922:0:18564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212117888 00000100:00100000:0.0:1787338939.518952:0:18564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787338939.518959:0:18564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf7ed4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874160212117888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787338939.519868:0:18564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf7ed4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874160212117888:12345-0@lo:400:kworker.0 Request processed in 896us (1187us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338939.519912:0:18564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787338939.520137:0:19250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212118400 00000100:00100000:0.0:1787338939.520144:0:19250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212118400 00000100:00100000:0.0:1787338939.520178:0:19250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787338939.520187:0:19250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf7ed4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874160212118400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787338939.520205:0:19250:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787338939.520241:0:19250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf7ed4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874160212118400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 55us (1497us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338939.520248:0:19250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787338939.520463:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc4095f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874160212118400:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787338939.520478:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf5b72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874160212117888:0@lo:400:kworker.0 00000100:00100000:3.0:1787338939.522609:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338939.522633:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338939.522664:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf5b71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1874160212118016:0@lo:400:kworker.0 00000100:00100000:1.0:1787338939.522670:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212117504 00000100:00100000:1.0:1787338939.522678:0:18554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212117504 00000100:00100000:3.0:1787338939.522699:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338939.522764:0:18563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212118016 00000100:00100000:0.0:1787338939.522774:0:18563:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212118016 00000100:00100000:0.0:1787338939.522815:0:18563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787338939.522825:0:18563:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbedcb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874160212118016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787338939.523469:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192219008 00000100:00100000:1.0:1787338939.523474:0:18554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192219008 00000100:00100000:0.0:1787338939.523523:0:18563:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbedcb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874160212118016:12345-0@lo:400:kworker.0 Request processed in 698us (822us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338939.523531:0:18563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:0.0:1787338939.523667:0:18558:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787338939.523785:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338939.523821:0:19248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212117760 00000100:00100000:2.0:1787338939.523825:0:19248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212117760 00000100:00100000:2.0:1787338939.523870:0:19248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787338939.523892:0:19248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4095880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1874160212117760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787338939.523928:0:19248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4095880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1874160212117760:12345-0@lo:400:kworker.0 Request processed in 38us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338939.523946:0:19248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787338939.523981:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf5b73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874160212117760:0@lo:400:kworker.0 00000100:00100000:2.0:1787338939.523990:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee080380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874160212118272:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787338939.524014:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338939.524158:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf5b71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1874160212118016:0@lo:400:kworker.0 00000100:00100000:3.0:1787338939.526834:0:18556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787338939.527048:0:18554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 91 00000100:00100000:3.0:1787338939.527054:0:18556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbef28a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4530016f-1c37-4f4c-b7ee-21f57031a048+19:3315:x1874160212117504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787338939.527065:0:18554:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbef28ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6691873-d8b0-4399-ba40-203a8aa11ea0+10:16932:x1874160192219008:12345-192.168.201.53@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787338939.527084:0:18554:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787338939.527103:0:18554:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90bbfbe9dc00/0x83671231080c32b6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x81bcb3edadabd4a expref: -99 pid: 18554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338939.527130:0:18554:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bbfbe9dc00/0x83671231080c32b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabd4a expref: 11 pid: 18554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338939.527164:0:18554:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90bbfbe9dc00/0x83671231080c32b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabd4a expref: 11 pid: 18554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338939.527171:0:18556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbef28a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4530016f-1c37-4f4c-b7ee-21f57031a048+19:3315:x1874160212117504:12345-0@lo:400:kworker.0 Request processed in 149us (4565us total) trans 0 rc 0/0 00010000:00010000:1.0:1787338939.527176:0:18554:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbfbe9dc00, rc 0) 00000100:00100000:3.0:1787338939.527183:0:18556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787338939.527226:0:18554:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbef28ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6691873-d8b0-4399-ba40-203a8aa11ea0+11:16932:x1874160192219008:12345-192.168.201.53@tcp:101:mount.lustre.0 Request processed in 166us (4595us total) trans 0 rc 0/0 00000100:00080000:0.0:1787338939.527660:0:18558:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787338939.527682:0:19250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212118272 00000100:00100000:0.0:1787338939.527689:0:19250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212118272 00000100:00100000:3.0:1787338939.527694:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf5b70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4530016f-1c37-4f4c-b7ee-21f57031a048:3315:1874160212117504:0@lo:400:kworker.0 00000100:00100000:1.0:1787338939.527797:0:18554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 91 00000100:00100000:0.0:1787338939.528129:0:19250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787338939.528139:0:19250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4094a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874160212118272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787338939.528158:0:19250:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787338939.528208:0:19250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4094a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874160212118272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (4193us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338939.528227:0:19250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787338939.528801:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee080380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874160212118272:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787338939.530819:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338939.531047:0:18557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192219136 00000100:00100000:1.0:1787338939.531056:0:18557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192219136 00000100:00100000:1.0:1787338939.531112:0:18557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 92 00000100:00100000:1.0:1787338939.531122:0:18557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbef289050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6691873-d8b0-4399-ba40-203a8aa11ea0+11:16932:x1874160192219136:12345-192.168.201.53@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787338939.531422:0:18557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbef289050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6691873-d8b0-4399-ba40-203a8aa11ea0+11:16932:x1874160192219136:12345-192.168.201.53@tcp:501:mount.lustre.0 Request processed in 300us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338939.531440:0:18557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 92 00000100:00100000:1.0:1787338939.533549:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338939.534047:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192219264 00000100:00100000:2.0:1787338939.534056:0:18554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192219264 00000100:00100000:2.0:1787338939.534105:0:18554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 93 00000100:00100000:2.0:1787338939.534116:0:18554:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbef28a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6691873-d8b0-4399-ba40-203a8aa11ea0+11:16932:x1874160192219264:12345-192.168.201.53@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787338939.535086:0:18554:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbef28a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6691873-d8b0-4399-ba40-203a8aa11ea0+11:16932:x1874160192219264:12345-192.168.201.53@tcp:503:mount.lustre.0 Request processed in 968us (1540us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338939.535096:0:18554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 93 00000100:00100000:2.0:1787338939.545176:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338939.545823:0:18556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192219392 00000100:00100000:3.0:1787338939.545835:0:18556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192219392 00000100:00100000:3.0:1787338939.545915:0:18556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 94 00000100:00100000:3.0:1787338939.545928:0:18556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbeb0ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6691873-d8b0-4399-ba40-203a8aa11ea0+11:16937:x1874160192219392:12345-192.168.201.53@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787338939.546201:0:18556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbeb0ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6691873-d8b0-4399-ba40-203a8aa11ea0+11:16937:x1874160192219392:12345-192.168.201.53@tcp:502:llog_process_th.0 Request processed in 275us (1034us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338939.546217:0:18556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 94 00000100:00100000:0.0:1787338939.569410:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338939.569488:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192219520 00000100:00100000:2.0:1787338939.569498:0:18554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192219520 00000100:00100000:2.0:1787338939.569591:0:18554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 95 00000100:00100000:2.0:1787338939.569602:0:18554:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbeb0c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6691873-d8b0-4399-ba40-203a8aa11ea0+11:16937:x1874160192219520:12345-192.168.201.53@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787338939.569954:0:18554:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbeb0c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6691873-d8b0-4399-ba40-203a8aa11ea0+11:16937:x1874160192219520:12345-192.168.201.53@tcp:502:llog_process_th.0 Request processed in 352us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338939.569963:0:18554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 95 00000100:00100000:0.0:1787338939.581512:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338939.581606:0:18557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192219648 00000100:00100000:1.0:1787338939.581616:0:18557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192219648 00000100:00100000:1.0:1787338939.581671:0:18557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 96 00000100:00100000:1.0:1787338939.581682:0:18557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbeb0c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6691873-d8b0-4399-ba40-203a8aa11ea0+11:16932:x1874160192219648:12345-192.168.201.53@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787338939.581699:0:18557:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787338939.581728:0:18557:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90bbfbe9d400/0x83671231080c32bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x81bcb3edadabd74 expref: -99 pid: 18557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338939.581759:0:18557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bbfbe9d400/0x83671231080c32bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabd74 expref: 12 pid: 18557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338939.581790:0:18557:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90bbfbe9d400/0x83671231080c32bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabd74 expref: 12 pid: 18557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338939.581801:0:18557:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbfbe9d400, rc 0) 00000100:00100000:1.0:1787338939.581865:0:18557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbeb0c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6691873-d8b0-4399-ba40-203a8aa11ea0+12:16932:x1874160192219648:12345-192.168.201.53@tcp:101:mount.lustre.0 Request processed in 185us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338939.581916:0:18557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 96 00000100:00100000:1.0:1787338939.589465:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338939.589563:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192219776 00000100:00100000:2.0:1787338939.589574:0:18554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192219776 00000100:00100000:2.0:1787338939.589630:0:18554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 97 00000100:00100000:2.0:1787338939.589641:0:18554:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbeb0ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6691873-d8b0-4399-ba40-203a8aa11ea0+12:16932:x1874160192219776:12345-192.168.201.53@tcp:256:mount.lustre.0 20000000:01000000:2.0:1787338939.589678:0:18554:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1787338939.589696:0:18554:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787338939.589700:0:18554:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1787338939.589704:0:18554:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1787338939.589706:0:18554:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 11 00000100:00100000:2.0:1787338939.592023:0:18554:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbeb0ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6691873-d8b0-4399-ba40-203a8aa11ea0+12:16932:x1874160192219776:12345-192.168.201.53@tcp:256:mount.lustre.0 Request processed in 2374us (2558us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338939.592038:0:18554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 97 00000100:00100000:0.0:1787338939.596957:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338939.597293:0:18556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192219904 00000100:00100000:3.0:1787338939.597303:0:18556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192219904 00000100:00100000:2.0:1787338939.597488:0:18556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 98 00000100:00100000:2.0:1787338939.597500:0:18556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbeb0c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6691873-d8b0-4399-ba40-203a8aa11ea0+12:16932:x1874160192219904:12345-192.168.201.53@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787338939.597516:0:18556:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787338939.597534:0:18556:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90bbf40e3c00/0x83671231080c32c4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x81bcb3edadabd7b expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338939.597560:0:18556:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bbf40e3c00/0x83671231080c32c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabd7b expref: 13 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338939.597572:0:18556:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90bbf40e3c00/0x83671231080c32c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabd7b expref: 13 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338939.597582:0:18556:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf40e3c00, rc 0) 00000100:00100000:2.0:1787338939.597640:0:18556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbeb0c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6691873-d8b0-4399-ba40-203a8aa11ea0+13:16932:x1874160192219904:12345-192.168.201.53@tcp:101:mount.lustre.0 Request processed in 142us (693us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338939.597647:0:18556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 98 00000100:00100000:1.0:1787338939.599124:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338939.599201:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192220032 00000100:00100000:3.0:1787338939.599209:0:18554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192220032 00000100:00100000:3.0:1787338939.599252:0:18554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 99 00000100:00100000:3.0:1787338939.599263:0:18554:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbeb0cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6691873-d8b0-4399-ba40-203a8aa11ea0+13:16932:x1874160192220032:12345-192.168.201.53@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787338939.599550:0:18554:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbeb0cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6691873-d8b0-4399-ba40-203a8aa11ea0+13:16932:x1874160192220032:12345-192.168.201.53@tcp:501:mount.lustre.0 Request processed in 287us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338939.599558:0:18554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 99 00000100:00100000:0.0:1787338939.601478:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338939.601555:0:18556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192220160 00000100:00100000:2.0:1787338939.601564:0:18556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192220160 00000100:00100000:2.0:1787338939.601663:0:18556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 100 00000100:00100000:2.0:1787338939.601674:0:18556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbeb0cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6691873-d8b0-4399-ba40-203a8aa11ea0+13:16932:x1874160192220160:12345-192.168.201.53@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787338939.601945:0:18556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbeb0cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6691873-d8b0-4399-ba40-203a8aa11ea0+13:16932:x1874160192220160:12345-192.168.201.53@tcp:503:mount.lustre.0 Request processed in 272us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338939.601954:0:18556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 100 00000100:00100000:0.0:1787338939.604633:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338939.604739:0:18557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192220288 00000100:00100000:1.0:1787338939.604748:0:18557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192220288 00000100:00100000:1.0:1787338939.604795:0:18557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 101 00000100:00100000:1.0:1787338939.604806:0:18557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbeb0c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6691873-d8b0-4399-ba40-203a8aa11ea0+13:16943:x1874160192220288:12345-192.168.201.53@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787338939.605084:0:18557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbeb0c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6691873-d8b0-4399-ba40-203a8aa11ea0+13:16943:x1874160192220288:12345-192.168.201.53@tcp:502:llog_process_th.0 Request processed in 279us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338939.605092:0:18557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 101 00000100:00100000:1.0:1787338939.607121:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338939.607382:0:18556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192220416 00000100:00100000:2.0:1787338939.607391:0:18556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192220416 00000100:00100000:2.0:1787338939.607434:0:18556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 102 00000100:00100000:2.0:1787338939.607443:0:18556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc9553050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6691873-d8b0-4399-ba40-203a8aa11ea0+13:16943:x1874160192220416:12345-192.168.201.53@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787338939.607636:0:18556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc9553050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6691873-d8b0-4399-ba40-203a8aa11ea0+13:16943:x1874160192220416:12345-192.168.201.53@tcp:502:llog_process_th.0 Request processed in 194us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338939.607644:0:18556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 102 00000100:00100000:0.0:1787338939.618479:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338939.618578:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338939.618682:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192221056 00000100:00100000:1.0:1787338939.618691:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192221056 00000100:00100000:1.0:1787338939.618787:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 4 00000100:00100000:1.0:1787338939.618798:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee082300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f11a8df7-6b86-4272-87dd-120efc0a0f31+5:2357:x1874160192221056:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:1.0:1787338939.619198:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee082300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f11a8df7-6b86-4272-87dd-120efc0a0f31+5:2357:x1874160192221056:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 400us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338939.619206:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 4 00000100:00100000:3.0:1787338939.619590:0:18564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192220544 00000100:00100000:3.0:1787338939.619596:0:18564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192220544 00000100:00100000:3.0:1787338939.619631:0:18564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 10 00000100:00100000:3.0:1787338939.619647:0:18564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee080700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2355:x1874160192220544:12345-192.168.201.53@tcp:38:mount.lustre.0 00010000:00080000:3.0:1787338939.619672:0:18564:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from eed3ef97-e99d-4750-973c-88dcada624d6@192.168.201.53@tcp t0 exp 0000000000000000 cur 592 last 0 00000020:00000080:3.0:1787338939.619741:0:18564:0:(genops.c:1385:class_connect()) connect: client eed3ef97-e99d-4750-973c-88dcada624d6, cookie 0x83671231080c32cb 00000004:00100000:3.0:1787338939.619772:0:18564:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1787338939.620312:0:18564:0:(import.c:65:import_set_state_nolock()) ffff90bac2396800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787338939.620368:0:18564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee080700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eed3ef97-e99d-4750-973c-88dcada624d6+6:2355:x1874160192220544:12345-192.168.201.53@tcp:38:mount.lustre.0 Request processed in 720us (1899us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338939.620375:0:18564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 10 00000100:00100000:0.0:1787338939.625573:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338939.625626:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338939.625705:0:19248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192221184 00000100:00100000:3.0:1787338939.625731:0:19248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192221184 00000100:00100000:3.0:1787338939.625791:0:19248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 5 00000100:00100000:3.0:1787338939.625802:0:19248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee081180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f11a8df7-6b86-4272-87dd-120efc0a0f31+5:2357:x1874160192221184:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:3.0:1787338939.625917:0:19248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee081180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f11a8df7-6b86-4272-87dd-120efc0a0f31+5:2357:x1874160192221184:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 115us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338939.625924:0:19248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 5 00000100:00100000:2.0:1787338939.626327:0:18563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192220928 00000100:00100000:2.0:1787338939.626334:0:18563:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192220928 00000100:00100000:2.0:1787338939.626378:0:18563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 17 00000100:00100000:2.0:1787338939.626387:0:18563:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee083b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f11a8df7-6b86-4272-87dd-120efc0a0f31+7:2357:x1874160192220928:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:2.0:1787338939.626434:0:18563:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee083b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f11a8df7-6b86-4272-87dd-120efc0a0f31+7:2357:x1874160192220928:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 49us (871us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338939.626442:0:18563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 17 00000100:00100000:0.0:1787338939.633544:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338939.633594:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338939.633670:0:18564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192220672 00000100:00100000:2.0:1787338939.633678:0:18564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192220672 00000100:00100000:2.0:1787338939.633803:0:18564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192220800 00000100:00100000:2.0:1787338939.633807:0:18564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192220800 00000100:00080000:0.0:1787338939.633888:0:18558:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787338939.633992:0:18563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 11 00000100:00100000:1.0:1787338939.634019:0:18563:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee083800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eed3ef97-e99d-4750-973c-88dcada624d6+7:0:x1874160192220672:12345-192.168.201.53@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787338939.634052:0:18563:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1787338939.634160:0:18563:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee083800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eed3ef97-e99d-4750-973c-88dcada624d6+7:0:x1874160192220672:12345-192.168.201.53@tcp:41:mount.lustre.0 Request processed in 145us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338939.634168:0:18563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 11 00000100:00100000:1.0:1787338939.634188:0:18563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 12 00000100:00100000:1.0:1787338939.634195:0:18563:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee080380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eed3ef97-e99d-4750-973c-88dcada624d6+6:16932:x1874160192220800:12345-192.168.201.53@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787338939.634207:0:18563:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1787338939.634231:0:18563:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee080380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eed3ef97-e99d-4750-973c-88dcada624d6+6:16932:x1874160192220800:12345-192.168.201.53@tcp:41:mount.lustre.0 Request processed in 37us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338939.634237:0:18563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 12 00000100:00100000:1.0:1787338939.638790:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338939.638903:0:18563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192221312 00000100:00100000:2.0:1787338939.638930:0:18563:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192221312 00000100:00100000:2.0:1787338939.639002:0:18563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 13 00000100:00100000:2.0:1787338939.639014:0:18563:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf7ed6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eed3ef97-e99d-4750-973c-88dcada624d6+6:16932:x1874160192221312:12345-192.168.201.53@tcp:40:mount.lustre.0 00000100:00100000:2.0:1787338939.639168:0:18563:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf7ed6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eed3ef97-e99d-4750-973c-88dcada624d6+6:16932:x1874160192221312:12345-192.168.201.53@tcp:40:mount.lustre.0 Request processed in 156us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338939.639176:0:18563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 13 00000100:00100000:0.0:1787338939.646031:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338939.646077:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338939.646118:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338939.647743:0:18566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192221696 00000100:00100000:2.0:1787338939.647762:0:18566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192221696 00000100:00100000:3.0:1787338939.647795:0:19247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192221440 00000100:00100000:3.0:1787338939.647813:0:19247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192221440 00000100:00100000:2.0:1787338939.647836:0:18566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 1 00000100:00100000:3.0:1787338939.647839:0:19247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192221568 00000100:00100000:3.0:1787338939.647842:0:19247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192221568 00000100:00100000:2.0:1787338939.647850:0:18566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf5b70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eed3ef97-e99d-4750-973c-88dcada624d6+6:16932:x1874160192221696:12345-192.168.201.53@tcp:33:mount.lustre.0 00000100:00100000:3.0:1787338939.647856:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 8 00000100:00100000:3.0:1787338939.647862:0:19247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf5b71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2355:x1874160192221440:12345-192.168.201.53@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787338939.647922:0:19247:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from eed3ef97-e99d-4750-973c-88dcada624d6@192.168.201.53@tcp t0 exp 0000000000000000 cur 592 last 0 00000020:00000080:3.0:1787338939.647958:0:19247:0:(genops.c:1385:class_connect()) connect: client eed3ef97-e99d-4750-973c-88dcada624d6, cookie 0x83671231080c32d2 00002000:00100000:3.0:1787338939.647971:0:19247:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli eed3ef97-e99d-4750-973c-88dcada624d6/ffff90bbf5b27800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787338939.647983:0:19247:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000004:00200000:2.0:1787338939.648139:0:18566:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00002000:00080000:3.0:1787338939.648296:0:19247:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787338939.648331:0:19247:0:(import.c:65:import_set_state_nolock()) ffff90bbf5b23800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787338939.648395:0:20031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 9 00000100:00100000:0.0:1787338939.648403:0:20031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf5b73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2355:x1874160192221568:12345-192.168.201.53@tcp:8:mount.lustre.0 00000100:00100000:3.0:1787338939.648411:0:19247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf5b71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eed3ef97-e99d-4750-973c-88dcada624d6+6:2355:x1874160192221440:12345-192.168.201.53@tcp:8:mount.lustre.0 Request processed in 546us (2332us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338939.648419:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 8 00010000:00080000:0.0:1787338939.648427:0:20031:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from eed3ef97-e99d-4750-973c-88dcada624d6@192.168.201.53@tcp t0 exp 0000000000000000 cur 592 last 0 00000020:00000080:0.0:1787338939.648453:0:20031:0:(genops.c:1385:class_connect()) connect: client eed3ef97-e99d-4750-973c-88dcada624d6, cookie 0x83671231080c32d9 00002000:00100000:0.0:1787338939.648460:0:20031:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli eed3ef97-e99d-4750-973c-88dcada624d6/ffff90bbc55a5800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787338939.648467:0:20031:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787338939.648647:0:20031:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787338939.648669:0:20031:0:(import.c:65:import_set_state_nolock()) ffff90bbc7efb800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787338939.648725:0:20031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf5b73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eed3ef97-e99d-4750-973c-88dcada624d6+6:2355:x1874160192221568:12345-192.168.201.53@tcp:8:mount.lustre.0 Request processed in 320us (2605us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338939.648734:0:20031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 9 00000100:00100000:2.0:1787338939.649783:0:18566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf5b70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eed3ef97-e99d-4750-973c-88dcada624d6+6:16932:x1874160192221696:12345-192.168.201.53@tcp:33:mount.lustre.0 Request processed in 1932us (3756us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338939.649795:0:18566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 1 00000100:00100000:0.0:1787338939.790929:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338939.791741:0:19270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192221824 00000100:00100000:3.0:1787338939.791753:0:19270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192221824 00000100:00100000:3.0:1787338939.791824:0:19270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 14 00000100:00100000:3.0:1787338939.791834:0:19270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf5b72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eed3ef97-e99d-4750-973c-88dcada624d6+6:16964:x1874160192221824:12345-192.168.201.53@tcp:101:mkdir.0 00010000:00010000:3.0:1787338939.791853:0:19270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787338939.791909:0:19270:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5600/0x83671231080c32e0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadabda5 expref: -99 pid: 19270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338939.791976:0:19270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c32e7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338939.791988:0:19270:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c32e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338939.792018:0:19270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c32e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787338939.792225:0:19270:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787338939.792230:0:19270:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:3.0:1787338939.793285:0:19270:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c32e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338939.793402:0:19270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5600/0x83671231080c32e0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabda5 expref: 8 pid: 19270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338939.793698:0:19270:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c32e7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabda5 expref: 7 pid: 19270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338939.793718:0:19270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90bbeb14d800) 00010000:00010000:3.0:1787338939.793721:0:19270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787338939.793725:0:19270:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf7ea5800, rc 0) 00000100:00100000:3.0:1787338939.793804:0:19270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf5b72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eed3ef97-e99d-4750-973c-88dcada624d6+7:16964:x1874160192221824:12345-192.168.201.53@tcp:101:mkdir.0 Request processed in 1969us (2882us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338939.793812:0:19270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 14 00010000:00010000:0.0:1787338940.026959:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338941.050224:0:18551:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338942.070356:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787338942.136948:0:5861:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f11a8df7-6b86-4272-87dd-120efc0a0f31 00000001:00100000:1.0:1787338942.136965:0:5861:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of eed3ef97-e99d-4750-973c-88dcada624d6 00000001:00100000:3.0:1787338942.162827:0:6714:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of eed3ef97-e99d-4750-973c-88dcada624d6 00000001:02000400:2.0:1787338942.625289:0:20524:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1787338943.094547:0:18551:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787338943.707189:0:7651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of eed3ef97-e99d-4750-973c-88dcada624d6 00010000:00010000:1.0:1787338944.132403:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787338944.633496:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc4096680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874160212118656:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787338944.633565:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338944.633645:0:19249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212118656 00000100:00100000:2.0:1787338944.633652:0:19249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212118656 00000100:00100000:2.0:1787338944.633706:0:19249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787338944.633718:0:19249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4094e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874160212118656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787338944.633751:0:19249:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787338944.633795:0:19249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4094e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874160212118656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338944.633802:0:19249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1787338944.633823:0:18558:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787338944.633867:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc4096680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874160212118656:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787338944.633954:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee44ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874160212118528:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787338944.633988:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338944.634398:0:19250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212118528 00000100:00100000:0.0:1787338944.634402:0:19250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212118528 00000100:00100000:0.0:1787338944.634429:0:19250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787338944.634438:0:19250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee44d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874160212118528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787338944.634457:0:19250:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787338944.634488:0:19250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee44d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874160212118528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 53us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338944.634494:0:19250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1787338944.634542:0:18558:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787338944.634556:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbffa4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1874160212119168:0@lo:400:kworker.0 00000100:00100000:2.0:1787338944.634583:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338944.634612:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787338944.634617:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf5b71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4530016f-1c37-4f4c-b7ee-21f57031a048:3316:1874160212118784:0@lo:400:kworker.0 00000100:00100000:2.0:1787338944.634657:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338944.634714:0:18563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212119168 00000100:00100000:0.0:1787338944.634718:0:18563:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212119168 00000100:00100000:0.0:1787338944.634762:0:18563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787338944.634769:0:18563:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4096680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874160212119168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787338944.634804:0:18563:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4096680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874160212119168:12345-0@lo:400:kworker.0 Request processed in 36us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338944.634811:0:18563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787338944.634897:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf5b72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874160212118912:0@lo:400:kworker.0 00000100:00100000:3.0:1787338944.634924:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338944.634957:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787338944.634963:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbffa4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1874160212119040:0@lo:400:kworker.0 00000100:00100000:3.0:1787338944.634999:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338944.635044:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212118784 00000100:00100000:3.0:1787338944.635048:0:18554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212118784 00000100:00100000:2.0:1787338944.635389:0:18556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787338944.635398:0:18556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc9551050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4530016f-1c37-4f4c-b7ee-21f57031a048+19:3316:x1874160212118784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787338944.635434:0:18556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc9551050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4530016f-1c37-4f4c-b7ee-21f57031a048+19:3316:x1874160212118784:12345-0@lo:400:kworker.0 Request processed in 38us (777us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338944.635440:0:18556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:2.0:1787338944.635467:0:18558:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787338944.635489:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf5b71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4530016f-1c37-4f4c-b7ee-21f57031a048:3316:1874160212118784:0@lo:400:kworker.0 00000100:00100000:2.0:1787338944.635501:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbffa4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1874160212119168:0@lo:400:kworker.0 00000100:00100000:3.0:1787338944.635553:0:18562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212118912 00000100:00100000:3.0:1787338944.635557:0:18562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212118912 00000100:00100000:3.0:1787338944.635589:0:18562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212119040 00000100:00100000:3.0:1787338944.635592:0:18562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212119040 00000100:00100000:3.0:1787338944.635618:0:18562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787338944.635635:0:18562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee44d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874160212118912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787338944.635672:0:18562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee44d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874160212118912:12345-0@lo:400:kworker.0 Request processed in 36us (747us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338944.635678:0:18562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787338944.635691:0:18562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787338944.635697:0:18562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee44c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874160212119040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787338944.635723:0:18562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee44c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874160212119040:12345-0@lo:400:kworker.0 Request processed in 27us (723us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338944.635729:0:18562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787338944.635755:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbffa4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1874160212119040:0@lo:400:kworker.0 00000100:00100000:3.0:1787338944.635765:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf5b72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874160212118912:0@lo:400:kworker.0 00000100:00100000:3.0:1787338944.635795:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee44ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874160212118528:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787338944.636320:0:18558:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787338944.840734:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338944.840777:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338944.840796:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338944.840820:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338944.840838:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338944.840854:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338944.840898:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338944.840935:0:19247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192222336 00000100:00100000:0.0:1787338944.840945:0:19247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192222336 00000100:00100000:0.0:1787338944.840997:0:19247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192222592 00000100:00100000:0.0:1787338944.841000:0:19247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192222592 00000100:00100000:0.0:1787338944.841014:0:19247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192222208 00000100:00100000:0.0:1787338944.841016:0:19247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192222208 00000100:00100000:0.0:1787338944.841026:0:19247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192222720 00000100:00100000:0.0:1787338944.841028:0:19247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192222720 00000100:00100000:0.0:1787338944.841041:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 6 00000100:00100000:0.0:1787338944.841052:0:19247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f11a8df7-6b86-4272-87dd-120efc0a0f31+5:2356:x1874160192222336:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:0.0:1787338944.841114:0:19247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f11a8df7-6b86-4272-87dd-120efc0a0f31+5:2356:x1874160192222336:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 64us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338944.841121:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 6 00000100:00100000:0.0:1787338944.841139:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 7 00000100:00100000:0.0:1787338944.841144:0:19247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eed3ef97-e99d-4750-973c-88dcada624d6+5:2356:x1874160192222592:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:0.0:1787338944.841165:0:19247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eed3ef97-e99d-4750-973c-88dcada624d6+5:2356:x1874160192222592:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 21us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338944.841171:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 7 00000100:00100000:0.0:1787338944.841180:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 8 00000100:00100000:0.0:1787338944.841185:0:19247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f11a8df7-6b86-4272-87dd-120efc0a0f31+5:2356:x1874160192222208:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:0.0:1787338944.841203:0:19247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f11a8df7-6b86-4272-87dd-120efc0a0f31+5:2356:x1874160192222208:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 18us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338944.841209:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 8 00000100:00100000:0.0:1787338944.841218:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 9 00000100:00100000:0.0:1787338944.841223:0:19247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa49f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eed3ef97-e99d-4750-973c-88dcada624d6+5:2356:x1874160192222720:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:0.0:1787338944.841242:0:19247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa49f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eed3ef97-e99d-4750-973c-88dcada624d6+5:2356:x1874160192222720:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 20us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338944.841254:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 9 00000100:00100000:0.0:1787338944.841273:0:18557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192221952 00000100:00100000:0.0:1787338944.841276:0:18557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192221952 00000100:00100000:0.0:1787338944.841297:0:18557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 104 00000100:00100000:0.0:1787338944.841302:0:18557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc9552050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6691873-d8b0-4399-ba40-203a8aa11ea0+13:2356:x1874160192221952:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:0.0:1787338944.841325:0:18557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc9552050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6691873-d8b0-4399-ba40-203a8aa11ea0+13:2356:x1874160192221952:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 23us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338944.841331:0:18557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 104 00000100:00100000:0.0:1787338944.841356:0:18564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192222080 00000100:00100000:0.0:1787338944.841359:0:18564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192222080 00000100:00100000:0.0:1787338944.841382:0:18564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192222464 00000100:00100000:0.0:1787338944.841384:0:18564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192222464 00000100:00100000:0.0:1787338944.841400:0:18564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 21 00000100:00100000:0.0:1787338944.841405:0:18564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f11a8df7-6b86-4272-87dd-120efc0a0f31+6:2356:x1874160192222080:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:0.0:1787338944.841430:0:18564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f11a8df7-6b86-4272-87dd-120efc0a0f31+6:2356:x1874160192222080:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 25us (706us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338944.841436:0:18564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 21 00000100:00100000:0.0:1787338944.841446:0:18564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 22 00000100:00100000:0.0:1787338944.841451:0:18564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eed3ef97-e99d-4750-973c-88dcada624d6+6:2356:x1874160192222464:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:0.0:1787338944.841468:0:18564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eed3ef97-e99d-4750-973c-88dcada624d6+6:2356:x1874160192222464:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 17us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338944.841475:0:18564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 22 00000100:00080000:0.0:1787338944.841490:0:18558:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787338944.841495:0:18558:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787338944.841496:0:18558:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787338945.145495:0:18551:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338946.168492:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787338946.487859:0:18597:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000080:2.0:1787338947.017542:0:20675:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffde6a2b970 20000000:00000080:2.0:1787338947.017559:0:20675:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff90bac373d400 uarg=0000000000000000 20000000:01000000:2.0:1787338947.017604:0:20675:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787338947.017611:0:20675:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787338947.017617:0:20675:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1787338947.018737:0:20676:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:1.0:1787338947.019187:0:20675:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1787338947.027434:0:20675:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787338947.027469:0:20675:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90bbfbe9c200/0x83671231080c32ee lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338947.027488:0:20675:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90bbf40e3a00/0x83671231080c2fb4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c2fad expref: 18 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338947.027512:0:20675:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90bbf40e3200/0x83671231080c3001 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c2ffa expref: 18 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338947.027519:0:20675:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90bbffef5600/0x83671231080c3071 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c306a expref: 18 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338947.027529:0:20675:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90bbfbe9d600/0x83671231080c328c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabd19 expref: 12 pid: 18557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338947.027537:0:20675:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90bbf40e3c00/0x83671231080c32c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabd7b expref: 12 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338947.027545:0:20675:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90bbfbe9c200/0x83671231080c32ee lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338947.027599:0:20675:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90bbf40e3c00/0x83671231080c32c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabd7b expref: 12 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338947.027614:0:20675:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90bbf40e3c00/0x83671231080c32c4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabd7b expref: 12 pid: 18556 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338947.027629:0:20675:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf7ed4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20675:1874160212119296:192.168.201.53@tcp:104: 00010000:00010000:1.0:1787338947.027931:0:20675:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90bbfbe9d600/0x83671231080c328c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabd19 expref: 12 pid: 18557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338947.027941:0:20675:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90bbfbe9d600/0x83671231080c328c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabd19 expref: 12 pid: 18557 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338947.027950:0:20675:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf7ed5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20675:1874160212119424:192.168.201.53@tcp:104: 00010000:00010000:1.0:1787338947.028099:0:20675:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90bbffef5600/0x83671231080c3071 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x83671231080c306a expref: 18 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338947.028109:0:20675:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90bbffef5600/0x83671231080c3071 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x83671231080c306a expref: 18 pid: 18556 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338947.028118:0:20675:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf7ed6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20675:1874160212119552:0@lo:104: 00000100:00100000:1.0:1787338947.028226:0:20675:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787338947.028542:0:20675:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90bbf40e3200/0x83671231080c3001 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x83671231080c2ffa expref: 18 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338947.028551:0:20675:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90bbf40e3200/0x83671231080c3001 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x83671231080c2ffa expref: 18 pid: 18556 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338947.028560:0:20675:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf7ed7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20675:1874160212119680:0@lo:104: 00000100:00100000:1.0:1787338947.028613:0:20675:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787338947.031985:0:20675:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90bbf40e3a00/0x83671231080c2fb4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x83671231080c2fad expref: 18 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338947.032003:0:20675:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90bbf40e3a00/0x83671231080c2fb4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x83671231080c2fad expref: 18 pid: 18556 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338947.032016:0:20675:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf3e91500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20675:1874160212119808:0@lo:104: 00000100:00100000:1.0:1787338947.032068:0:20675:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338947.032251:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212119552 00000100:00100000:3.0:1787338947.032260:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212119552 00000100:00100000:1.0:1787338947.032532:0:20675:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbfbcd8b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787338947.033319:0:20675:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf7ed4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20675:1874160212119296:192.168.201.53@tcp:104: 00000100:00100000:1.0:1787338947.033331:0:20675:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf7ed5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20675:1874160212119424:192.168.201.53@tcp:104: 00000100:00100000:3.0:1787338947.033918:0:18546:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787338947.033932:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212119680 00000100:00100000:3.0:1787338947.033938:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212119680 00000100:00100000:3.0:1787338947.033951:0:18546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212119808 00000100:00100000:3.0:1787338947.033953:0:18546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212119808 00000100:00100000:3.0:1787338947.034037:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787338947.034046:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf7ed7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4530016f-1c37-4f4c-b7ee-21f57031a048+5:20675:x1874160212119552:12345-0@lo:104: 00010000:00010000:3.0:1787338947.034061:0:18546:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.153@tcp lock: ffff90bbc0031a00/0x83671231080c306a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x83671231080c3071 expref: -99 pid: 19964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338947.034248:0:18546:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787338947.034256:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf7ed7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4530016f-1c37-4f4c-b7ee-21f57031a048+5:20675:x1874160212119552:12345-0@lo:104: Request processed in 211us (6029us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338947.034263:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787338947.034279:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787338947.034284:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf3e90a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4530016f-1c37-4f4c-b7ee-21f57031a048+4:20675:x1874160212119680:12345-0@lo:104: 00010000:00010000:3.0:1787338947.034292:0:18546:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.153@tcp lock: ffff90bbffef4e00/0x83671231080c2ffa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x83671231080c3001 expref: -99 pid: 19244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338947.034322:0:18546:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787338947.034327:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf3e90a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4530016f-1c37-4f4c-b7ee-21f57031a048+4:20675:x1874160212119680:12345-0@lo:104: Request processed in 43us (5715us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338947.034332:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787338947.034342:0:18546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787338947.034346:0:18546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc16b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4530016f-1c37-4f4c-b7ee-21f57031a048+3:20675:x1874160212119808:12345-0@lo:104: 00010000:00010000:3.0:1787338947.034353:0:18546:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.153@tcp lock: ffff90bbc0030400/0x83671231080c2fad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x83671231080c2fb4 expref: -99 pid: 18559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338947.034375:0:18546:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1787338947.034380:0:18546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc16b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4530016f-1c37-4f4c-b7ee-21f57031a048+3:20675:x1874160212119808:12345-0@lo:104: Request processed in 33us (2312us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338947.034394:0:18546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1787338947.034437:0:18550:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787338947.034447:0:18550:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.153@tcp lock: ffff90bbc0031a00/0x83671231080c306a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x83671231080c3071 expref: -99 pid: 19964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338947.034454:0:18550:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbc0031a00 already unused, calling callback (ffffffffc1b2ec20) 10000000:00010000:3.0:1787338947.034459:0:18550:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.153@tcp lock: ffff90bbc0031a00/0x83671231080c306a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x83671231080c3071 expref: -99 pid: 19964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338947.034467:0:18550:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.153@tcp lock: ffff90bbc0031a00/0x83671231080c306a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x83671231080c3071 expref: -99 pid: 19964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787338947.034474:0:18550:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.153@tcp lock: ffff90bbc0031a00/0x83671231080c306a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x83671231080c3071 expref: -99 pid: 19964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787338947.034481:0:18550:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787338947.034512:0:18550:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.153@tcp lock: ffff90bbc0031a00/0x83671231080c306a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c3071 expref: -99 pid: 19964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338947.034518:0:18550:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787338947.034536:0:18550:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.153@tcp lock: ffff90bbc0031a00/0x83671231080c306a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c3071 expref: -99 pid: 19964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338947.034543:0:18550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.153@tcp lock: ffff90bbc0031a00/0x83671231080c306a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c3071 expref: -99 pid: 19964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338947.034555:0:18550:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787338947.034558:0:18550:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.153@tcp lock: ffff90bbffef4e00/0x83671231080c2ffa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x83671231080c3001 expref: -99 pid: 19244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338947.034563:0:18550:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbffef4e00 already unused, calling callback (ffffffffc1b2ec20) 10000000:00010000:3.0:1787338947.034566:0:18550:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.153@tcp lock: ffff90bbffef4e00/0x83671231080c2ffa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x83671231080c3001 expref: -99 pid: 19244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338947.034592:0:18550:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.153@tcp lock: ffff90bbffef4e00/0x83671231080c2ffa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x83671231080c3001 expref: -99 pid: 19244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787338947.034598:0:18550:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.153@tcp lock: ffff90bbffef4e00/0x83671231080c2ffa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x83671231080c3001 expref: -99 pid: 19244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787338947.034603:0:18550:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787338947.034615:0:18550:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.153@tcp lock: ffff90bbffef4e00/0x83671231080c2ffa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c3001 expref: -99 pid: 19244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338947.034621:0:18550:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787338947.034634:0:18550:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.153@tcp lock: ffff90bbffef4e00/0x83671231080c2ffa lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c3001 expref: -99 pid: 19244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338947.034641:0:18550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.153@tcp lock: ffff90bbffef4e00/0x83671231080c2ffa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c3001 expref: -99 pid: 19244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338947.034649:0:18550:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787338947.034652:0:18550:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.153@tcp lock: ffff90bbc0030400/0x83671231080c2fad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x83671231080c2fb4 expref: -99 pid: 18559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338947.034658:0:18550:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbc0030400 already unused, calling callback (ffffffffc1b2ec20) 10000000:00010000:3.0:1787338947.034661:0:18550:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.153@tcp lock: ffff90bbc0030400/0x83671231080c2fad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x83671231080c2fb4 expref: -99 pid: 18559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338947.034667:0:18550:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.153@tcp lock: ffff90bbc0030400/0x83671231080c2fad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x83671231080c2fb4 expref: -99 pid: 18559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787338947.034808:0:18550:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.153@tcp lock: ffff90bbc0030400/0x83671231080c2fad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x83671231080c2fb4 expref: -99 pid: 18559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787338947.034819:0:18550:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787338947.034833:0:18550:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.153@tcp lock: ffff90bbc0030400/0x83671231080c2fad lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c2fb4 expref: -99 pid: 18559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338947.034839:0:18550:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787338947.034845:0:18550:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.153@tcp lock: ffff90bbc0030400/0x83671231080c2fad lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c2fb4 expref: -99 pid: 18559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338947.034851:0:18550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.153@tcp lock: ffff90bbc0030400/0x83671231080c2fad lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x83671231080c2fb4 expref: -99 pid: 18559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338947.034864:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338947.034866:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787338947.034867:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787338947.034899:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee44ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4530016f-1c37-4f4c-b7ee-21f57031a048:3317:1874160212119936:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787338947.034928:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338947.034964:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee44f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4530016f-1c37-4f4c-b7ee-21f57031a048:3314:1874160212120064:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787338947.035236:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338947.035258:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787338947.035263:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee44d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4530016f-1c37-4f4c-b7ee-21f57031a048:3314:1874160212120192:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787338947.035283:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787338947.035345:0:18551:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787338947.035361:0:18548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212119936 00000100:00100000:0.0:1787338947.035367:0:18548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212119936 00010000:00010000:0.0:1787338947.035398:0:18548:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90bbffef5600/0x83671231080c3071 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x83671231080c306a expref: 19 pid: 18556 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338947.035413:0:18548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212120064 00000100:00100000:0.0:1787338947.035415:0:18548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212120064 00010000:00010000:0.0:1787338947.035424:0:18548:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90bbf40e3200/0x83671231080c3001 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x83671231080c2ffa expref: 20 pid: 18556 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338947.035432:0:18548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212120192 00000100:00100000:0.0:1787338947.035434:0:18548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212120192 00010000:00010000:0.0:1787338947.035442:0:18548:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90bbf40e3a00/0x83671231080c2fb4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x83671231080c2fad expref: 21 pid: 18556 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338947.035452:0:18548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787338947.035458:0:18548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee44e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4530016f-1c37-4f4c-b7ee-21f57031a048+21:3317:x1874160212119936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787338947.035468:0:18548:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787338947.035473:0:18548:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90bbffef5600/0x83671231080c3071 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x83671231080c306a expref: 21 pid: 18556 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338947.035483:0:18548:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90bbffef5600/0x83671231080c3071 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x83671231080c306a expref: 21 pid: 18556 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338947.035497:0:18548:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787338947.035532:0:18548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee44e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4530016f-1c37-4f4c-b7ee-21f57031a048+21:3317:x1874160212119936:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338947.035538:0:18548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787338947.035549:0:18548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787338947.035554:0:18548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee44e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4530016f-1c37-4f4c-b7ee-21f57031a048+20:3314:x1874160212120064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787338947.035568:0:18548:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787338947.035573:0:18548:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90bbf40e3200/0x83671231080c3001 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x83671231080c2ffa expref: 20 pid: 18556 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338947.035591:0:18548:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90bbf40e3200/0x83671231080c3001 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x83671231080c2ffa expref: 20 pid: 18556 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338947.035600:0:18548:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787338947.035625:0:18548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee44e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4530016f-1c37-4f4c-b7ee-21f57031a048+20:3314:x1874160212120064:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338947.035631:0:18548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787338947.035642:0:18548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787338947.035647:0:18548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfbfe9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4530016f-1c37-4f4c-b7ee-21f57031a048+19:3314:x1874160212120192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787338947.035653:0:18548:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787338947.035657:0:18548:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90bbf40e3a00/0x83671231080c2fb4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x83671231080c2fad expref: 19 pid: 18556 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338947.035665:0:18548:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90bbf40e3a00/0x83671231080c2fb4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x83671231080c2fad expref: 19 pid: 18556 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338947.035810:0:18548:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787338947.035833:0:18548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfbfe9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4530016f-1c37-4f4c-b7ee-21f57031a048+19:3314:x1874160212120192:12345-0@lo:103:ldlm_bl.0 Request processed in 186us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338947.035840:0:18548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787338947.035906:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee44d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4530016f-1c37-4f4c-b7ee-21f57031a048:3314:1874160212120192:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787338947.035914:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee44f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4530016f-1c37-4f4c-b7ee-21f57031a048:3314:1874160212120064:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787338947.036898:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee44ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4530016f-1c37-4f4c-b7ee-21f57031a048:3317:1874160212119936:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787338947.037264:0:20675:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90bbffef5600/0x83671231080c3071 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x83671231080c306a expref: 18 pid: 18556 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338947.037298:0:20675:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf7ed6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20675:1874160212119552:0@lo:104: 00010000:00010000:1.0:1787338947.037313:0:20675:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90bbf40e3200/0x83671231080c3001 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x83671231080c2ffa expref: 17 pid: 18556 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338947.037322:0:20675:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf7ed7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20675:1874160212119680:0@lo:104: 00010000:00010000:1.0:1787338947.037331:0:20675:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90bbf40e3a00/0x83671231080c2fb4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x83671231080c2fad expref: 16 pid: 18556 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338947.037338:0:20675:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf3e91500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20675:1874160212119808:0@lo:104: 00010000:00010000:1.0:1787338947.037362:0:20675:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90bbfbe9c200/0x83671231080c32ee lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338947.049253:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338947.049301:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338947.049434:0:18549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192222848 00000100:00100000:2.0:1787338947.049444:0:18549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192222848 00010000:00010000:2.0:1787338947.049482:0:18549:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90bbf40e3c00/0x83671231080c32c4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabd7b expref: 13 pid: 18556 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338947.049540:0:18549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192222976 00000100:00100000:2.0:1787338947.049543:0:18549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192222976 00010000:00010000:2.0:1787338947.049557:0:18549:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90bbfbe9d600/0x83671231080c328c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabd19 expref: 14 pid: 18557 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338947.049572:0:18549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 7 00000100:00100000:2.0:1787338947.049590:0:18549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf3e91500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f6691873-d8b0-4399-ba40-203a8aa11ea0+14:2358:x1874160192222848:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787338947.049605:0:18549:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787338947.049611:0:18549:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90bbf40e3c00/0x83671231080c32c4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabd7b expref: 14 pid: 18556 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338947.049629:0:18549:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90bbf40e3c00/0x83671231080c32c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabd7b expref: 14 pid: 18556 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338947.049649:0:18549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90bbf40e3c00/0x83671231080c32c4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabd7b expref: 14 pid: 18556 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338947.049666:0:18549:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787338947.049725:0:18549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf3e91500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f6691873-d8b0-4399-ba40-203a8aa11ea0+13:2358:x1874160192222848:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 144us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338947.049732:0:18549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 7 00000100:00100000:2.0:1787338947.049759:0:18549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 8 00000100:00100000:2.0:1787338947.049766:0:18549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf3e91180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f6691873-d8b0-4399-ba40-203a8aa11ea0+12:2359:x1874160192222976:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787338947.049773:0:18549:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787338947.049778:0:18549:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90bbfbe9d600/0x83671231080c328c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabd19 expref: 12 pid: 18557 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338947.049798:0:18549:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90bbfbe9d600/0x83671231080c328c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabd19 expref: 12 pid: 18557 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338947.049809:0:18549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90bbfbe9d600/0x83671231080c328c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabd19 expref: 12 pid: 18557 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338947.049821:0:18549:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90bbfbe9c200/0x83671231080c32ee lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338947.049829:0:18549:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bbfbe9c200/0x83671231080c32ee lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338947.049845:0:18549:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90bbfbe9c200/0x83671231080c32ee lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338947.049853:0:18549:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90bbfbe9c200/0x83671231080c32ee lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338947.049860:0:18549:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90bbfbe9c200/0x83671231080c32ee lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338947.049867:0:18549:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90bbfbe9c200/0x83671231080c32ee lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338947.049919:0:18549:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbfbe9c200 already unused, calling callback (ffffffffc1546230) 00010000:00010000:2.0:1787338947.049925:0:18549:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90bbfbe9c200/0x83671231080c32ee lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338947.049933:0:18549:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90bbfbe9c200/0x83671231080c32ee lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338947.049957:0:18549:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90bbfbe9c200/0x83671231080c32ee lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338947.049968:0:18549:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787338947.049988:0:18549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf3e91180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f6691873-d8b0-4399-ba40-203a8aa11ea0+11:2359:x1874160192222976:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 223us (686us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338947.049995:0:18549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 8 00010000:00010000:1.0:1787338947.050212:0:20675:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90bbfbe9c200/0x83671231080c32ee lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338947.050221:0:20675:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90bbfbe9c200/0x83671231080c32ee lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338947.050228:0:20675:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90bbfbe9c200/0x83671231080c32ee lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338947.194609:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787338948.214238:0:18551:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787338948.342334:0:18559:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787338948.342343:0:18559:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90bbe826c000 from 10 10000000:01000000:0.0:1787338948.342348:0:18559:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787338948.342405:0:18559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bac3b93600/0x83671231080c32f5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338948.342416:0:18559:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.153@tcp lock: ffff90bac3b93600/0x83671231080c32f5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338948.342427:0:18559:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.153@tcp lock: ffff90bac3b93600/0x83671231080c32f5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338948.342454:0:18559:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbffa48000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4530016f-1c37-4f4c-b7ee-21f57031a048:18559:1874160212120320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787338948.342523:0:18559:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338948.342629:0:18559:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbd1b79240 going to sleep for 11 seconds 00000100:00100000:3.0:1787338948.342776:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212120320 00000100:00100000:3.0:1787338948.342783:0:18554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212120320 00000100:00100000:3.0:1787338948.342840:0:18554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787338948.342849:0:18554:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc9553850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4530016f-1c37-4f4c-b7ee-21f57031a048+16:18559:x1874160212120320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787338948.342903:0:18554:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787338948.342917:0:18554:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90bbf7ea5600/0x83671231080c32fc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x83671231080c32f5 expref: -99 pid: 18554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338948.342939:0:18554:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bbf7ea5600/0x83671231080c32fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x83671231080c32f5 expref: 17 pid: 18554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338948.342948:0:18554:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90bbf7ea5600/0x83671231080c32fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c32f5 expref: 17 pid: 18554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338948.342958:0:18554:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf7ea5600, rc 0) 00000100:00100000:3.0:1787338948.343013:0:18554:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc9553850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4530016f-1c37-4f4c-b7ee-21f57031a048+17:18559:x1874160212120320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 164us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338948.343019:0:18554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787338948.343319:0:18559:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbffa48000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4530016f-1c37-4f4c-b7ee-21f57031a048:18559:1874160212120320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787338948.343335:0:18559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.153@tcp lock: ffff90bac3b93600/0x83671231080c32f5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c32fc expref: -99 pid: 18559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338948.343354:0:18559:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.153@tcp lock: ffff90bac3b93600/0x83671231080c32f5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x83671231080c32fc expref: -99 pid: 18559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338948.343408:0:18559:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf3e91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4530016f-1c37-4f4c-b7ee-21f57031a048:18559:1874160212120448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787338948.343437:0:18559:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338948.343470:0:18559:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbfbcd8780 going to sleep for 11 seconds 00000100:00100000:2.0:1787338948.344748:0:18556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212120448 00000100:00100000:2.0:1787338948.344757:0:18556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212120448 00000100:00100000:2.0:1787338948.344816:0:18556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787338948.344827:0:18556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc9550c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4530016f-1c37-4f4c-b7ee-21f57031a048+17:18559:x1874160212120448:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787338948.345140:0:18556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc9550c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4530016f-1c37-4f4c-b7ee-21f57031a048+17:18559:x1874160212120448:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 315us (1701us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338948.345156:0:18556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787338948.345377:0:18559:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf3e91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4530016f-1c37-4f4c-b7ee-21f57031a048:18559:1874160212120448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787338948.345422:0:18559:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf3e91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4530016f-1c37-4f4c-b7ee-21f57031a048:18559:1874160212120576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787338948.345466:0:18559:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338948.345500:0:18559:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbfbcd8780 going to sleep for 11 seconds 00000100:00100000:0.0:1787338948.345817:0:18557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212120576 00000100:00100000:0.0:1787338948.345822:0:18557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212120576 00000100:00100000:0.0:1787338948.345844:0:18557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787338948.345851:0:18557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc9551c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4530016f-1c37-4f4c-b7ee-21f57031a048+17:18559:x1874160212120576:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787338948.346033:0:18557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc9551c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4530016f-1c37-4f4c-b7ee-21f57031a048+17:18559:x1874160212120576:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 181us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338948.346040:0:18557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787338948.346167:0:18559:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf3e91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4530016f-1c37-4f4c-b7ee-21f57031a048:18559:1874160212120576:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787338948.348662:0:20690:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1787338948.349116:0:18559:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1787338948.349136:0:18559:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787338948.349154:0:18559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bac3b93600/0x83671231080c32f5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c32fc expref: -99 pid: 18559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338948.349167:0:18559:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.153@tcp lock: ffff90bac3b93600/0x83671231080c32f5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c32fc expref: -99 pid: 18559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787338948.349194:0:18559:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787338948.349196:0:18559:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90bbc96ab000 from 10 10000000:01000000:0.0:1787338948.349199:0:18559:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787338948.349237:0:18559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bac3b93e00/0x83671231080c3303 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338948.349245:0:18559:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.153@tcp lock: ffff90bac3b93e00/0x83671231080c3303 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338948.349255:0:18559:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.153@tcp lock: ffff90bac3b93e00/0x83671231080c3303 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338948.349279:0:18559:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbffa48a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4530016f-1c37-4f4c-b7ee-21f57031a048:18559:1874160212120704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787338948.349342:0:18559:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338948.349380:0:18559:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbd1b79480 going to sleep for 11 seconds 00000100:00100000:1.0:1787338948.349434:0:18557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212120704 00000100:00100000:1.0:1787338948.349442:0:18557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212120704 00000100:00100000:1.0:1787338948.349488:0:18557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787338948.349499:0:18557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc9550850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4530016f-1c37-4f4c-b7ee-21f57031a048+17:18559:x1874160212120704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787338948.349512:0:18557:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787338948.349524:0:18557:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90bbfbe9c200/0x83671231080c330a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x83671231080c3303 expref: -99 pid: 18557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338948.349547:0:18557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bbfbe9c200/0x83671231080c330a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x83671231080c3303 expref: 18 pid: 18557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338948.349569:0:18557:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90bbfbe9c200/0x83671231080c330a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c3303 expref: 18 pid: 18557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338948.349590:0:18557:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbfbe9c200, rc 0) 00000100:00100000:1.0:1787338948.349640:0:18557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc9550850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4530016f-1c37-4f4c-b7ee-21f57031a048+18:18559:x1874160212120704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 143us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338948.349646:0:18557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787338948.351398:0:18559:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbffa48a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4530016f-1c37-4f4c-b7ee-21f57031a048:18559:1874160212120704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787338948.351424:0:18559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.153@tcp lock: ffff90bac3b93e00/0x83671231080c3303 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c330a expref: -99 pid: 18559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338948.351434:0:18559:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.153@tcp lock: ffff90bac3b93e00/0x83671231080c3303 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x83671231080c330a expref: -99 pid: 18559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338948.351503:0:18559:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbffa48a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4530016f-1c37-4f4c-b7ee-21f57031a048:18559:1874160212120832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787338948.351545:0:18559:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338948.351604:0:18559:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbd1b79480 going to sleep for 11 seconds 00000100:00100000:1.0:1787338948.357729:0:18556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212120832 00000100:00100000:1.0:1787338948.357745:0:18556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212120832 00000100:00100000:1.0:1787338948.357830:0:18556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787338948.357841:0:18556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc9550050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4530016f-1c37-4f4c-b7ee-21f57031a048+18:18559:x1874160212120832:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787338948.358201:0:18556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc9550050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4530016f-1c37-4f4c-b7ee-21f57031a048+18:18559:x1874160212120832:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 361us (6654us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338948.358209:0:18556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787338948.358416:0:18559:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbffa48a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4530016f-1c37-4f4c-b7ee-21f57031a048:18559:1874160212120832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787338948.358469:0:18559:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee44ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4530016f-1c37-4f4c-b7ee-21f57031a048:18559:1874160212120960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787338948.358515:0:18559:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338948.358571:0:18559:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bac2b8cc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787338948.361096:0:18557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212120960 00000100:00100000:0.0:1787338948.361110:0:18557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212120960 00000100:00100000:0.0:1787338948.361211:0:18557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787338948.361222:0:18557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc9552c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4530016f-1c37-4f4c-b7ee-21f57031a048+18:18559:x1874160212120960:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787338948.361445:0:18557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc9552c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4530016f-1c37-4f4c-b7ee-21f57031a048+18:18559:x1874160212120960:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 224us (2928us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338948.361453:0:18557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787338948.361651:0:18559:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee44ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4530016f-1c37-4f4c-b7ee-21f57031a048:18559:1874160212120960:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787338948.378991:0:20691:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1787338948.379326:0:18559:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1787338948.379349:0:18559:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787338948.379361:0:18559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bac3b93e00/0x83671231080c3303 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c330a expref: -99 pid: 18559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338948.379372:0:18559:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.153@tcp lock: ffff90bac3b93e00/0x83671231080c3303 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c330a expref: -99 pid: 18559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787338948.379383:0:18559:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787338948.379385:0:18559:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90bbe83a5800 from 10 10000000:01000000:0.0:1787338948.379389:0:18559:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787338948.379427:0:18559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bac3b92e00/0x83671231080c3311 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338948.379434:0:18559:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.153@tcp lock: ffff90bac3b92e00/0x83671231080c3311 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338948.379444:0:18559:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.153@tcp lock: ffff90bac3b92e00/0x83671231080c3311 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338948.379472:0:18559:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbffa48700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4530016f-1c37-4f4c-b7ee-21f57031a048:18559:1874160212121088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787338948.379539:0:18559:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338948.379603:0:18559:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbd1b79480 going to sleep for 11 seconds 00000100:00100000:1.0:1787338948.379704:0:18557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212121088 00000100:00100000:1.0:1787338948.379712:0:18557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212121088 00000100:00100000:1.0:1787338948.379760:0:18557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787338948.379770:0:18557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc9551450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4530016f-1c37-4f4c-b7ee-21f57031a048+18:18559:x1874160212121088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787338948.379781:0:18557:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787338948.379793:0:18557:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90bbfbe9da00/0x83671231080c3318 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x83671231080c3311 expref: -99 pid: 18557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338948.379815:0:18557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bbfbe9da00/0x83671231080c3318 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x83671231080c3311 expref: 19 pid: 18557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338948.379825:0:18557:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90bbfbe9da00/0x83671231080c3318 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x83671231080c3311 expref: 19 pid: 18557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338948.379833:0:18557:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbfbe9da00, rc 0) 00000100:00100000:1.0:1787338948.379915:0:18557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc9551450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4530016f-1c37-4f4c-b7ee-21f57031a048+19:18559:x1874160212121088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 146us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338948.379922:0:18557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787338948.380481:0:18559:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbffa48700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4530016f-1c37-4f4c-b7ee-21f57031a048:18559:1874160212121088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787338948.380504:0:18559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.153@tcp lock: ffff90bac3b92e00/0x83671231080c3311 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c3318 expref: -99 pid: 18559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338948.380513:0:18559:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.153@tcp lock: ffff90bac3b92e00/0x83671231080c3311 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x83671231080c3318 expref: -99 pid: 18559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338948.380572:0:18559:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbffa48700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4530016f-1c37-4f4c-b7ee-21f57031a048:18559:1874160212121216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787338948.380607:0:18559:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338948.380636:0:18559:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbd1b79480 going to sleep for 11 seconds 00000100:00100000:1.0:1787338948.381323:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212121216 00000100:00100000:1.0:1787338948.381329:0:18554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212121216 00000100:00100000:1.0:1787338948.381357:0:18554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787338948.381364:0:18554:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc9552850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4530016f-1c37-4f4c-b7ee-21f57031a048+19:18559:x1874160212121216:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787338948.381606:0:18554:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc9552850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4530016f-1c37-4f4c-b7ee-21f57031a048+19:18559:x1874160212121216:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 241us (997us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338948.381614:0:18554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787338948.384776:0:18559:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbffa48700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4530016f-1c37-4f4c-b7ee-21f57031a048:18559:1874160212121216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787338948.384852:0:18559:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbffa48700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4530016f-1c37-4f4c-b7ee-21f57031a048:18559:1874160212121344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787338948.384971:0:18559:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338948.385015:0:18559:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbd1b79480 going to sleep for 11 seconds 00000100:00100000:0.0:1787338948.385036:0:18557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212121344 00000100:00100000:0.0:1787338948.385043:0:18557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212121344 00000100:00100000:0.0:1787338948.385087:0:18557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787338948.385096:0:18557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc9553c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4530016f-1c37-4f4c-b7ee-21f57031a048+19:18559:x1874160212121344:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787338948.385287:0:18557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc9553c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4530016f-1c37-4f4c-b7ee-21f57031a048+19:18559:x1874160212121344:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 192us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338948.385295:0:18557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787338948.385337:0:18559:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbffa48700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4530016f-1c37-4f4c-b7ee-21f57031a048:18559:1874160212121344:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787338948.386045:0:20692:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1787338948.386095:0:18559:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1787338948.386108:0:18559:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787338948.386117:0:18559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.153@tcp lock: ffff90bac3b92e00/0x83671231080c3311 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c3318 expref: -99 pid: 18559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338948.386136:0:18559:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.153@tcp lock: ffff90bac3b92e00/0x83671231080c3311 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x83671231080c3318 expref: -99 pid: 18559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338948.628977:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338948.629127:0:18564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192223104 00000100:00100000:3.0:1787338948.629137:0:18564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192223104 00000100:00100000:3.0:1787338948.629212:0:18564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 15 00000100:00100000:3.0:1787338948.629224:0:18564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f11a8df7-6b86-4272-87dd-120efc0a0f31+6:17428:x1874160192223104:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787338948.629244:0:18564:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787338948.629264:0:18564:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c331f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadabdac expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338948.629340:0:18564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c3326 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338948.629353:0:18564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c3326 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338948.629363:0:18564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c3326 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338948.629376:0:18564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5c00/0x83671231080c332d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338948.629382:0:18564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5c00/0x83671231080c332d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338948.629388:0:18564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5c00/0x83671231080c332d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338948.629840:0:18564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5e00/0x83671231080c3334 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338948.629850:0:18564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5e00/0x83671231080c3334 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338948.629858:0:18564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5e00/0x83671231080c3334 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787338948.629988:0:18564:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000100:00080000:0.0:1787338948.630306:0:18558:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:3.0:1787338948.630524:0:18564:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1787338948.630802:0:18564:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5e00/0x83671231080c3334 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338948.630826:0:18564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c3326 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338948.630832:0:18564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c3326 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338948.630839:0:18564:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c3326 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338948.630845:0:18564:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea5a00 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:3.0:1787338948.630850:0:18564:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c3326 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338948.630857:0:18564:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c3326 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338948.630870:0:18564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90bbeb14d800) 00010000:00010000:3.0:1787338948.630899:0:18564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787338948.630904:0:18564:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c3326 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338948.630910:0:18564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c3326 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338948.630922:0:18564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5c00/0x83671231080c332d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338948.630928:0:18564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5c00/0x83671231080c332d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338948.630933:0:18564:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5c00/0x83671231080c332d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338948.630944:0:18564:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea5c00 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:3.0:1787338948.630947:0:18564:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5c00/0x83671231080c332d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338948.630953:0:18564:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5c00/0x83671231080c332d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338948.631245:0:18564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff90bbd38d6c00) 00010000:00010000:3.0:1787338948.631248:0:18564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787338948.631252:0:18564:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5c00/0x83671231080c332d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338948.631333:0:18564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5c00/0x83671231080c332d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338948.631378:0:18564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c331f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabdac expref: 8 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338948.631392:0:18564:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5e00/0x83671231080c3334 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabdac expref: 7 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338948.631400:0:18564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff90bbd38d6800) 00010000:00010000:3.0:1787338948.631402:0:18564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787338948.631405:0:18564:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf7ea5e00, rc 0) 00000100:00100000:3.0:1787338948.631530:0:18564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f11a8df7-6b86-4272-87dd-120efc0a0f31+7:17428:x1874160192223104:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 Request processed in 2307us (2568us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338948.631538:0:18564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 15 00000100:00100000:1.0:1787338948.634471:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338948.635637:0:19270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192223360 00000100:00100000:0.0:1787338948.635649:0:19270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192223360 00000100:00100000:0.0:1787338948.635770:0:19270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 16 00000100:00100000:0.0:1787338948.635782:0:19270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf3e91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f11a8df7-6b86-4272-87dd-120efc0a0f31+7:17428:x1874160192223360:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787338948.635801:0:19270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787338948.635822:0:19270:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b92000/0x83671231080c333b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadabdb3 expref: -99 pid: 19270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338948.635925:0:19270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93200/0x83671231080c3342 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338948.635940:0:19270:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93200/0x83671231080c3342 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338948.635951:0:19270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93200/0x83671231080c3342 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338948.636000:0:19270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93a00/0x83671231080c3349 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338948.636008:0:19270:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93a00/0x83671231080c3349 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338948.636016:0:19270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93a00/0x83671231080c3349 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338948.636533:0:19270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b92600/0x83671231080c3350 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338948.636543:0:19270:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b92600/0x83671231080c3350 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338948.636562:0:19270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b92600/0x83671231080c3350 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787338948.636573:0:19270:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1787338948.636821:0:19270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93200/0x83671231080c3342 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338948.636829:0:19270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93200/0x83671231080c3342 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338948.636836:0:19270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93200/0x83671231080c3342 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338948.636842:0:19270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bac3b93200 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:0.0:1787338948.636847:0:19270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93200/0x83671231080c3342 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338948.636854:0:19270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93200/0x83671231080c3342 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338948.636867:0:19270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff90bbd38d6800) 00010000:00010000:0.0:1787338948.636870:0:19270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787338948.636899:0:19270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93200/0x83671231080c3342 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338948.636914:0:19270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93200/0x83671231080c3342 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338948.636937:0:19270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93a00/0x83671231080c3349 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338948.636943:0:19270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93a00/0x83671231080c3349 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338948.636948:0:19270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93a00/0x83671231080c3349 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338948.636954:0:19270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bac3b93a00 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:0.0:1787338948.636957:0:19270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93a00/0x83671231080c3349 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338948.636963:0:19270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93a00/0x83671231080c3349 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338948.636970:0:19270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff90bbeb14d900) 00010000:00010000:0.0:1787338948.636972:0:19270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787338948.636975:0:19270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93a00/0x83671231080c3349 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338948.636981:0:19270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93a00/0x83671231080c3349 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338948.637351:0:19270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b92000/0x83671231080c333b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabdb3 expref: 10 pid: 19270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338948.637380:0:19270:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b92600/0x83671231080c3350 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabdb3 expref: 9 pid: 19270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338948.637386:0:19270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90bbeb14da00) 00010000:00010000:0.0:1787338948.637389:0:19270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787338948.637391:0:19270:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bac3b92600, rc 0) 00000100:00100000:0.0:1787338948.637465:0:19270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf3e91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f11a8df7-6b86-4272-87dd-120efc0a0f31+9:17428:x1874160192223360:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 Request processed in 1685us (3002us total) trans 12884901889 rc 0/0 00000100:00100000:0.0:1787338948.637473:0:19270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 16 00000100:00100000:1.0:1787338948.642105:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338948.642457:0:18562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192223488 00000100:00100000:2.0:1787338948.642467:0:18562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192223488 00000100:00100000:2.0:1787338948.642567:0:18562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 17 00000100:00100000:2.0:1787338948.642579:0:18562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf3e92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f11a8df7-6b86-4272-87dd-120efc0a0f31+9:17428:x1874160192223488:12345-192.168.201.53@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1787338948.642694:0:18562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf3e92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f11a8df7-6b86-4272-87dd-120efc0a0f31+9:17428:x1874160192223488:12345-192.168.201.53@tcp:59:lhsmtool_posix.0 Request processed in 117us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338948.642702:0:18562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 17 00000100:00100000:1.0:1787338948.684053:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338948.684469:0:18563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192223616 00000100:00100000:2.0:1787338948.684481:0:18563:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192223616 00000100:00100000:2.0:1787338948.684548:0:18563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 18 00000100:00100000:2.0:1787338948.684569:0:18563:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf3e90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f11a8df7-6b86-4272-87dd-120efc0a0f31+9:17434:x1874160192223616:12345-192.168.201.53@tcp:101:lfs.0 00010000:00010000:2.0:1787338948.684730:0:18563:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787338948.684753:0:18563:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3c00/0x83671231080c335e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadabdba expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338948.684818:0:18563:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3000/0x83671231080c3365 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338948.684918:0:18563:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3000/0x83671231080c3365 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338948.684934:0:18563:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3000/0x83671231080c3365 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338948.685017:0:18563:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2200/0x83671231080c336c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338948.685026:0:18563:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2200/0x83671231080c336c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338948.685032:0:18563:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2200/0x83671231080c336c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338948.685456:0:18563:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3000/0x83671231080c3365 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338948.685464:0:18563:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3000/0x83671231080c3365 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338948.685471:0:18563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3000/0x83671231080c3365 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338948.685477:0:18563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e3000 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:2.0:1787338948.685488:0:18563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3000/0x83671231080c3365 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338948.685495:0:18563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3000/0x83671231080c3365 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338948.685512:0:18563:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90bbeb14d800) 00010000:00010000:2.0:1787338948.685514:0:18563:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787338948.685518:0:18563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3000/0x83671231080c3365 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338948.685524:0:18563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3000/0x83671231080c3365 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338948.685536:0:18563:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2200/0x83671231080c336c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338948.685541:0:18563:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2200/0x83671231080c336c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338948.685547:0:18563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2200/0x83671231080c336c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338948.685562:0:18563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e2200 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:2.0:1787338948.685565:0:18563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2200/0x83671231080c336c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338948.685570:0:18563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2200/0x83671231080c336c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338948.685577:0:18563:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff90bbc8283100) 00010000:00010000:2.0:1787338948.685579:0:18563:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787338948.685656:0:18563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2200/0x83671231080c336c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338948.685664:0:18563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2200/0x83671231080c336c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338948.685701:0:18563:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3c00/0x83671231080c335e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabdba expref: 10 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338948.685711:0:18563:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90bbeb14d800) 00010000:00010000:2.0:1787338948.685713:0:18563:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787338948.685716:0:18563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3c00/0x83671231080c335e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabdba expref: 10 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338948.685723:0:18563:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf40e3c00, rc 0) 00000100:00100000:2.0:1787338948.685792:0:18563:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf3e90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f11a8df7-6b86-4272-87dd-120efc0a0f31+9:17434:x1874160192223616:12345-192.168.201.53@tcp:101:lfs.0 Request processed in 1224us (1747us total) trans 0 rc 301/301 00000100:00100000:2.0:1787338948.685800:0:18563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 18 00000100:00100000:1.0:1787338948.699143:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338948.699294:0:18571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192223744 00000100:00100000:3.0:1787338948.699316:0:18571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192223744 00000100:00100000:3.0:1787338948.699369:0:18571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 0 00000100:00100000:3.0:1787338948.699379:0:18571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf3e92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:f11a8df7-6b86-4272-87dd-120efc0a0f31+9:17434:x1874160192223744:12345-192.168.201.53@tcp:700:lfs.0 00000100:00100000:3.0:1787338948.699463:0:18571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf3e92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:f11a8df7-6b86-4272-87dd-120efc0a0f31+9:17434:x1874160192223744:12345-192.168.201.53@tcp:700:lfs.0 Request processed in 85us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338948.699471:0:18571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 0 00000100:00100000:1.0:1787338948.703473:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338948.703569:0:18564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192224000 00000100:00100000:3.0:1787338948.703594:0:18564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192224000 00000100:00100000:3.0:1787338948.703652:0:18564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 19 00000100:00100000:3.0:1787338948.703662:0:18564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf3e90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f11a8df7-6b86-4272-87dd-120efc0a0f31+9:17434:x1874160192224000:12345-192.168.201.53@tcp:36:lfs.0 00010000:00010000:3.0:1787338948.703724:0:18564:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787338948.703753:0:18564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b92800/0x83671231080c32af lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabd43 expref: 9 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338948.703782:0:18564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90bbeb14d800) 00010000:00010000:3.0:1787338948.703788:0:18564:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787338948.704771:0:18564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c3373 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338948.704790:0:18564:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c32e7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabda5 expref: 5 pid: 19270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338948.704799:0:18564:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c3373 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338948.705097:0:18564:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c32e7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabda5 expref: 5 pid: 19270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338948.705311:0:18564:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c32e7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabda5 expref: 5 pid: 19270 timeout: 701 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338948.705327:0:18564:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee44ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:18564:1874160212121472:192.168.201.53@tcp:104: 00000100:00100000:3.0:1787338948.705477:0:18564:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bac2b8c0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787338948.721921:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338948.722516:0:18549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192224128 00000100:00100000:0.0:1787338948.722526:0:18549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192224128 00010000:00010000:0.0:1787338948.722603:0:18549:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c32e7 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabda5 expref: 6 pid: 19270 timeout: 701 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338948.722646:0:18549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 9 00000100:00100000:0.0:1787338948.722657:0:18549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf3e91f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eed3ef97-e99d-4750-973c-88dcada624d6+6:2359:x1874160192224128:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787338948.722672:0:18549:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787338948.722679:0:18549:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c32e7 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabda5 expref: 6 pid: 19270 timeout: 701 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338948.722693:0:18549:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c32e7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabda5 expref: 6 pid: 19270 timeout: 701 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338948.722716:0:18549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90bbeb14d800) 00010000:00010000:0.0:1787338948.722721:0:18549:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c3373 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338948.722745:0:18549:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c3373 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338948.722752:0:18549:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c3373 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338948.722771:0:18549:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787338948.722820:0:18549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf3e91f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eed3ef97-e99d-4750-973c-88dcada624d6+6:2359:x1874160192224128:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 164us (908us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338948.722841:0:18549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 9 00000100:00080000:2.0:1787338948.723985:0:18558:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787338948.724999:0:18564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c32e7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabda5 expref: 5 pid: 19270 timeout: 701 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338948.725026:0:18564:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee44ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:18564:1874160212121472:192.168.201.53@tcp:104: 00010000:00010000:3.0:1787338948.725049:0:18564:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c3373 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338948.725254:0:18564:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c3373 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338948.725263:0:18564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c3373 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338948.725292:0:18564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3c00/0x83671231080c337a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338948.725303:0:18564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3c00/0x83671231080c337a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338948.725328:0:18564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3c00/0x83671231080c337a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787338948.732342:0:18564:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1787338948.732365:0:18564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c3373 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338948.732375:0:18564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c3373 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338948.732383:0:18564:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c3373 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338948.732389:0:18564:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea5400 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:2.0:1787338948.732394:0:18564:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c3373 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338948.732401:0:18564:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c3373 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338948.732419:0:18564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90bbeb14d800) 00010000:00010000:2.0:1787338948.732422:0:18564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787338948.732426:0:18564:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c3373 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338948.732432:0:18564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5400/0x83671231080c3373 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787338948.732457:0:18564:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000400e1879 reply state 00000000d9370faf transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3c00/0x83671231080c337a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338948.732485:0:18564:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787338948.732849:0:18564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf3e90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f11a8df7-6b86-4272-87dd-120efc0a0f31+10:17434:x1874160192224000:12345-192.168.201.53@tcp:36:lfs.0 Request processed in 29184us (29382us total) trans 12884901890 rc 0/0 00000100:00100000:2.0:1787338948.732858:0:18564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 19 00010000:00010000:3.0:1787338948.738144:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3c00/0x83671231080c337a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338948.738163:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3c00/0x83671231080c337a lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338948.738171:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3c00/0x83671231080c337a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338948.738177:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e3c00 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:3.0:1787338948.738182:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3c00/0x83671231080c337a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338948.738190:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3c00/0x83671231080c337a lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338948.738226:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff90bbc8283100) 00010000:00010000:3.0:1787338948.738229:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787338948.738234:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3c00/0x83671231080c337a lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338948.738241:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3c00/0x83671231080c337a lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338948.857833:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338948.857980:0:19270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192224256 00000100:00100000:0.0:1787338948.857990:0:19270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192224256 00000100:00100000:0.0:1787338948.858053:0:19270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 20 00000100:00100000:0.0:1787338948.858064:0:19270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf3e90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f11a8df7-6b86-4272-87dd-120efc0a0f31+9:17442:x1874160192224256:12345-192.168.201.53@tcp:101:lctl.0 00010000:00010000:0.0:1787338948.858088:0:19270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787338948.858120:0:19270:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b92000/0x83671231080c3381 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadabdc1 expref: -99 pid: 19270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338948.858184:0:19270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93a00/0x83671231080c3388 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338948.858199:0:19270:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93a00/0x83671231080c3388 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338948.858209:0:19270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93a00/0x83671231080c3388 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787338948.858270:0:19270:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787338948.858274:0:19270:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 5 stripe count 1 MDT count 1 00000004:00010000:0.0:1787338948.858327:0:19270:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93a00/0x83671231080c3388 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338948.858352:0:19270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b92000/0x83671231080c3381 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabdc1 expref: 11 pid: 19270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338948.858379:0:19270:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93a00/0x83671231080c3388 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabdc1 expref: 10 pid: 19270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338948.858387:0:19270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90bbeb14d900) 00010000:00010000:0.0:1787338948.858390:0:19270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787338948.858393:0:19270:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bac3b93a00, rc 0) 00000100:00100000:0.0:1787338948.858449:0:19270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf3e90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f11a8df7-6b86-4272-87dd-120efc0a0f31+10:17442:x1874160192224256:12345-192.168.201.53@tcp:101:lctl.0 Request processed in 387us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338948.858457:0:19270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 20 00000100:00100000:1.0:1787338948.882988:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338948.883082:0:18562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192224384 00000100:00100000:2.0:1787338948.883091:0:18562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192224384 00000100:00100000:2.0:1787338948.883168:0:18562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 21 00000100:00100000:2.0:1787338948.883180:0:18562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf3e93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eed3ef97-e99d-4750-973c-88dcada624d6+5:17443:x1874160192224384:12345-192.168.201.53@tcp:101:lfs.0 00010000:00010000:2.0:1787338948.883201:0:18562:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787338948.883222:0:18562:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2200/0x83671231080c338f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadabdc8 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338948.883292:0:18562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3000/0x83671231080c3396 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338948.883306:0:18562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3000/0x83671231080c3396 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338948.883316:0:18562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3000/0x83671231080c3396 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18562 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787338948.883368:0:18562:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787338948.883370:0:18562:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 5 stripe count 1 MDT count 1 00000004:00010000:2.0:1787338948.883388:0:18562:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3000/0x83671231080c3396 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338948.883406:0:18562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2200/0x83671231080c338f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabdc8 expref: 7 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338948.883438:0:18562:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3000/0x83671231080c3396 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabdc8 expref: 6 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338948.883445:0:18562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90bbeb14d900) 00010000:00010000:2.0:1787338948.883447:0:18562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787338948.883449:0:18562:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf40e3000, rc 0) 00000100:00100000:2.0:1787338948.883499:0:18562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf3e93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eed3ef97-e99d-4750-973c-88dcada624d6+6:17443:x1874160192224384:12345-192.168.201.53@tcp:101:lfs.0 Request processed in 323us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338948.883504:0:18562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 21 00000100:00100000:3.0:1787338948.890022:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338948.890402:0:19270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192224512 00000100:00100000:0.0:1787338948.890413:0:19270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192224512 00000100:00100000:0.0:1787338948.890475:0:19270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 22 00000100:00100000:0.0:1787338948.890486:0:19270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee44ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eed3ef97-e99d-4750-973c-88dcada624d6+6:17443:x1874160192224512:12345-192.168.201.53@tcp:101:lfs.0 00010000:00010000:0.0:1787338948.890507:0:19270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787338948.890527:0:19270:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b92000/0x83671231080c339d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadabdcf expref: -99 pid: 19270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338948.890599:0:19270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93200/0x83671231080c33a4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338948.890613:0:19270:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93200/0x83671231080c33a4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338948.890623:0:19270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93200/0x83671231080c33a4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338948.890653:0:19270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93c00/0x83671231080c33ab lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338948.890661:0:19270:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93c00/0x83671231080c33ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338948.890668:0:19270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93c00/0x83671231080c33ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338948.890767:0:19270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b92200/0x83671231080c33b2 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338948.890777:0:19270:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b92200/0x83671231080c33b2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338948.890784:0:19270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b92200/0x83671231080c33b2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787338948.890829:0:19270:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1787338948.890833:0:19270:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787338948.890857:0:19270:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b92200/0x83671231080c33b2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338948.890871:0:19270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93200/0x83671231080c33a4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338948.890919:0:19270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93200/0x83671231080c33a4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338948.890927:0:19270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93200/0x83671231080c33a4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338948.890943:0:19270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bac3b93200 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:0.0:1787338948.890948:0:19270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93200/0x83671231080c33a4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338948.890956:0:19270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93200/0x83671231080c33a4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338948.890968:0:19270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90bbeb14d900) 00010000:00010000:0.0:1787338948.890971:0:19270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787338948.890975:0:19270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93200/0x83671231080c33a4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338948.890981:0:19270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93200/0x83671231080c33a4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338948.891009:0:19270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93c00/0x83671231080c33ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338948.891015:0:19270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93c00/0x83671231080c33ab lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338948.891021:0:19270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93c00/0x83671231080c33ab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338948.891026:0:19270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bac3b93c00 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:0.0:1787338948.891029:0:19270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93c00/0x83671231080c33ab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338948.891036:0:19270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93c00/0x83671231080c33ab lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338948.891055:0:19270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff90bbeb14dc00) 00010000:00010000:0.0:1787338948.891058:0:19270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787338948.891061:0:19270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93c00/0x83671231080c33ab lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338948.891067:0:19270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93c00/0x83671231080c33ab lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338948.891104:0:19270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b92000/0x83671231080c339d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabdcf expref: 8 pid: 19270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338948.891287:0:19270:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b92200/0x83671231080c33b2 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabdcf expref: 7 pid: 19270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338948.891296:0:19270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff90bbeb14d600) 00010000:00010000:0.0:1787338948.891298:0:19270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787338948.891301:0:19270:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bac3b92200, rc 0) 00000100:00100000:0.0:1787338948.891357:0:19270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee44ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eed3ef97-e99d-4750-973c-88dcada624d6+7:17443:x1874160192224512:12345-192.168.201.53@tcp:101:lfs.0 Request processed in 872us (1345us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338948.891364:0:19270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 22 00000100:00100000:1.0:1787338948.895040:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338948.900008:0:18562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192224768 00000100:00100000:2.0:1787338948.900028:0:18562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192224768 00000100:00100000:2.0:1787338948.900102:0:18562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 23 00000100:00100000:2.0:1787338948.900294:0:18562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf3e93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eed3ef97-e99d-4750-973c-88dcada624d6+7:17443:x1874160192224768:12345-192.168.201.53@tcp:101:lfs.0 00010000:00010000:2.0:1787338948.900317:0:18562:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787338948.900339:0:18562:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2200/0x83671231080c33b9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadabdd6 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787338948.900455:0:18562:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1787338948.902100:0:18562:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2200/0x83671231080c33b9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabdd6 expref: 9 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338948.902128:0:18562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90bbeb14d900) 00010000:00010000:2.0:1787338948.902132:0:18562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787338948.902137:0:18562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2200/0x83671231080c33b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabdd6 expref: 9 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338948.902178:0:18562:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf40e2200, rc 0) 00000100:00100000:2.0:1787338948.902254:0:18562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf3e93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eed3ef97-e99d-4750-973c-88dcada624d6+8:17443:x1874160192224768:12345-192.168.201.53@tcp:101:lfs.0 Request processed in 2141us (7223us total) trans 12884901891 rc 301/301 00000100:00100000:2.0:1787338948.902263:0:18562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 23 00000100:00100000:1.0:1787338948.905915:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338948.906174:0:18563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192225024 00000100:00100000:2.0:1787338948.906189:0:18563:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192225024 00000100:00100000:2.0:1787338948.906251:0:18563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 24 00000100:00100000:2.0:1787338948.906264:0:18563:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf3e92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eed3ef97-e99d-4750-973c-88dcada624d6+8:17443:x1874160192225024:12345-192.168.201.53@tcp:36:lfs.0 00010000:00010000:2.0:1787338948.906312:0:18563:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787338948.906334:0:18563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b92200/0x83671231080c33b2 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabdcf expref: 8 pid: 19270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338948.906536:0:18563:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff90bbeb14d600) 00010000:00010000:2.0:1787338948.906554:0:18563:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787338948.906779:0:18563:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c33c7 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338948.906793:0:18563:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c33c7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338948.906803:0:18563:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c33c7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787338948.907125:0:18563:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009b30cae5 reply state 000000008a6135f5 transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c33c7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338948.907134:0:18563:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787338948.907164:0:18563:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 512 00000100:00100000:2.0:1787338948.907296:0:18563:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf3e92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eed3ef97-e99d-4750-973c-88dcada624d6+9:17443:x1874160192225024:12345-192.168.201.53@tcp:36:lfs.0 Request processed in 1034us (1428us total) trans 12884901892 rc 0/0 00000100:00100000:2.0:1787338948.907304:0:18563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 24 00010000:00010000:0.0:1787338948.908868:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c33c7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338948.909736:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338948.909807:0:18566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192225280 00000100:00100000:2.0:1787338948.909817:0:18566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192225280 00000100:00100000:2.0:1787338948.909905:0:18566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 2 00000100:00100000:2.0:1787338948.909917:0:18566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf3e93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eed3ef97-e99d-4750-973c-88dcada624d6+9:17443:x1874160192225280:12345-192.168.201.53@tcp:35:lfs.0 00000100:00100000:2.0:1787338948.910168:0:18566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf3e93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eed3ef97-e99d-4750-973c-88dcada624d6+10:17443:x1874160192225280:12345-192.168.201.53@tcp:35:lfs.0 Request processed in 253us (438us total) trans 12884901893 rc 0/0 00000100:00100000:2.0:1787338948.910176:0:18566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 2 00010000:00010000:0.0:1787338948.911060:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c33c7 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338948.911070:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c33c7 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338948.911094:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e2a00 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:0.0:1787338948.911099:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c33c7 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338948.911107:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c33c7 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338948.911343:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff90bbc8283300) 00010000:00010000:0.0:1787338948.911347:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1787338948.911352:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c33c7 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338948.911359:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c33c7 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338948.913983:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338948.915276:0:18564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192225536 00000100:00100000:0.0:1787338948.915287:0:18564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192225536 00000100:00100000:0.0:1787338948.915349:0:18564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 25 00000100:00100000:0.0:1787338948.915359:0:18564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee44ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eed3ef97-e99d-4750-973c-88dcada624d6+9:17443:x1874160192225536:12345-192.168.201.53@tcp:101:lfs.0 00010000:00010000:0.0:1787338948.915383:0:18564:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787338948.915403:0:18564:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b92000/0x83671231080c33ce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadabddd expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338948.915471:0:18564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93c00/0x83671231080c33d5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338948.915486:0:18564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93c00/0x83671231080c33d5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338948.915498:0:18564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93c00/0x83671231080c33d5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338948.915526:0:18564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93200/0x83671231080c33dc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338948.915534:0:18564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93200/0x83671231080c33dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338948.915541:0:18564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93200/0x83671231080c33dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787338948.915675:0:18564:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1787338948.915767:0:18564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93c00/0x83671231080c33d5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338948.915775:0:18564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93c00/0x83671231080c33d5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338948.915782:0:18564:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93c00/0x83671231080c33d5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338948.915799:0:18564:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bac3b93c00 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:0.0:1787338948.915803:0:18564:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93c00/0x83671231080c33d5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338948.915811:0:18564:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93c00/0x83671231080c33d5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338948.915822:0:18564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90bbeb14d900) 00010000:00010000:0.0:1787338948.916069:0:18564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787338948.916075:0:18564:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93c00/0x83671231080c33d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338948.916092:0:18564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93c00/0x83671231080c33d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338948.916338:0:18564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93200/0x83671231080c33dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338948.916347:0:18564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93200/0x83671231080c33dc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338948.916352:0:18564:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93200/0x83671231080c33dc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338948.916357:0:18564:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bac3b93200 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:0.0:1787338948.916360:0:18564:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93200/0x83671231080c33dc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338948.916366:0:18564:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93200/0x83671231080c33dc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338948.916375:0:18564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff90bbeb14dc00) 00010000:00010000:0.0:1787338948.916378:0:18564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787338948.916381:0:18564:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93200/0x83671231080c33dc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338948.916386:0:18564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93200/0x83671231080c33dc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338948.916429:0:18564:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b92000/0x83671231080c33ce lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabddd expref: 11 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338948.916449:0:18564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90bbeb14d900) 00010000:00010000:0.0:1787338948.916451:0:18564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787338948.916455:0:18564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b92000/0x83671231080c33ce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabddd expref: 11 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338948.916466:0:18564:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bac3b92000, rc 0) 00000100:00100000:0.0:1787338948.916589:0:18564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee44ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eed3ef97-e99d-4750-973c-88dcada624d6+10:17443:x1874160192225536:12345-192.168.201.53@tcp:101:lfs.0 Request processed in 1231us (2614us total) trans 12884901894 rc 301/301 00000100:00100000:0.0:1787338948.916598:0:18564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 25 00000100:00100000:3.0:1787338948.922779:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338948.926387:0:19270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192225664 00000100:00100000:0.0:1787338948.926400:0:19270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192225664 00000100:00100000:0.0:1787338948.926464:0:19270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 26 00000100:00100000:0.0:1787338948.926473:0:19270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee44ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eed3ef97-e99d-4750-973c-88dcada624d6+10:17443:x1874160192225664:12345-192.168.201.53@tcp:101:lfs.0 00010000:00010000:0.0:1787338948.926497:0:19270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787338948.926518:0:19270:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93800/0x83671231080c33ea lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadabde4 expref: -99 pid: 19270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338948.926650:0:19270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9de00/0x83671231080c33f1 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338948.926666:0:19270:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9de00/0x83671231080c33f1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338948.926679:0:19270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9de00/0x83671231080c33f1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787338948.926757:0:19270:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 512 00000004:00200000:1.0:1787338948.926760:0:19270:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787338948.926785:0:19270:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9de00/0x83671231080c33f1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338948.926813:0:19270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93800/0x83671231080c33ea lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabde4 expref: 12 pid: 19270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338948.926846:0:19270:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9de00/0x83671231080c33f1 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabde4 expref: 11 pid: 19270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338948.926855:0:19270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff90bbeb14de00) 00010000:00010000:1.0:1787338948.926858:0:19270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787338948.926862:0:19270:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbfbe9de00, rc 0) 00000100:00100000:1.0:1787338948.926946:0:19270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee44ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eed3ef97-e99d-4750-973c-88dcada624d6+11:17443:x1874160192225664:12345-192.168.201.53@tcp:101:lfs.0 Request processed in 473us (4177us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338948.926963:0:19270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 26 00000100:00100000:0.0:1787338948.934156:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338948.934206:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338948.934222:0:18566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192225792 00000100:00100000:2.0:1787338948.934233:0:18566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192225792 00000100:00100000:2.0:1787338948.934294:0:18566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 3 00000100:00100000:2.0:1787338948.934305:0:18566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eed3ef97-e99d-4750-973c-88dcada624d6+11:17443:x1874160192225792:12345-192.168.201.53@tcp:37:lfs.0 00000100:00100000:1.0:1787338948.934319:0:18557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192225920 00000100:00100000:1.0:1787338948.934323:0:18557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192225920 00000100:00100000:1.0:1787338948.934357:0:18557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 114 00000100:00100000:1.0:1787338948.934364:0:18557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbff94b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6691873-d8b0-4399-ba40-203a8aa11ea0+11:16815:x1874160192225920:12345-192.168.201.53@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787338948.934372:0:18557:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787338948.934389:0:18557:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90bbfbe9ca00/0x83671231080c33f8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x81bcb3edadabdeb expref: -99 pid: 18557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338948.934411:0:18557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bbfbe9ca00/0x83671231080c33f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabdeb expref: 12 pid: 18557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338948.934430:0:18557:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90bbfbe9ca00/0x83671231080c33f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabdeb expref: 12 pid: 18557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338948.934439:0:18557:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbfbe9ca00, rc 0) 00000100:00100000:1.0:1787338948.934486:0:18557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbff94b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6691873-d8b0-4399-ba40-203a8aa11ea0+12:16815:x1874160192225920:12345-192.168.201.53@tcp:101:ll_cfg_requeue.0 Request processed in 123us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338948.934493:0:18557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 114 00000100:00100000:0.0:1787338948.937840:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338948.937936:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192226048 00000100:00100000:1.0:1787338948.937950:0:18554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192226048 00000100:00100000:1.0:1787338948.937997:0:18554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 115 00000100:00100000:1.0:1787338948.938006:0:18554:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbff949050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6691873-d8b0-4399-ba40-203a8aa11ea0+12:16815:x1874160192226048:12345-192.168.201.53@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787338948.938361:0:18554:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbff949050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6691873-d8b0-4399-ba40-203a8aa11ea0+12:16815:x1874160192226048:12345-192.168.201.53@tcp:501:ll_cfg_requeue.0 Request processed in 355us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338948.938369:0:18554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 115 00000100:00100000:2.0:1787338948.938678:0:18566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eed3ef97-e99d-4750-973c-88dcada624d6+11:17443:x1874160192225792:12345-192.168.201.53@tcp:37:lfs.0 Request processed in 4372us (4539us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338948.938685:0:18566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 3 00000100:00100000:0.0:1787338948.945996:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338948.946141:0:18565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192226304 00000100:00100000:1.0:1787338948.946152:0:18565:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192226304 00000100:00100000:1.0:1787338948.946214:0:18565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 4 00000100:00100000:1.0:1787338948.946225:0:18565:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfdb6c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eed3ef97-e99d-4750-973c-88dcada624d6+11:17443:x1874160192226304:12345-192.168.201.53@tcp:35:lfs.0 00000100:00100000:1.0:1787338948.946483:0:18565:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfdb6c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eed3ef97-e99d-4750-973c-88dcada624d6+12:17443:x1874160192226304:12345-192.168.201.53@tcp:35:lfs.0 Request processed in 258us (495us total) trans 12884901895 rc 0/0 00000100:00100000:1.0:1787338948.946491:0:18565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 4 00000100:00100000:3.0:1787338948.950477:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338948.950588:0:18556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192226432 00000100:00100000:1.0:1787338948.950651:0:18556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192226432 00000100:00100000:1.0:1787338948.950741:0:18556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 116 00000100:00100000:1.0:1787338948.950752:0:18556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbff94a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6691873-d8b0-4399-ba40-203a8aa11ea0+12:16815:x1874160192226432:12345-192.168.201.53@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787338948.951019:0:18556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbff94a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6691873-d8b0-4399-ba40-203a8aa11ea0+12:16815:x1874160192226432:12345-192.168.201.53@tcp:503:ll_cfg_requeue.0 Request processed in 269us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338948.951028:0:18556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 116 00000100:00100000:3.0:1787338948.987935:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338948.988028:0:18557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192226560 00000100:00100000:0.0:1787338948.988039:0:18557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192226560 00000100:00100000:0.0:1787338948.988098:0:18557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 117 00000100:00100000:0.0:1787338948.988120:0:18557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbff94a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6691873-d8b0-4399-ba40-203a8aa11ea0+12:16815:x1874160192226560:12345-192.168.201.53@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787338948.988264:0:18557:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787338948.988285:0:18557:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90bac3b93200/0x83671231080c33ff lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x81bcb3edadabdf2 expref: -99 pid: 18557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338948.988314:0:18557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90bac3b93200/0x83671231080c33ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabdf2 expref: 13 pid: 18557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338948.988324:0:18557:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90bac3b93200/0x83671231080c33ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabdf2 expref: 13 pid: 18557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338948.988334:0:18557:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bac3b93200, rc 0) 00000100:00100000:0.0:1787338948.988429:0:18557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbff94a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6691873-d8b0-4399-ba40-203a8aa11ea0+13:16815:x1874160192226560:12345-192.168.201.53@tcp:101:ll_cfg_requeue.0 Request processed in 321us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338948.988436:0:18557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 117 00000100:00100000:0.0:1787338948.998480:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338948.998583:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338948.998686:0:18556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192226688 00000100:00100000:1.0:1787338948.998698:0:18556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192226688 00000100:00100000:1.0:1787338948.998795:0:18556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 118 00000100:00100000:1.0:1787338948.998807:0:18556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbff948050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6691873-d8b0-4399-ba40-203a8aa11ea0+13:16815:x1874160192226688:12345-192.168.201.53@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787338948.999475:0:18556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbff948050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6691873-d8b0-4399-ba40-203a8aa11ea0+13:16815:x1874160192226688:12345-192.168.201.53@tcp:501:ll_cfg_requeue.0 Request processed in 669us (1004us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338948.999484:0:18556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 118 00000100:00100000:2.0:1787338948.999556:0:18562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192226816 00000100:00100000:2.0:1787338948.999562:0:18562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192226816 00000100:00100000:2.0:1787338948.999594:0:18562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 27 00000100:00100000:2.0:1787338948.999602:0:18562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f11a8df7-6b86-4272-87dd-120efc0a0f31+10:17450:x1874160192226816:12345-192.168.201.53@tcp:101:bash.0 00010000:00010000:2.0:1787338948.999615:0:18562:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787338948.999634:0:18562:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3e00/0x83671231080c3406 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadabdf9 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338948.999691:0:18562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2200/0x83671231080c340d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338948.999712:0:18562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2200/0x83671231080c340d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338948.999723:0:18562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2200/0x83671231080c340d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338948.999738:0:18562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c3414 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338948.999745:0:18562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c3414 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338948.999752:0:18562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c3414 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338948.999841:0:18562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3c00/0x83671231080c341b lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338948.999849:0:18562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3c00/0x83671231080c341b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338948.999856:0:18562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3c00/0x83671231080c341b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18562 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787338948.999902:0:18562:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1787338948.999906:0:18562:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787338948.999960:0:18562:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3c00/0x83671231080c341b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338948.999971:0:18562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2200/0x83671231080c340d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338948.999986:0:18562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2200/0x83671231080c340d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338948.999994:0:18562:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2200/0x83671231080c340d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338948.999999:0:18562:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e2200 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:2.0:1787338949.000003:0:18562:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2200/0x83671231080c340d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338949.000010:0:18562:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2200/0x83671231080c340d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338949.000021:0:18562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90bbeb14d900) 00010000:00010000:2.0:1787338949.000024:0:18562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787338949.000028:0:18562:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2200/0x83671231080c340d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338949.000034:0:18562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2200/0x83671231080c340d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338949.000048:0:18562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c3414 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338949.000054:0:18562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c3414 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338949.000059:0:18562:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c3414 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338949.000064:0:18562:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e2a00 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:2.0:1787338949.000072:0:18562:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c3414 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338949.000079:0:18562:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c3414 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338949.000086:0:18562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff90bbc8283d00) 00010000:00010000:2.0:1787338949.000089:0:18562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787338949.000091:0:18562:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c3414 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338949.000097:0:18562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c3414 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338949.002503:0:18562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3e00/0x83671231080c3406 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabdf9 expref: 12 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338949.002534:0:18562:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3c00/0x83671231080c341b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabdf9 expref: 11 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338949.002555:0:18562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff90bbeb14de00) 00010000:00010000:2.0:1787338949.002558:0:18562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787338949.002562:0:18562:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf40e3c00, rc 0) 00000100:00100000:2.0:1787338949.002643:0:18562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f11a8df7-6b86-4272-87dd-120efc0a0f31+11:17450:x1874160192226816:12345-192.168.201.53@tcp:101:bash.0 Request processed in 3040us (4057us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338949.002652:0:18562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 27 00000100:00100000:2.0:1787338949.005328:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338949.005420:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338949.005807:0:18557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192226944 00000100:00100000:3.0:1787338949.005819:0:18557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192226944 00000100:00100000:3.0:1787338949.005903:0:18557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 119 00000100:00100000:3.0:1787338949.005914:0:18557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc168850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6691873-d8b0-4399-ba40-203a8aa11ea0+13:16815:x1874160192226944:12345-192.168.201.53@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787338949.006398:0:18557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc168850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6691873-d8b0-4399-ba40-203a8aa11ea0+13:16815:x1874160192226944:12345-192.168.201.53@tcp:503:ll_cfg_requeue.0 Request processed in 485us (1078us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338949.006408:0:18557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 119 00000100:00100000:1.0:1787338949.009316:0:19270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192227200 00000100:00100000:1.0:1787338949.009330:0:19270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192227200 00000100:00100000:1.0:1787338949.009396:0:19270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 28 00000100:00100000:1.0:1787338949.009407:0:19270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4097100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f11a8df7-6b86-4272-87dd-120efc0a0f31+11:17450:x1874160192227200:12345-192.168.201.53@tcp:101:bash.0 00010000:00010000:1.0:1787338949.009428:0:19270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787338949.009449:0:19270:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d200/0x83671231080c3422 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadabe00 expref: -99 pid: 19270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338949.009593:0:19270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c3429 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338949.009608:0:19270:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9de00/0x83671231080c33f1 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabde4 expref: 11 pid: 19270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338949.009618:0:19270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c3429 lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338949.009676:0:19270:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9de00/0x83671231080c33f1 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabde4 expref: 11 pid: 19270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338949.009691:0:19270:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9de00/0x83671231080c33f1 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabde4 expref: 11 pid: 19270 timeout: 701 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338949.009703:0:19270:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf3e93100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19270:1874160212121600:192.168.201.53@tcp:104: 00000100:00100000:1.0:1787338949.009793:0:19270:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbfbcd8180 going to sleep for 11 seconds 00000100:00100000:2.0:1787338949.012735:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338949.012770:0:18548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192227328 00000100:00100000:2.0:1787338949.012793:0:18548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192227328 00010000:00010000:2.0:1787338949.012831:0:18548:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9de00/0x83671231080c33f1 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabde4 expref: 12 pid: 19270 timeout: 701 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338949.012864:0:18548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 10 00000100:00100000:2.0:1787338949.012895:0:18548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4097800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eed3ef97-e99d-4750-973c-88dcada624d6+12:2359:x1874160192227328:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787338949.012910:0:18548:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787338949.012917:0:18548:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9de00/0x83671231080c33f1 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabde4 expref: 12 pid: 19270 timeout: 701 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338949.012931:0:18548:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9de00/0x83671231080c33f1 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabde4 expref: 12 pid: 19270 timeout: 701 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338949.012964:0:18548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff90bbeb14de00) 00010000:00010000:2.0:1787338949.012970:0:18548:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c3429 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338949.012980:0:18548:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c3429 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338949.012988:0:18548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c3429 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338949.013006:0:18548:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787338949.013052:0:18548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4097800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eed3ef97-e99d-4750-973c-88dcada624d6+12:2359:x1874160192227328:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 180us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338949.013060:0:18548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 10 00010000:00010000:1.0:1787338949.014002:0:19270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9de00/0x83671231080c33f1 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabde4 expref: 11 pid: 19270 timeout: 701 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338949.014023:0:19270:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf3e93100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19270:1874160212121600:192.168.201.53@tcp:104: 00010000:00010000:1.0:1787338949.014045:0:19270:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c3429 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338949.014055:0:19270:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c3429 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338949.014061:0:19270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c3429 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338949.014313:0:19270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c600/0x83671231080c3430 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338949.014325:0:19270:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c600/0x83671231080c3430 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338949.014335:0:19270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c600/0x83671231080c3430 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338949.015445:0:19270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d000/0x83671231080c3437 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338949.015459:0:19270:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d000/0x83671231080c3437 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338949.015468:0:19270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d000/0x83671231080c3437 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787338949.015480:0:19270:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787338949.015508:0:19270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c3429 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338949.015515:0:19270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c3429 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338949.015523:0:19270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c3429 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338949.015529:0:19270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbfbe9d600 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:1.0:1787338949.015534:0:19270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c3429 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338949.015541:0:19270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c3429 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338949.015566:0:19270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff90bbeb14de00) 00010000:00010000:1.0:1787338949.015569:0:19270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787338949.015573:0:19270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c3429 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338949.015594:0:19270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c3429 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787338949.015608:0:19270:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b2fcd7e8 reply state 0000000042f95eb7 transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c600/0x83671231080c3430 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338949.015616:0:19270:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787338949.015655:0:19270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d200/0x83671231080c3422 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabe00 expref: 14 pid: 19270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338949.015669:0:19270:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d000/0x83671231080c3437 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabe00 expref: 13 pid: 19270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338949.015677:0:19270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90bbc9a99d00) 00010000:00010000:1.0:1787338949.015679:0:19270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1787338949.015681:0:19270:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbfbe9d000, rc 0) 00000100:00100000:1.0:1787338949.015751:0:19270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4097100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f11a8df7-6b86-4272-87dd-120efc0a0f31+14:17450:x1874160192227200:12345-192.168.201.53@tcp:101:bash.0 Request processed in 6346us (10330us total) trans 12884901896 rc 0/0 00000100:00100000:1.0:1787338949.015760:0:19270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 28 00010000:00010000:3.0:1787338949.021038:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c600/0x83671231080c3430 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338949.021057:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c600/0x83671231080c3430 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338949.021065:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c600/0x83671231080c3430 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338949.021093:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbfbe9c600 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:3.0:1787338949.021098:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c600/0x83671231080c3430 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338949.021116:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c600/0x83671231080c3430 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338949.021144:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff90bbc9a99e00) 00010000:00010000:3.0:1787338949.021148:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787338949.021152:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c600/0x83671231080c3430 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338949.021160:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c600/0x83671231080c3430 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338949.035312:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338949.035628:0:18564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192227456 00000100:00100000:0.0:1787338949.035638:0:18564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192227456 00000100:00100000:0.0:1787338949.035700:0:18564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 29 00000100:00100000:0.0:1787338949.035712:0:18564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee44f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f11a8df7-6b86-4272-87dd-120efc0a0f31+13:17450:x1874160192227456:12345-192.168.201.53@tcp:101:bash.0 00010000:00010000:0.0:1787338949.035735:0:18564:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787338949.035755:0:18564:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b92a00/0x83671231080c3445 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadabe07 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338949.035824:0:18564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93400/0x83671231080c344c lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338949.035838:0:18564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93400/0x83671231080c344c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338949.035862:0:18564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93400/0x83671231080c344c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787338949.035951:0:18564:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787338949.035956:0:18564:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787338949.035978:0:18564:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93400/0x83671231080c344c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338949.035990:0:18564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93400/0x83671231080c344c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338949.036016:0:18564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b92a00/0x83671231080c3445 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabe07 expref: 15 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338949.036046:0:18564:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93400/0x83671231080c344c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabe07 expref: 14 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338949.036055:0:18564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90bbc9a99d00) 00010000:00010000:0.0:1787338949.036059:0:18564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787338949.036063:0:18564:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bac3b93400, rc 0) 00000100:00100000:0.0:1787338949.036376:0:18564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee44f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f11a8df7-6b86-4272-87dd-120efc0a0f31+14:17450:x1874160192227456:12345-192.168.201.53@tcp:101:bash.0 Request processed in 665us (1073us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338949.036383:0:18564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 29 00000100:00100000:2.0:1787338949.039378:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338949.039480:0:18565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192227712 00000100:00100000:1.0:1787338949.039491:0:18565:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192227712 00000100:00100000:1.0:1787338949.039556:0:18565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 5 00000100:00100000:1.0:1787338949.039566:0:18565:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4094380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f11a8df7-6b86-4272-87dd-120efc0a0f31+14:17450:x1874160192227712:12345-192.168.201.53@tcp:35:bash.0 00000100:00100000:1.0:1787338949.039914:0:18565:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4094380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f11a8df7-6b86-4272-87dd-120efc0a0f31+15:17450:x1874160192227712:12345-192.168.201.53@tcp:35:bash.0 Request processed in 349us (546us total) trans 12884901897 rc 0/0 00000100:00100000:1.0:1787338949.039922:0:18565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 5 00000100:00100000:3.0:1787338949.137506:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338949.137642:0:18563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192227968 00000100:00100000:2.0:1787338949.137669:0:18563:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192227968 00000100:00100000:2.0:1787338949.137735:0:18563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 30 00000100:00100000:2.0:1787338949.137747:0:18563:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee44c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f11a8df7-6b86-4272-87dd-120efc0a0f31+15:17461:x1874160192227968:12345-192.168.201.53@tcp:101:lfs.0 00010000:00010000:2.0:1787338949.137783:0:18563:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787338949.137807:0:18563:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3e00/0x83671231080c3453 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadabe0e expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787338949.137960:0:18563:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1787338949.138081:0:18563:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3e00/0x83671231080c3453 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabe0e expref: 17 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338949.138373:0:18563:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90bbeb14d900) 00010000:00010000:2.0:1787338949.138377:0:18563:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787338949.138383:0:18563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3e00/0x83671231080c3453 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabe0e expref: 17 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338949.138400:0:18563:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf40e3e00, rc 0) 00000100:00100000:2.0:1787338949.138469:0:18563:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee44c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f11a8df7-6b86-4272-87dd-120efc0a0f31+16:17461:x1874160192227968:12345-192.168.201.53@tcp:101:lfs.0 Request processed in 723us (972us total) trans 12884901898 rc 301/301 00000100:00100000:2.0:1787338949.138476:0:18563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 30 00000100:00100000:3.0:1787338949.140860:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338949.140978:0:18565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192228224 00000100:00100000:1.0:1787338949.140999:0:18565:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192228224 00000100:00100000:1.0:1787338949.141049:0:18565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 6 00000100:00100000:1.0:1787338949.141058:0:18565:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee44df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f11a8df7-6b86-4272-87dd-120efc0a0f31+16:17461:x1874160192228224:12345-192.168.201.53@tcp:35:lfs.0 00000100:00100000:1.0:1787338949.141310:0:18565:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee44df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f11a8df7-6b86-4272-87dd-120efc0a0f31+17:17461:x1874160192228224:12345-192.168.201.53@tcp:35:lfs.0 Request processed in 252us (458us total) trans 12884901899 rc 0/0 00000100:00100000:1.0:1787338949.141319:0:18565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 6 00000100:00100000:3.0:1787338949.211920:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338949.212077:0:18562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192228480 00000100:00100000:2.0:1787338949.212088:0:18562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192228480 00000100:00100000:2.0:1787338949.212157:0:18562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 31 00000100:00100000:2.0:1787338949.212173:0:18562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee44dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f11a8df7-6b86-4272-87dd-120efc0a0f31+17:17464:x1874160192228480:12345-192.168.201.53@tcp:101:lfs.0 00010000:00010000:2.0:1787338949.212201:0:18562:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787338949.212223:0:18562:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3e00/0x83671231080c3461 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadabe15 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338949.212341:0:18562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c3468 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338949.212357:0:18562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c3468 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338949.212370:0:18562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c3468 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18562 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787338949.212382:0:18562:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787338949.212511:0:18562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3e00/0x83671231080c3461 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabe15 expref: 20 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338949.212532:0:18562:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c3468 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabe15 expref: 19 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338949.212553:0:18562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90bbc9a99d00) 00010000:00010000:2.0:1787338949.212557:0:18562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787338949.212561:0:18562:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf40e2a00, rc 0) 00000100:00100000:2.0:1787338949.212628:0:18562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee44dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f11a8df7-6b86-4272-87dd-120efc0a0f31+19:17464:x1874160192228480:12345-192.168.201.53@tcp:101:lfs.0 Request processed in 461us (770us total) trans 12884901900 rc 0/0 00000100:00100000:2.0:1787338949.212645:0:18562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 31 00000100:00100000:3.0:1787338949.215840:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338949.216026:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192228608 00000100:00100000:1.0:1787338949.216035:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192228608 00000100:00100000:1.0:1787338949.216098:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 0 00000100:00100000:1.0:1787338949.216124:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee44ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f11a8df7-6b86-4272-87dd-120efc0a0f31+19:2358:x1874160192228608:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787338949.216145:0:18547:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787338949.216168:0:18547:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c3468 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabe15 expref: 19 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338949.216189:0:18547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90bbc9a99d00) 00010000:00010000:1.0:1787338949.216194:0:18547:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787338949.216248:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee44ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f11a8df7-6b86-4272-87dd-120efc0a0f31+18:2358:x1874160192228608:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 140us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338949.216255:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 0 00000100:00100000:3.0:1787338949.222239:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338949.222400:0:19270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192228736 00000100:00100000:1.0:1787338949.222410:0:19270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192228736 00000100:00100000:1.0:1787338949.222469:0:19270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 32 00000100:00100000:1.0:1787338949.222479:0:19270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee44f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f11a8df7-6b86-4272-87dd-120efc0a0f31+18:17464:x1874160192228736:12345-192.168.201.53@tcp:54:lfs.0 00010000:00010000:1.0:1787338949.222558:0:19270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d200/0x83671231080c3476 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338949.222586:0:19270:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d200/0x83671231080c3476 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338949.222623:0:19270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d200/0x83671231080c3476 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338949.222649:0:19270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d200/0x83671231080c3476 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338949.222656:0:19270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d200/0x83671231080c3476 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338949.222662:0:19270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d200/0x83671231080c3476 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338949.222669:0:19270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbfbe9d200 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:1.0:1787338949.222674:0:19270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d200/0x83671231080c3476 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338949.222682:0:19270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d200/0x83671231080c3476 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338949.222694:0:19270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90bbc9a99d00) 00010000:00010000:1.0:1787338949.222697:0:19270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787338949.222703:0:19270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d200/0x83671231080c3476 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338949.222709:0:19270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d200/0x83671231080c3476 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338949.222785:0:19270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee44f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f11a8df7-6b86-4272-87dd-120efc0a0f31+18:17464:x1874160192228736:12345-192.168.201.53@tcp:54:lfs.0 Request processed in 307us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338949.222795:0:19270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 32 00000100:00100000:3.0:1787338949.231242:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338949.231492:0:18565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192228992 00000100:00100000:1.0:1787338949.231502:0:18565:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192228992 00000100:00100000:1.0:1787338949.231563:0:18565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 7 00000100:00100000:1.0:1787338949.231573:0:18565:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee44fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f11a8df7-6b86-4272-87dd-120efc0a0f31+18:17464:x1874160192228992:12345-192.168.201.53@tcp:35:lfs.0 00000100:00100000:1.0:1787338949.231802:0:18565:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee44fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f11a8df7-6b86-4272-87dd-120efc0a0f31+19:17464:x1874160192228992:12345-192.168.201.53@tcp:35:lfs.0 Request processed in 229us (568us total) trans 12884901901 rc 0/0 00000100:00100000:1.0:1787338949.231809:0:18565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 7 00010000:00010000:3.0:1787338949.238036:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787338949.558790:0:18597:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787338949.599004:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338949.599467:0:18564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192229248 00000100:00100000:0.0:1787338949.599479:0:18564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192229248 00000100:00100000:0.0:1787338949.599604:0:18564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 33 00000100:00100000:0.0:1787338949.599617:0:18564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee44c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f11a8df7-6b86-4272-87dd-120efc0a0f31+19:17495:x1874160192229248:12345-192.168.201.53@tcp:101:cat.0 00010000:00010000:0.0:1787338949.599643:0:18564:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787338949.599681:0:18564:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93000/0x83671231080c347d lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadabe1c expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338949.599795:0:18564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b92a00/0x83671231080c3484 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338949.599810:0:18564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b92a00/0x83671231080c3484 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338949.599822:0:18564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b92a00/0x83671231080c3484 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787338949.599834:0:18564:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787338949.600043:0:18564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93000/0x83671231080c347d lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabe1c expref: 22 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338949.600074:0:18564:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b92a00/0x83671231080c3484 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabe1c expref: 21 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338949.600084:0:18564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90bbc9a99d00) 00010000:00010000:0.0:1787338949.600087:0:18564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787338949.600091:0:18564:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bac3b92a00, rc 0) 00000100:00100000:0.0:1787338949.600480:0:18564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee44c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f11a8df7-6b86-4272-87dd-120efc0a0f31+21:17495:x1874160192229248:12345-192.168.201.53@tcp:101:cat.0 Request processed in 864us (1483us total) trans 12884901902 rc 0/0 00000100:00100000:0.0:1787338949.600488:0:18564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 33 00000100:00100000:0.0:1787338949.607658:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338949.608333:0:18565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192229504 00000100:00100000:1.0:1787338949.608343:0:18565:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192229504 00000100:00100000:1.0:1787338949.608409:0:18565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 8 00000100:00100000:1.0:1787338949.608419:0:18565:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f11a8df7-6b86-4272-87dd-120efc0a0f31+21:17495:x1874160192229504:12345-192.168.201.53@tcp:35:cat.0 00000100:00100000:1.0:1787338949.608774:0:18565:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f11a8df7-6b86-4272-87dd-120efc0a0f31+22:17495:x1874160192229504:12345-192.168.201.53@tcp:35:cat.0 Request processed in 354us (1682us total) trans 12884901903 rc 0/0 00000100:00100000:1.0:1787338949.608782:0:18565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 8 00000100:00100000:0.0:1787338949.609153:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338949.610381:0:18549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192229632 00000100:00100000:2.0:1787338949.610392:0:18549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192229632 00000100:00100000:2.0:1787338949.610457:0:18549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 1 00000100:00100000:2.0:1787338949.610468:0:18549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa4a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f11a8df7-6b86-4272-87dd-120efc0a0f31+22:2356:x1874160192229632:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787338949.610500:0:18549:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787338949.610524:0:18549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b92a00/0x83671231080c3484 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabe1c expref: 22 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338949.610566:0:18549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90bbc9a99d00) 00010000:00010000:2.0:1787338949.610572:0:18549:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787338949.610613:0:18549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa4a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f11a8df7-6b86-4272-87dd-120efc0a0f31+21:2356:x1874160192229632:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 147us (1461us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338949.610620:0:18549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 1 00000100:00100000:3.0:1787338949.709024:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338949.709274:0:19270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192229888 00000100:00100000:1.0:1787338949.709285:0:19270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192229888 00000100:00100000:1.0:1787338949.709346:0:19270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 34 00000100:00100000:1.0:1787338949.709356:0:19270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee44f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f11a8df7-6b86-4272-87dd-120efc0a0f31+21:17501:x1874160192229888:12345-192.168.201.53@tcp:101:dd.0 00010000:00010000:1.0:1787338949.709381:0:19270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787338949.709400:0:19270:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d200/0x83671231080c3492 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadabe23 expref: -99 pid: 19270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338949.709494:0:19270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c3499 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338949.709508:0:19270:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c3499 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338949.709563:0:19270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c3499 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787338949.709577:0:19270:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787338949.714963:0:19270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d200/0x83671231080c3492 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabe23 expref: 24 pid: 19270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338949.715776:0:19270:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c3499 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabe23 expref: 23 pid: 19270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338949.715789:0:19270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90bbc9a99d00) 00010000:00010000:0.0:1787338949.715792:0:19270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787338949.715797:0:19270:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbfbe9d600, rc 0) 00000100:00100000:0.0:1787338949.715946:0:19270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee44f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f11a8df7-6b86-4272-87dd-120efc0a0f31+23:17501:x1874160192229888:12345-192.168.201.53@tcp:101:dd.0 Request processed in 6588us (6927us total) trans 12884901904 rc 0/0 00000100:00100000:0.0:1787338949.715955:0:19270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 34 00000100:00100000:2.0:1787338949.718957:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338949.719015:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338949.719284:0:18562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192230272 00000100:00100000:0.0:1787338949.719295:0:18562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192230272 00000100:00100000:0.0:1787338949.719356:0:18562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 35 00000100:00100000:0.0:1787338949.719366:0:18562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4094000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f11a8df7-6b86-4272-87dd-120efc0a0f31+23:17501:x1874160192230272:12345-192.168.201.53@tcp:36:dd.0 00010000:00010000:0.0:1787338949.719428:0:18562:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787338949.719458:0:18562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93400/0x83671231080c344c lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabe07 expref: 23 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338949.719489:0:18562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90bbc9a99d00) 00010000:00010000:0.0:1787338949.719494:0:18562:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787338949.719846:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192230016 00000100:00100000:1.0:1787338949.719851:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192230016 00000100:00100000:1.0:1787338949.719915:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 2 00000100:00100000:1.0:1787338949.719923:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfbfeb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f11a8df7-6b86-4272-87dd-120efc0a0f31+23:2359:x1874160192230016:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787338949.719934:0:18547:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787338949.719945:0:18547:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c3499 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabe23 expref: 23 pid: 19270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338949.719956:0:18547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90bbc9a99d00) 00010000:00010000:1.0:1787338949.719959:0:18547:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787338949.720023:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfbfeb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f11a8df7-6b86-4272-87dd-120efc0a0f31+22:2359:x1874160192230016:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 101us (1007us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338949.720031:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 2 00010000:00010000:0.0:1787338949.720451:0:18562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b92000/0x83671231080c34a7 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338949.720465:0:18562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b92000/0x83671231080c34a7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338949.720475:0:18562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b92000/0x83671231080c34a7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18562 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787338949.720547:0:18562:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901905 00000004:00010000:0.0:1787338949.720573:0:18562:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002dce50ae reply state 00000000a4168104 transno 12884901906 ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b92000/0x83671231080c34a7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18562 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338949.720582:0:18562:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787338949.720652:0:18562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4094000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f11a8df7-6b86-4272-87dd-120efc0a0f31+24:17501:x1874160192230272:12345-192.168.201.53@tcp:36:dd.0 Request processed in 1287us (1704us total) trans 12884901906 rc 0/0 00000100:00100000:0.0:1787338949.720659:0:18562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 35 00000020:00080000:0.0:1787338949.720663:0:18562:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787338949.725111:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b92000/0x83671231080c34a7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338949.725131:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b92000/0x83671231080c34a7 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338949.725139:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b92000/0x83671231080c34a7 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338949.725145:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bac3b92000 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:0.0:1787338949.725152:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b92000/0x83671231080c34a7 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338949.725160:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b92000/0x83671231080c34a7 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338949.725180:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90bbc9a99d00) 00010000:00010000:0.0:1787338949.725183:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787338949.725188:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b92000/0x83671231080c34a7 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338949.725194:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b92000/0x83671231080c34a7 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18562 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338949.750388:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787338949.750421:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc4097480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874160212121728:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787338949.750522:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338949.750527:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee44e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874160212121984:0@lo:400:kworker.0 00000100:00100000:1.0:1787338949.750615:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee44d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4530016f-1c37-4f4c-b7ee-21f57031a048:3317:1874160212121856:0@lo:400:kworker.0 00000100:00100000:2.0:1787338949.750635:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee44e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874160212122112:0@lo:400:kworker.0 00000100:00100000:0.0:1787338949.750742:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee44ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874160212122240:0@lo:400:kworker.0 00000100:00100000:3.0:1787338949.751972:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338949.752034:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbedcb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1874160212122496:0@lo:400:kworker.0 00000100:00100000:3.0:1787338949.752088:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338949.752156:0:19247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212121984 00000100:00100000:3.0:1787338949.752165:0:19247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212121984 00000100:00100000:3.0:1787338949.752234:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787338949.752243:0:19247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbedcb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874160212121984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787338949.752295:0:19247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbedcb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874160212121984:12345-0@lo:400:kworker.0 Request processed in 53us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338949.752302:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787338949.752340:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee44e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874160212121984:0@lo:400:kworker.0 00000100:00100000:3.0:1787338949.752381:0:18563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212122496 00000100:00100000:3.0:1787338949.752384:0:18563:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212122496 00000100:00100000:3.0:1787338949.752410:0:18563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787338949.752416:0:18563:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbedcb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874160212122496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787338949.752444:0:18563:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbedcb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874160212122496:12345-0@lo:400:kworker.0 Request processed in 29us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338949.752450:0:18563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787338949.752468:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbedcb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1874160212122496:0@lo:400:kworker.0 00000100:00080000:3.0:1787338949.752491:0:18558:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787338949.752495:0:18558:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787338949.760523:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338949.761207:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbedcb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1874160212122368:0@lo:400:kworker.0 00000100:00100000:1.0:1787338949.761280:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338949.761969:0:18557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212121856 00000100:00100000:3.0:1787338949.761982:0:18557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212121856 00000100:00100000:3.0:1787338949.762049:0:18557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1787338949.762065:0:18557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc16b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4530016f-1c37-4f4c-b7ee-21f57031a048+19:3317:x1874160212121856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787338949.762185:0:18557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc16b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4530016f-1c37-4f4c-b7ee-21f57031a048+19:3317:x1874160212121856:12345-0@lo:400:kworker.0 Request processed in 124us (1672us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338949.762195:0:18557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1787338949.764987:0:19250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212121728 00000100:00100000:1.0:1787338949.765033:0:19250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212121728 00000100:00100000:1.0:1787338949.765149:0:19250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787338949.765164:0:19250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf3e91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874160212121728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787338949.765232:0:19250:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787338949.765362:0:19250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf3e91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874160212121728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 203us (14839us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338949.765370:0:19250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787338949.765433:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee44d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4530016f-1c37-4f4c-b7ee-21f57031a048:3317:1874160212121856:0@lo:400:kworker.0 00000100:00100000:1.0:1787338949.765472:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc4097480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874160212121728:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787338949.765521:0:18562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212122368 00000100:00100000:1.0:1787338949.765526:0:18562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212122368 00000100:00100000:1.0:1787338949.765583:0:18562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00080000:3.0:1787338949.765971:0:18558:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787338949.765978:0:18558:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787338949.769752:0:18562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf3e91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874160212122368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787338949.769965:0:18562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf3e91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874160212122368:12345-0@lo:400:kworker.0 Request processed in 4373us (8682us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338949.769980:0:18562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787338949.770086:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338949.770790:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbedcb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1874160212122368:0@lo:400:kworker.0 00000100:00100000:2.0:1787338949.771901:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc4096a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874160212122624:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787338949.772048:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338949.772323:0:19250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212122624 00000100:00100000:3.0:1787338949.772333:0:19250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212122624 00000100:00100000:3.0:1787338949.772404:0:19250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787338949.772418:0:19250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4095500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874160212122624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787338949.772468:0:19250:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787338949.772543:0:19250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4095500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874160212122624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338949.772552:0:19250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787338949.772690:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc4096a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874160212122624:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787338949.772796:0:20031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212122112 00000100:00100000:1.0:1787338949.772802:0:20031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212122112 00000100:00100000:1.0:1787338949.772866:0:20031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787338949.772918:0:20031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4095180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1874160212122112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787338949.773062:0:20031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4095180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1874160212122112:12345-0@lo:400:kworker.0 Request processed in 188us (2976us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338949.773069:0:20031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787338949.775246:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338949.775264:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee44e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874160212122112:0@lo:400:kworker.0 00000100:00100000:1.0:1787338949.775917:0:18563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212122240 00000100:00100000:1.0:1787338949.775937:0:18563:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212122240 00000100:00100000:1.0:1787338949.775992:0:18563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787338949.776002:0:18563:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874160212122240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787338949.776107:0:18563:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874160212122240:12345-0@lo:400:kworker.0 Request processed in 97us (860us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338949.776115:0:18563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787338949.777947:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee44ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874160212122240:0@lo:400:kworker.0 00000100:00100000:0.0:1787338949.846166:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338949.846255:0:18565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192230528 00000100:00100000:1.0:1787338949.846265:0:18565:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192230528 00000100:00100000:1.0:1787338949.846329:0:18565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 9 00000100:00100000:1.0:1787338949.846340:0:18565:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f11a8df7-6b86-4272-87dd-120efc0a0f31+23:17501:x1874160192230528:12345-192.168.201.53@tcp:35:dd.0 00000100:00100000:1.0:1787338949.846648:0:18565:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f11a8df7-6b86-4272-87dd-120efc0a0f31+24:17501:x1874160192230528:12345-192.168.201.53@tcp:35:dd.0 Request processed in 310us (492us total) trans 12884901907 rc 0/0 00000100:00100000:1.0:1787338949.846656:0:18565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 9 00000100:00100000:3.0:1787338949.956714:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338949.956757:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338949.956788:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338949.956824:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338949.956851:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338949.956928:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338949.957075:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192230912 00000100:00100000:2.0:1787338949.957084:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192230912 00000100:00100000:2.0:1787338949.957153:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192231168 00000100:00100000:2.0:1787338949.957156:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192231168 00000100:00100000:2.0:1787338949.957170:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192230784 00000100:00100000:2.0:1787338949.957173:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192230784 00000100:00100000:2.0:1787338949.957182:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192231296 00000100:00100000:2.0:1787338949.957185:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192231296 00000100:00100000:2.0:1787338949.957200:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 12 00000100:00100000:2.0:1787338949.957210:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbedcb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f11a8df7-6b86-4272-87dd-120efc0a0f31+5:2357:x1874160192230912:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:2.0:1787338949.957295:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbedcb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f11a8df7-6b86-4272-87dd-120efc0a0f31+5:2357:x1874160192230912:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 86us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338949.957304:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 12 00000100:00100000:2.0:1787338949.957321:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 13 00000100:00100000:2.0:1787338949.957327:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbedcb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eed3ef97-e99d-4750-973c-88dcada624d6+5:2357:x1874160192231168:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:2.0:1787338949.957350:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbedcb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eed3ef97-e99d-4750-973c-88dcada624d6+5:2357:x1874160192231168:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 24us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338949.957356:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 13 00000100:00100000:2.0:1787338949.957366:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 14 00000100:00100000:2.0:1787338949.957372:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee44ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f11a8df7-6b86-4272-87dd-120efc0a0f31+5:2357:x1874160192230784:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:2.0:1787338949.957390:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee44ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f11a8df7-6b86-4272-87dd-120efc0a0f31+5:2357:x1874160192230784:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 18us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338949.957395:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 14 00000100:00100000:2.0:1787338949.957406:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 15 00000100:00100000:2.0:1787338949.957411:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee44d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eed3ef97-e99d-4750-973c-88dcada624d6+5:2357:x1874160192231296:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:2.0:1787338949.957429:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee44d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eed3ef97-e99d-4750-973c-88dcada624d6+5:2357:x1874160192231296:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 18us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338949.957435:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 15 00000100:00100000:2.0:1787338949.957451:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192230656 00000100:00100000:2.0:1787338949.957455:0:18554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192230656 00000100:00100000:2.0:1787338949.957479:0:18554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 121 00000100:00100000:2.0:1787338949.957485:0:18554:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc16a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6691873-d8b0-4399-ba40-203a8aa11ea0+13:2357:x1874160192230656:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:2.0:1787338949.957506:0:18554:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc16a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6691873-d8b0-4399-ba40-203a8aa11ea0+13:2357:x1874160192230656:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 22us (814us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338949.957517:0:18554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 121 00000100:00080000:2.0:1787338949.957679:0:18558:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787338949.957682:0:18558:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787338949.957696:0:18562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192231040 00000100:00100000:2.0:1787338949.957699:0:18562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192231040 00000100:00100000:2.0:1787338949.957729:0:18562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 26 00000100:00100000:2.0:1787338949.957736:0:18562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee44e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eed3ef97-e99d-4750-973c-88dcada624d6+11:2357:x1874160192231040:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:2.0:1787338949.957774:0:18562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee44e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eed3ef97-e99d-4750-973c-88dcada624d6+11:2357:x1874160192231040:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 39us (922us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338949.957780:0:18562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 26 00000100:00100000:3.0:1787338950.084516:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338950.084690:0:18563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192231424 00000100:00100000:1.0:1787338950.084910:0:18563:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192231424 00000100:00080000:2.0:1787338950.085051:0:18558:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787338950.085273:0:18563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 36 00000100:00100000:1.0:1787338950.085288:0:18563:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee44e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f11a8df7-6b86-4272-87dd-120efc0a0f31+24:17515:x1874160192231424:12345-192.168.201.53@tcp:101:stat.0 00010000:00010000:1.0:1787338950.085319:0:18563:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787338950.085343:0:18563:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c34ae lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadabe2a expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338950.085416:0:18563:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9de00/0x83671231080c34b5 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338950.085431:0:18563:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9de00/0x83671231080c34b5 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338950.085441:0:18563:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9de00/0x83671231080c34b5 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338950.085456:0:18563:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c34bc lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338950.085481:0:18563:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c34bc lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338950.085489:0:18563:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c34bc lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338950.085599:0:18563:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c400/0x83671231080c34c3 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338950.085609:0:18563:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c400/0x83671231080c34c3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338950.085616:0:18563:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c400/0x83671231080c34c3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787338950.085651:0:18563:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1787338950.085656:0:18563:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787338950.085692:0:18563:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c400/0x83671231080c34c3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338950.085717:0:18563:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c400/0x83671231080c34c3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338950.085726:0:18563:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9de00/0x83671231080c34b5 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338950.085732:0:18563:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9de00/0x83671231080c34b5 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338950.085738:0:18563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9de00/0x83671231080c34b5 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338950.085753:0:18563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbfbe9de00 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:1.0:1787338950.085758:0:18563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9de00/0x83671231080c34b5 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338950.085764:0:18563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9de00/0x83671231080c34b5 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338950.085777:0:18563:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff90bbeb14de00) 00010000:00010000:1.0:1787338950.085780:0:18563:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787338950.085784:0:18563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9de00/0x83671231080c34b5 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338950.085790:0:18563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9de00/0x83671231080c34b5 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338950.085803:0:18563:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c34bc lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338950.085809:0:18563:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c34bc lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338950.085814:0:18563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c34bc lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338950.085819:0:18563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbfbe9d800 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:1.0:1787338950.085822:0:18563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c34bc lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338950.085828:0:18563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c34bc lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338950.085846:0:18563:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff90bbc9a99a00) 00010000:00010000:1.0:1787338950.085848:0:18563:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787338950.085851:0:18563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c34bc lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338950.085856:0:18563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c34bc lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338950.085937:0:18563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c34ae lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabe2a expref: 26 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338950.085951:0:18563:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c400/0x83671231080c34c3 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabe2a expref: 25 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338950.085959:0:18563:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90bbc9a99d00) 00010000:00010000:1.0:1787338950.085962:0:18563:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787338950.085964:0:18563:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbfbe9c400, rc 0) 00000100:00100000:1.0:1787338950.086037:0:18563:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee44e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f11a8df7-6b86-4272-87dd-120efc0a0f31+25:17515:x1874160192231424:12345-192.168.201.53@tcp:101:stat.0 Request processed in 754us (1531us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338950.086044:0:18563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 36 00000100:00100000:2.0:1787338950.233473:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338950.233619:0:18562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192231680 00000100:00100000:1.0:1787338950.233631:0:18562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192231680 00000100:00100000:1.0:1787338950.233704:0:18562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 37 00000100:00100000:1.0:1787338950.233716:0:18562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4096a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f11a8df7-6b86-4272-87dd-120efc0a0f31+25:17521:x1874160192231680:12345-192.168.201.53@tcp:36:truncate.0 00010000:00010000:1.0:1787338950.233783:0:18562:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787338950.233811:0:18562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c400/0x83671231080c34c3 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabe2a expref: 25 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338950.233851:0:18562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90bbc9a99d00) 00010000:00010000:1.0:1787338950.233857:0:18562:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787338950.234468:0:18562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c34ca lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338950.234482:0:18562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c34ca lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338950.234491:0:18562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c34ca lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18562 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787338950.234547:0:18562:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901908 00000004:00010000:1.0:1787338950.234570:0:18562:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004b423591 reply state 0000000048ba7de8 transno 12884901909 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c34ca lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18562 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338950.234580:0:18562:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787338950.235307:0:18562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4096a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f11a8df7-6b86-4272-87dd-120efc0a0f31+27:17521:x1874160192231680:12345-192.168.201.53@tcp:36:truncate.0 Request processed in 1588us (1841us total) trans 12884901909 rc 0/0 00000100:00100000:1.0:1787338950.235317:0:18562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 37 00000020:00080000:1.0:1787338950.235324:0:18562:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787338950.248157:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c34ca lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338950.248176:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c34ca lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338950.248185:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c34ca lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338950.248191:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbfbe9d600 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:1.0:1787338950.248209:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c34ca lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338950.248218:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c34ca lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338950.248235:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90bbc9a99d00) 00010000:00010000:1.0:1787338950.248238:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787338950.248242:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c34ca lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338950.248249:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d600/0x83671231080c34ca lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338950.262307:0:18551:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787338950.455237:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338950.455380:0:19270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192231808 00000100:00100000:3.0:1787338950.455393:0:19270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192231808 00000100:00100000:3.0:1787338950.455457:0:19270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 38 00000100:00100000:3.0:1787338950.455468:0:19270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4094700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f11a8df7-6b86-4272-87dd-120efc0a0f31+26:17535:x1874160192231808:12345-192.168.201.53@tcp:101:stat.0 00010000:00010000:3.0:1787338950.455493:0:19270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787338950.455514:0:19270:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5c00/0x83671231080c34d1 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadabe31 expref: -99 pid: 19270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338950.455640:0:19270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c34d8 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338950.455655:0:19270:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c34d8 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338950.455666:0:19270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c34d8 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338950.455681:0:19270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c34df lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338950.455688:0:19270:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c34df lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338950.455695:0:19270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c34df lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338950.455792:0:19270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4800/0x83671231080c34e6 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338950.456062:0:19270:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4800/0x83671231080c34e6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338950.456071:0:19270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4800/0x83671231080c34e6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787338950.462867:0:19270:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 1234567 00000004:00200000:2.0:1787338950.462896:0:19270:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787338950.462939:0:19270:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4800/0x83671231080c34e6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338950.462959:0:19270:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4800/0x83671231080c34e6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338950.462971:0:19270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c34d8 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338950.462978:0:19270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c34d8 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338950.462986:0:19270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c34d8 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338950.463011:0:19270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea5800 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:2.0:1787338950.463016:0:19270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c34d8 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338950.463024:0:19270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c34d8 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338950.463042:0:19270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff90bbeb14de00) 00010000:00010000:2.0:1787338950.463045:0:19270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787338950.463050:0:19270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c34d8 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338950.463055:0:19270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5800/0x83671231080c34d8 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338950.463073:0:19270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c34df lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338950.463079:0:19270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c34df lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338950.463085:0:19270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c34df lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338950.463090:0:19270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea5a00 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:2.0:1787338950.463093:0:19270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c34df lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338950.463100:0:19270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c34df lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338950.464051:0:19270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff90bbd38d6c00) 00010000:00010000:2.0:1787338950.464055:0:19270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787338950.464059:0:19270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c34df lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338950.464065:0:19270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5a00/0x83671231080c34df lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338950.464140:0:19270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5c00/0x83671231080c34d1 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabe31 expref: 28 pid: 19270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338950.464157:0:19270:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4800/0x83671231080c34e6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabe31 expref: 27 pid: 19270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338950.464164:0:19270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90bbc9a99d00) 00010000:00010000:2.0:1787338950.464166:0:19270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787338950.464169:0:19270:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf7ea4800, rc 0) 00000100:00100000:2.0:1787338950.464256:0:19270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4094700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f11a8df7-6b86-4272-87dd-120efc0a0f31+27:17535:x1874160192231808:12345-192.168.201.53@tcp:101:stat.0 Request processed in 8788us (9029us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338950.464265:0:19270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 38 00000100:00100000:3.0:1787338950.649215:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338950.649321:0:18564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192232064 00000100:00100000:2.0:1787338950.649333:0:18564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192232064 00000100:00100000:2.0:1787338950.649395:0:18564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 39 00000100:00100000:2.0:1787338950.649407:0:18564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee080a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f11a8df7-6b86-4272-87dd-120efc0a0f31+27:17545:x1874160192232064:12345-192.168.201.53@tcp:101:lfs.0 00010000:00010000:2.0:1787338950.649429:0:18564:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787338950.649449:0:18564:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3800/0x83671231080c34ed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadabe38 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787338950.649611:0:18564:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1787338950.649746:0:18564:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3800/0x83671231080c34ed lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabe38 expref: 29 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338950.649761:0:18564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90bbeb14d900) 00010000:00010000:2.0:1787338950.649764:0:18564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787338950.649770:0:18564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3800/0x83671231080c34ed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabe38 expref: 29 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338950.649785:0:18564:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf40e3800, rc 0) 00000100:00100000:2.0:1787338950.649854:0:18564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee080a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f11a8df7-6b86-4272-87dd-120efc0a0f31+28:17545:x1874160192232064:12345-192.168.201.53@tcp:101:lfs.0 Request processed in 449us (650us total) trans 12884901910 rc 301/301 00000100:00100000:2.0:1787338950.649861:0:18564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 39 00000100:00100000:1.0:1787338950.653424:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338950.653509:0:18566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192232320 00000100:00100000:0.0:1787338950.653529:0:18566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192232320 00000100:00100000:0.0:1787338950.653584:0:18566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 10 00000100:00100000:0.0:1787338950.653595:0:18566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfdb6c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f11a8df7-6b86-4272-87dd-120efc0a0f31+28:17545:x1874160192232320:12345-192.168.201.53@tcp:35:lfs.0 00000100:00100000:0.0:1787338950.653855:0:18566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfdb6c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f11a8df7-6b86-4272-87dd-120efc0a0f31+29:17545:x1874160192232320:12345-192.168.201.53@tcp:35:lfs.0 Request processed in 260us (437us total) trans 12884901911 rc 0/0 00000100:00100000:0.0:1787338950.653863:0:18566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 10 00000100:00100000:3.0:1787338950.753771:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338950.753939:0:18563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192232576 00000100:00100000:1.0:1787338950.753950:0:18563:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192232576 00000100:00100000:1.0:1787338950.754015:0:18563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 40 00000100:00100000:1.0:1787338950.754027:0:18563:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee081c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f11a8df7-6b86-4272-87dd-120efc0a0f31+29:17551:x1874160192232576:12345-192.168.201.53@tcp:101:bash.0 00010000:00010000:1.0:1787338950.754057:0:18563:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787338950.754080:0:18563:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c400/0x83671231080c34fb lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadabe3f expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338950.754214:0:18563:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c3502 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338950.754230:0:18563:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d000/0x83671231080c3437 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabe00 expref: 30 pid: 19270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338950.754238:0:18563:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4800/0x83671231080c34e6 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabe31 expref: 30 pid: 19270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338950.754264:0:18563:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c3502 lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338950.754305:0:18563:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4800/0x83671231080c34e6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabe31 expref: 30 pid: 19270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338950.754318:0:18563:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4800/0x83671231080c34e6 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabe31 expref: 30 pid: 19270 timeout: 703 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338950.754332:0:18563:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf3e91f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:18563:1874160212122752:192.168.201.53@tcp:104: 00010000:00010000:1.0:1787338950.754446:0:18563:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d000/0x83671231080c3437 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabe00 expref: 30 pid: 19270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338950.754455:0:18563:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d000/0x83671231080c3437 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabe00 expref: 30 pid: 19270 timeout: 703 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338950.754463:0:18563:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbf3e93100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:18563:1874160212122880:192.168.201.53@tcp:104: 00000100:00100000:1.0:1787338950.754488:0:18563:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbd16a2b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787338950.757498:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338950.757572:0:18548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192232704 00000100:00100000:2.0:1787338950.757581:0:18548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192232704 00000100:00100000:3.0:1787338950.757610:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00010000:00010000:2.0:1787338950.757636:0:18548:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4800/0x83671231080c34e6 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabe31 expref: 31 pid: 19270 timeout: 703 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338950.757663:0:18548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192232832 00000100:00100000:2.0:1787338950.757667:0:18548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192232832 00010000:00010000:2.0:1787338950.757679:0:18548:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d000/0x83671231080c3437 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabe00 expref: 32 pid: 19270 timeout: 703 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338950.757693:0:18549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 11 00000100:00100000:3.0:1787338950.757704:0:18549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf7ed7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f11a8df7-6b86-4272-87dd-120efc0a0f31+32:2358:x1874160192232704:12345-192.168.201.53@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787338950.757704:0:18548:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1787338950.757710:0:18548:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:3.0:1787338950.757717:0:18549:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787338950.757724:0:18549:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4800/0x83671231080c34e6 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabe31 expref: 32 pid: 19270 timeout: 703 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338950.757738:0:18549:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4800/0x83671231080c34e6 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabe31 expref: 32 pid: 19270 timeout: 703 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338950.757761:0:18549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90bbc9a99d00) 00010000:00010000:3.0:1787338950.757767:0:18549:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c3502 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338950.757775:0:18549:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c3502 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338950.757782:0:18549:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787338950.757842:0:18549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf7ed7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f11a8df7-6b86-4272-87dd-120efc0a0f31+32:2358:x1874160192232704:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 140us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338950.757849:0:18549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 11 00000100:00100000:3.0:1787338950.757869:0:18549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 12 00000100:00100000:3.0:1787338950.757898:0:18549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf7ed6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f11a8df7-6b86-4272-87dd-120efc0a0f31+31:2358:x1874160192232832:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787338950.757906:0:18549:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787338950.757911:0:18549:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d000/0x83671231080c3437 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabe00 expref: 31 pid: 19270 timeout: 703 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338950.757932:0:18549:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d000/0x83671231080c3437 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabe00 expref: 31 pid: 19270 timeout: 703 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338950.757951:0:18549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90bbc9a99d00) 00010000:00010000:3.0:1787338950.757955:0:18549:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c3502 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338950.757963:0:18549:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c3502 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338950.757970:0:18549:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c3502 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338950.757987:0:18549:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787338950.758007:0:18549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf7ed6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f11a8df7-6b86-4272-87dd-120efc0a0f31+31:2358:x1874160192232832:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 111us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338950.758013:0:18549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 12 00010000:00010000:1.0:1787338950.758581:0:18563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea4800/0x83671231080c34e6 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabe31 expref: 30 pid: 19270 timeout: 703 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338950.758600:0:18563:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf3e91f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:18563:1874160212122752:192.168.201.53@tcp:104: 00010000:00010000:1.0:1787338950.758611:0:18563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d000/0x83671231080c3437 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabe00 expref: 29 pid: 19270 timeout: 703 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338950.758635:0:18563:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbf3e93100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:18563:1874160212122880:192.168.201.53@tcp:104: 00010000:00010000:1.0:1787338950.758661:0:18563:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c3502 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338950.758670:0:18563:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c3502 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338950.758676:0:18563:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c3502 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787338950.758696:0:18563:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 1234567 00010000:00010000:1.0:1787338950.758864:0:18563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9c400/0x83671231080c34fb lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabe3f expref: 30 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338950.758931:0:18563:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c3502 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabe3f expref: 29 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338950.758941:0:18563:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90bbc9a99d00) 00010000:00010000:1.0:1787338950.758943:0:18563:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787338950.758946:0:18563:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbfbe9d800, rc 0) 00000100:00100000:1.0:1787338950.759002:0:18563:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee081c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f11a8df7-6b86-4272-87dd-120efc0a0f31+29:17551:x1874160192232576:12345-192.168.201.53@tcp:101:bash.0 Request processed in 4977us (5242us total) trans 12884901912 rc 0/0 00000100:00100000:1.0:1787338950.759009:0:18563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 40 00000100:00100000:0.0:1787338950.765052:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338950.765559:0:18564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192233088 00000100:00100000:2.0:1787338950.765571:0:18564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192233088 00000100:00100000:2.0:1787338950.765642:0:18564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 41 00000100:00100000:2.0:1787338950.765653:0:18564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f11a8df7-6b86-4272-87dd-120efc0a0f31+29:17551:x1874160192233088:12345-192.168.201.53@tcp:36:bash.0 00010000:00010000:2.0:1787338950.765961:0:18564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3400/0x83671231080c3510 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338950.765978:0:18564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3400/0x83671231080c3510 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338950.765990:0:18564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3400/0x83671231080c3510 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787338950.766037:0:18564:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901913 00000004:00010000:2.0:1787338950.766059:0:18564:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009df85917 reply state 0000000077c75efc transno 12884901914 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3400/0x83671231080c3510 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338950.766068:0:18564:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787338950.766170:0:18564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f11a8df7-6b86-4272-87dd-120efc0a0f31+32:17551:x1874160192233088:12345-192.168.201.53@tcp:36:bash.0 Request processed in 516us (1126us total) trans 12884901914 rc 0/0 00000100:00100000:2.0:1787338950.766177:0:18564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 41 00000020:00080000:2.0:1787338950.766183:0:18564:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787338950.767965:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3400/0x83671231080c3510 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338950.767982:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3400/0x83671231080c3510 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338950.767989:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3400/0x83671231080c3510 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338950.767996:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e3400 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:2.0:1787338950.768001:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3400/0x83671231080c3510 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338950.768023:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3400/0x83671231080c3510 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338950.768040:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90bbc9a99d00) 00010000:00010000:2.0:1787338950.768044:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787338950.768049:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3400/0x83671231080c3510 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338950.768055:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3400/0x83671231080c3510 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338950.768613:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338950.768680:0:19270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192233216 00000100:00100000:2.0:1787338950.768690:0:19270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192233216 00000100:00100000:2.0:1787338950.768747:0:19270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 42 00000100:00100000:2.0:1787338950.768758:0:19270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f11a8df7-6b86-4272-87dd-120efc0a0f31+31:17551:x1874160192233216:12345-192.168.201.53@tcp:101:bash.0 00010000:00010000:2.0:1787338950.768780:0:19270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787338950.768797:0:19270:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3800/0x83671231080c3517 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadabe46 expref: -99 pid: 19270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338950.768849:0:19270:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3800/0x83671231080c3517 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabe46 expref: 32 pid: 19270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338950.768862:0:19270:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3800/0x83671231080c3517 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabe46 expref: 32 pid: 19270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338950.774345:0:19270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90bbc9a99d00) 00010000:00010000:2.0:1787338950.774357:0:19270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787338950.774364:0:19270:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf40e3800, rc 0) 00000100:00100000:2.0:1787338950.774480:0:19270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f11a8df7-6b86-4272-87dd-120efc0a0f31+32:17551:x1874160192233216:12345-192.168.201.53@tcp:101:bash.0 Request processed in 5718us (5866us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338950.774490:0:19270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 42 00000100:00100000:0.0:1787338950.782541:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338950.782619:0:18564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192233344 00000100:00100000:2.0:1787338950.782632:0:18564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192233344 00000100:00100000:2.0:1787338950.782690:0:18564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 43 00000100:00100000:2.0:1787338950.782700:0:18564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f11a8df7-6b86-4272-87dd-120efc0a0f31+32:17551:x1874160192233344:12345-192.168.201.53@tcp:101:bash.0 00010000:00010000:2.0:1787338950.782721:0:18564:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787338950.782741:0:18564:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2200/0x83671231080c351e lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadabe4d expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338950.782820:0:18564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3e00/0x83671231080c3525 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338950.782833:0:18564:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c3502 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabe3f expref: 33 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338950.782842:0:18564:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3e00/0x83671231080c3525 lrc: 4/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338950.782906:0:18564:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c3502 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabe3f expref: 33 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338950.782919:0:18564:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c3502 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabe3f expref: 33 pid: 18563 timeout: 703 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338950.782933:0:18564:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc4096300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:18564:1874160212123008:192.168.201.53@tcp:104: 00000100:00100000:2.0:1787338950.783003:0:18564:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbd1649540 going to sleep for 11 seconds 00000100:00100000:0.0:1787338950.788348:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338950.788427:0:18549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192233472 00000100:00100000:3.0:1787338950.788438:0:18549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192233472 00010000:00010000:3.0:1787338950.788532:0:18549:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c3502 lrc: 5/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabe3f expref: 34 pid: 18563 timeout: 703 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338950.788588:0:18549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 13 00000100:00100000:3.0:1787338950.788600:0:18549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa4a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f11a8df7-6b86-4272-87dd-120efc0a0f31+34:2359:x1874160192233472:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787338950.788615:0:18549:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787338950.788622:0:18549:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c3502 lrc: 5/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabe3f expref: 34 pid: 18563 timeout: 703 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338950.788635:0:18549:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c3502 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabe3f expref: 34 pid: 18563 timeout: 703 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338950.788682:0:18549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90bbc9a99d00) 00010000:00010000:3.0:1787338950.788687:0:18549:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3e00/0x83671231080c3525 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338950.788697:0:18549:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3e00/0x83671231080c3525 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338950.788704:0:18549:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3e00/0x83671231080c3525 lrc: 4/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338950.788725:0:18549:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787338950.788792:0:18549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa4a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f11a8df7-6b86-4272-87dd-120efc0a0f31+34:2359:x1874160192233472:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 193us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338950.788800:0:18549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 13 00010000:00010000:2.0:1787338950.789481:0:18564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9d800/0x83671231080c3502 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabe3f expref: 33 pid: 18563 timeout: 703 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338950.789501:0:18564:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc4096300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:18564:1874160212123008:192.168.201.53@tcp:104: 00010000:00010000:2.0:1787338950.789533:0:18564:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3e00/0x83671231080c3525 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338950.789544:0:18564:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3e00/0x83671231080c3525 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338950.789551:0:18564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3e00/0x83671231080c3525 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787338950.789766:0:18564:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787338950.789773:0:18564:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787338950.789799:0:18564:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3e00/0x83671231080c3525 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338950.789837:0:18564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2200/0x83671231080c351e lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabe4d expref: 33 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338950.789854:0:18564:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3e00/0x83671231080c3525 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabe4d expref: 32 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338950.789926:0:18564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90bbc9a99d00) 00010000:00010000:0.0:1787338950.789930:0:18564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787338950.789934:0:18564:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf40e3e00, rc 0) 00000100:00100000:0.0:1787338950.789999:0:18564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f11a8df7-6b86-4272-87dd-120efc0a0f31+32:17551:x1874160192233344:12345-192.168.201.53@tcp:101:bash.0 Request processed in 7298us (7468us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338950.790007:0:18564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 43 00000100:00100000:0.0:1787338950.795258:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338950.802745:0:18548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192233728 00000100:00100000:1.0:1787338950.802762:0:18548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192233728 00000100:00100000:1.0:1787338950.804082:0:18548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 3 00000100:00100000:1.0:1787338950.804111:0:18548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f11a8df7-6b86-4272-87dd-120efc0a0f31+32:17551:x1874160192233728:12345-192.168.201.53@tcp:103:bash.0 00010000:00010000:1.0:1787338950.804150:0:18548:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1787338950.804175:0:18548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3e00/0x83671231080c3525 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabe4d expref: 32 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338950.804199:0:18548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3800/0x83671231080c3517 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabe46 expref: 31 pid: 19270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338950.804210:0:18548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90bbc9a99d00) 00010000:00010000:1.0:1787338950.804221:0:18548:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787338950.804290:0:18548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f11a8df7-6b86-4272-87dd-120efc0a0f31+30:17551:x1874160192233728:12345-192.168.201.53@tcp:103:bash.0 Request processed in 198us (9045us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338950.804299:0:18548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 3 00000100:00100000:1.0:1787338950.811739:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338950.812230:0:18563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192233856 00000100:00100000:3.0:1787338950.812241:0:18563:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192233856 00000100:00100000:3.0:1787338950.812297:0:18563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 44 00000100:00100000:3.0:1787338950.812307:0:18563:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf3e93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f11a8df7-6b86-4272-87dd-120efc0a0f31+30:17551:x1874160192233856:12345-192.168.201.53@tcp:58:bash.0 00010000:00010000:3.0:1787338950.812403:0:18563:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5000/0x83671231080c352c lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338950.812420:0:18563:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5000/0x83671231080c352c lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338950.812432:0:18563:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5000/0x83671231080c352c lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787338950.813628:0:18563:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787338950.813772:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:0.0:1787338950.813848:0:18563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:0.0:1787338950.813983:0:18563:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf3e93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f11a8df7-6b86-4272-87dd-120efc0a0f31+30:17551:x1874160192233856:12345-192.168.201.53@tcp:58:bash.0 Request processed in 1672us (2248us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338950.813992:0:18563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 44 00000100:00100000:0.0:1787338950.821136:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338950.821280:0:18562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192233984 00000100:00100000:1.0:1787338950.821291:0:18562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192233984 00000100:00100000:1.0:1787338950.821352:0:18562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 45 00000100:00100000:1.0:1787338950.821363:0:18562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f11a8df7-6b86-4272-87dd-120efc0a0f31+30:17551:x1874160192233984:12345-192.168.201.53@tcp:101:bash.0 00010000:00010000:1.0:1787338950.821387:0:18562:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787338950.821412:0:18562:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9de00/0x83671231080c3533 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadabe54 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338950.821468:0:18562:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5000/0x83671231080c352c lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338950.821480:0:18562:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9de00/0x83671231080c3533 lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabe54 expref: 31 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338950.821528:0:18562:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5000/0x83671231080c352c lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338950.821541:0:18562:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9de00/0x83671231080c3533 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabe54 expref: 31 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338950.821556:0:18562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90bbd38d6d00) 00010000:00010000:1.0:1787338950.821559:0:18562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787338950.821563:0:18562:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9de00/0x83671231080c3533 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabe54 expref: 31 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338950.821572:0:18562:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbfbe9de00, rc 0) 00000100:00100000:1.0:1787338950.821662:0:18562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f11a8df7-6b86-4272-87dd-120efc0a0f31+31:17551:x1874160192233984:12345-192.168.201.53@tcp:101:bash.0 Request processed in 301us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338950.821671:0:18562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 45 00010000:00010000:3.0:1787338951.286160:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787338951.606206:0:18597:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1787338951.606217:0:18597:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787338951.606251:0:18597:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:2.0:1787338951.606258:0:18597:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:2.0:1787338951.606374:0:18597:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc4096300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:18597:1874160212123136:192.168.201.53@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787338951.606491:0:18597:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbd16490c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787338951.610970:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338951.611083:0:18573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192234112 00000100:00100000:3.0:1787338951.611114:0:18573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192234112 00000100:00100000:3.0:1787338951.611181:0:18573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 0 00000100:00100000:3.0:1787338951.611191:0:18573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f11a8df7-6b86-4272-87dd-120efc0a0f31+32:17552:x1874160192234112:12345-192.168.201.53@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1787338951.611282:0:18573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f11a8df7-6b86-4272-87dd-120efc0a0f31+32:17552:x1874160192234112:12345-192.168.201.53@tcp:900:lhsmtool_posix.0 Request processed in 93us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338951.611289:0:18573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 0 00000100:00100000:2.0:1787338951.611965:0:18597:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc4096300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:18597:1874160212123136:192.168.201.53@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787338951.624338:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338951.626549:0:18563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192234240 00000100:00100000:0.0:1787338951.626565:0:18563:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192234240 00000100:00100000:0.0:1787338951.626654:0:18563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 46 00000100:00100000:0.0:1787338951.626666:0:18563:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf7ed5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f11a8df7-6b86-4272-87dd-120efc0a0f31+31:17552:x1874160192234240:12345-192.168.201.53@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787338951.626705:0:18563:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787338951.628472:0:18563:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf7ed5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f11a8df7-6b86-4272-87dd-120efc0a0f31+31:17552:x1874160192234240:12345-192.168.201.53@tcp:53:lhsmtool_posix.0 Request processed in 1798us (4134us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338951.628483:0:18563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 46 00000100:00100000:1.0:1787338951.639717:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338951.640946:0:18562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192234368 00000100:00100000:2.0:1787338951.640959:0:18562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192234368 00000100:00100000:2.0:1787338951.641029:0:18562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 47 00000100:00100000:2.0:1787338951.641041:0:18562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf3e91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f11a8df7-6b86-4272-87dd-120efc0a0f31+31:17552:x1874160192234368:12345-192.168.201.53@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787338951.641147:0:18562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c353a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338951.641525:0:18562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c353a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338951.641559:0:18562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c353a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338951.641643:0:18562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2000/0x83671231080c3541 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338951.641651:0:18562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2000/0x83671231080c3541 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338951.641659:0:18562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2000/0x83671231080c3541 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338951.641689:0:18562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c3548 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338951.641697:0:18562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c3548 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338951.641703:0:18562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c3548 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18562 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787338951.641754:0:18562:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1787338951.641760:0:18562:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787338951.642380:0:18562:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c3548 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338951.642395:0:18562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c353a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338951.642403:0:18562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c353a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338951.642424:0:18562:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c353a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338951.642429:0:18562:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e2a00 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:2.0:1787338951.642434:0:18562:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c353a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338951.642442:0:18562:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c353a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338951.642454:0:18562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90bbeb14da00) 00010000:00010000:2.0:1787338951.642457:0:18562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787338951.642462:0:18562:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c353a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338951.642468:0:18562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c353a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338951.642486:0:18562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2000/0x83671231080c3541 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338951.642491:0:18562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2000/0x83671231080c3541 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338951.642496:0:18562:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2000/0x83671231080c3541 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338951.642512:0:18562:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e2000 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:2.0:1787338951.642515:0:18562:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2000/0x83671231080c3541 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338951.642530:0:18562:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2000/0x83671231080c3541 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338951.642538:0:18562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff90bbc8283d00) 00010000:00010000:2.0:1787338951.642541:0:18562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787338951.642543:0:18562:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2000/0x83671231080c3541 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338951.642549:0:18562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2000/0x83671231080c3541 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338951.642563:0:18562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c3548 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338951.642569:0:18562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c3548 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338951.642575:0:18562:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c3548 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338951.642581:0:18562:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e3200 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:2.0:1787338951.642583:0:18562:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c3548 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338951.642588:0:18562:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c3548 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338951.642596:0:18562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90bbd38d6d00) 00010000:00010000:2.0:1787338951.642598:0:18562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787338951.642601:0:18562:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c3548 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338951.642615:0:18562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c3548 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18562 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338951.642790:0:18562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf3e91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f11a8df7-6b86-4272-87dd-120efc0a0f31+31:17552:x1874160192234368:12345-192.168.201.53@tcp:34:lhsmtool_posix.0 Request processed in 1740us (3073us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338951.642800:0:18562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 47 00000100:00100000:1.0:1787338951.657572:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338951.658414:0:19270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192234624 00000100:00100000:2.0:1787338951.658427:0:19270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192234624 00000100:00100000:2.0:1787338951.658515:0:19270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 48 00000100:00100000:2.0:1787338951.658527:0:19270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf3e90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f11a8df7-6b86-4272-87dd-120efc0a0f31+31:17552:x1874160192234624:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787338951.658556:0:19270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787338951.658587:0:19270:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c354f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadabe5b expref: -99 pid: 19270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338951.658709:0:19270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2000/0x83671231080c3556 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338951.658725:0:19270:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2000/0x83671231080c3556 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338951.658738:0:19270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2000/0x83671231080c3556 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787338951.658751:0:19270:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787338951.659442:0:19270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2000/0x83671231080c3556 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338951.659452:0:19270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2000/0x83671231080c3556 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338951.659476:0:19270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2000/0x83671231080c3556 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338951.659482:0:19270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e2000 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:2.0:1787338951.659487:0:19270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2000/0x83671231080c3556 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338951.659494:0:19270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2000/0x83671231080c3556 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338951.659520:0:19270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90bbd38d6d00) 00010000:00010000:2.0:1787338951.659523:0:19270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787338951.659527:0:19270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2000/0x83671231080c3556 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338951.659534:0:19270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2000/0x83671231080c3556 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338951.659586:0:19270:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c354f lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabe5b expref: 33 pid: 19270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338951.659598:0:19270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90bbeb14da00) 00010000:00010000:2.0:1787338951.659600:0:19270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787338951.659604:0:19270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c354f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabe5b expref: 33 pid: 19270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338951.659615:0:19270:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf40e3200, rc 0) 00000100:00100000:2.0:1787338951.659688:0:19270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf3e90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f11a8df7-6b86-4272-87dd-120efc0a0f31+32:17552:x1874160192234624:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 Request processed in 1163us (2126us total) trans 12884901915 rc 301/301 00000100:00100000:2.0:1787338951.659704:0:19270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 48 00000100:00100000:3.0:1787338951.670809:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338951.671645:0:18564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192234752 00000100:00100000:0.0:1787338951.671657:0:18564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192234752 00000100:00100000:0.0:1787338951.671740:0:18564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 49 00000100:00100000:0.0:1787338951.671751:0:18564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf7ed4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f11a8df7-6b86-4272-87dd-120efc0a0f31+32:17552:x1874160192234752:12345-192.168.201.53@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787338951.671801:0:18564:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787338951.671988:0:18564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf7ed4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f11a8df7-6b86-4272-87dd-120efc0a0f31+32:17552:x1874160192234752:12345-192.168.201.53@tcp:53:lhsmtool_posix.0 Request processed in 238us (1188us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338951.671996:0:18564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 49 00000100:00100000:1.0:1787338951.680791:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338951.681334:0:18563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192235008 00000100:00100000:0.0:1787338951.681345:0:18563:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192235008 00000100:00100000:0.0:1787338951.681414:0:18563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 50 00000100:00100000:0.0:1787338951.681426:0:18563:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf3e91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f11a8df7-6b86-4272-87dd-120efc0a0f31+32:17552:x1874160192235008:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787338951.681449:0:18563:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787338951.681473:0:18563:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b92800/0x83671231080c3564 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadabe62 expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787338951.689244:0:18563:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x23:0x0], count =31 00000004:00080000:0.0:1787338951.689257:0:18563:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x23:0x0]+31 in llog 00000004:00080000:0.0:1787338951.689364:0:18563:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x42:0x0], index 0: 0 00010000:00010000:0.0:1787338951.690814:0:18563:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b92200/0x83671231080c356b lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338951.690833:0:18563:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b92200/0x83671231080c356b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338951.690845:0:18563:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b92200/0x83671231080c356b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338951.692403:0:18563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b92800/0x83671231080c3564 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabe62 expref: 35 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338951.692481:0:18563:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b92200/0x83671231080c356b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabe62 expref: 34 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338951.692491:0:18563:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff90bbeb14dc00) 00010000:00010000:0.0:1787338951.692494:0:18563:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787338951.692509:0:18563:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bac3b92200, rc 0) 00000100:00100000:0.0:1787338951.692612:0:18563:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf3e91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f11a8df7-6b86-4272-87dd-120efc0a0f31+34:17552:x1874160192235008:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 Request processed in 11186us (11839us total) trans 12884901916 rc 0/0 00000100:00100000:0.0:1787338951.692622:0:18563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 50 00000100:00100000:1.0:1787338951.704145:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338951.704384:0:18564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192235264 00000100:00100000:0.0:1787338951.704399:0:18564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192235264 00000100:00100000:0.0:1787338951.704462:0:18564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 51 00000100:00100000:0.0:1787338951.704473:0:18564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf3e93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f11a8df7-6b86-4272-87dd-120efc0a0f31+34:17552:x1874160192235264:12345-192.168.201.53@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787338951.704576:0:18564:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787338951.704610:0:18564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b92200/0x83671231080c356b lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabe62 expref: 34 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338951.704648:0:18564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff90bbeb14dc00) 00010000:00010000:0.0:1787338951.704663:0:18564:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787338951.704688:0:18564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b92800/0x83671231080c3579 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338951.704702:0:18564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b92800/0x83671231080c3579 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338951.704711:0:18564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b92800/0x83671231080c3579 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338951.704764:0:18564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b92c00/0x83671231080c3580 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xc38a3139 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338951.704772:0:18564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b92c00/0x83671231080c3580 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xc38a3139 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338951.704779:0:18564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b92c00/0x83671231080c3580 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xc38a3139 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338951.704856:0:18564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b92800/0x83671231080c3579 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338951.704864:0:18564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b92800/0x83671231080c3579 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338951.704871:0:18564:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b92800/0x83671231080c3579 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338951.704932:0:18564:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bac3b92800 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:0.0:1787338951.704938:0:18564:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b92800/0x83671231080c3579 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338951.704945:0:18564:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b92800/0x83671231080c3579 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338951.704955:0:18564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff90bbeb14de00) 00010000:00010000:0.0:1787338951.704958:0:18564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787338951.704961:0:18564:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b92800/0x83671231080c3579 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338951.704967:0:18564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b92800/0x83671231080c3579 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338951.704988:0:18564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b92c00/0x83671231080c3580 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xc38a3139 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338951.704994:0:18564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b92c00/0x83671231080c3580 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xc38a3139 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338951.705001:0:18564:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b92c00/0x83671231080c3580 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xc38a3139 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338951.705006:0:18564:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bac3b92c00 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:0.0:1787338951.705008:0:18564:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b92c00/0x83671231080c3580 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xc38a3139 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338951.705014:0:18564:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b92c00/0x83671231080c3580 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xc38a3139 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338951.705025:0:18564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xc38a3139 (ffff90bbeb14df00) 00010000:00010000:0.0:1787338951.705027:0:18564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787338951.705030:0:18564:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b92c00/0x83671231080c3580 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xc38a3139 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338951.705036:0:18564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b92c00/0x83671231080c3580 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xc38a3139 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338951.705434:0:18564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf3e93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f11a8df7-6b86-4272-87dd-120efc0a0f31+33:17552:x1874160192235264:12345-192.168.201.53@tcp:36:lhsmtool_posix.0 Request processed in 960us (1300us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787338951.705443:0:18564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 51 00000100:00100000:0.0:1787338951.711126:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338951.711283:0:19270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192235392 00000100:00100000:2.0:1787338951.711294:0:19270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192235392 00000100:00100000:2.0:1787338951.711351:0:19270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 52 00000100:00100000:2.0:1787338951.711363:0:19270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f11a8df7-6b86-4272-87dd-120efc0a0f31+33:17552:x1874160192235392:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787338951.711384:0:19270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787338951.711404:0:19270:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c3587 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadabe69 expref: -99 pid: 19270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338951.711444:0:19270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2000/0x83671231080c358e lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338951.711457:0:19270:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2000/0x83671231080c358e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338951.711469:0:19270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2000/0x83671231080c358e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338951.711580:0:19270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c3587 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabe69 expref: 35 pid: 19270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338951.711599:0:19270:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2000/0x83671231080c358e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabe69 expref: 34 pid: 19270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338951.711608:0:19270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff90bbc8283d00) 00010000:00010000:2.0:1787338951.711611:0:19270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787338951.711615:0:19270:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf40e2000, rc 0) 00000100:00100000:2.0:1787338951.711671:0:19270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f11a8df7-6b86-4272-87dd-120efc0a0f31+34:17552:x1874160192235392:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 Request processed in 309us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338951.711684:0:19270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 52 00000100:00100000:1.0:1787338951.720288:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338951.720799:0:18564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192235648 00000100:00100000:0.0:1787338951.720824:0:18564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192235648 00000100:00100000:0.0:1787338951.720923:0:18564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 53 00000100:00100000:0.0:1787338951.720943:0:18564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf3e92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f11a8df7-6b86-4272-87dd-120efc0a0f31+34:17552:x1874160192235648:12345-192.168.201.53@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787338951.721037:0:18564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b92c00/0x83671231080c3595 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338951.721057:0:18564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b92c00/0x83671231080c3595 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338951.721082:0:18564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b92c00/0x83671231080c3595 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787338951.721691:0:18564:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].2, 88 off8344 00000004:00080000:0.0:1787338951.721702:0:18564:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 604562827598ns, next at 605562825546ns, rc = 0 00000004:00010000:0.0:1787338951.721784:0:18564:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f129822b reply state 00000000844b4554 transno 12884901917 ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b92c00/0x83671231080c3595 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338951.721795:0:18564:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787338951.721919:0:18564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf3e92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f11a8df7-6b86-4272-87dd-120efc0a0f31+36:17552:x1874160192235648:12345-192.168.201.53@tcp:36:lhsmtool_posix.0 Request processed in 977us (1639us total) trans 12884901917 rc 0/0 00000100:00100000:0.0:1787338951.721928:0:18564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 53 00000100:00100000:3.0:1787338951.730574:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00010000:00010000:0.0:1787338951.730789:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b92c00/0x83671231080c3595 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338951.730804:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b92c00/0x83671231080c3595 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338951.730812:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b92c00/0x83671231080c3595 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338951.730818:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bac3b92c00 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:0.0:1787338951.730838:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b92c00/0x83671231080c3595 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338951.730846:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b92c00/0x83671231080c3595 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338951.730903:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff90bbc8283d00) 00010000:00010000:0.0:1787338951.730907:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787338951.730911:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b92c00/0x83671231080c3595 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338951.730918:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b92c00/0x83671231080c3595 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18564 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338951.735533:0:19270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192235776 00000100:00100000:2.0:1787338951.735554:0:19270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192235776 00000100:00100000:2.0:1787338951.735647:0:19270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 54 00000100:00100000:2.0:1787338951.735660:0:19270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf7ed4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f11a8df7-6b86-4272-87dd-120efc0a0f31+35:17552:x1874160192235776:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787338951.735690:0:19270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787338951.735712:0:19270:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c359c lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadabe70 expref: -99 pid: 19270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338951.735789:0:19270:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c359c lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabe70 expref: 36 pid: 19270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338951.735806:0:19270:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c359c lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabe70 expref: 36 pid: 19270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338951.735828:0:19270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff90bbc8283d00) 00010000:00010000:2.0:1787338951.735831:0:19270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787338951.735835:0:19270:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf40e3200, rc 0) 00000100:00100000:2.0:1787338951.735958:0:19270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf7ed4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f11a8df7-6b86-4272-87dd-120efc0a0f31+36:17552:x1874160192235776:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 Request processed in 300us (5397us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338951.735966:0:19270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 54 00000100:00100000:1.0:1787338951.747176:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338951.747541:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192235904 00000100:00100000:2.0:1787338951.747552:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192235904 00000100:00100000:2.0:1787338951.747638:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 10 00000100:00100000:2.0:1787338951.747651:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf3e90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f11a8df7-6b86-4272-87dd-120efc0a0f31+5:2358:x1874160192235904:12345-192.168.201.53@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1787338951.748193:0:18558:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787338951.748770:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf3e90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f11a8df7-6b86-4272-87dd-120efc0a0f31+6:2358:x1874160192235904:12345-192.168.201.53@tcp:2:lhsmtool_posix.0 Request processed in 1116us (1598us total) trans 12884901890 rc 0/0 00000100:00100000:2.0:1787338951.751203:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 10 00000100:00100000:1.0:1787338951.754339:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338951.754458:0:18566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192236160 00000100:00100000:0.0:1787338951.754471:0:18566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192236160 00000100:00100000:0.0:1787338951.754551:0:18566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 11 00000100:00100000:0.0:1787338951.754562:0:18566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee563800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f11a8df7-6b86-4272-87dd-120efc0a0f31+36:17552:x1874160192236160:12345-192.168.201.53@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787338951.754842:0:18566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee563800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f11a8df7-6b86-4272-87dd-120efc0a0f31+37:17552:x1874160192236160:12345-192.168.201.53@tcp:35:lhsmtool_posix.0 Request processed in 281us (514us total) trans 12884901918 rc 0/0 00000100:00100000:0.0:1787338951.754850:0:18566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 11 00000100:00100000:3.0:1787338951.758001:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338951.758286:0:18562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192236416 00000100:00100000:2.0:1787338951.758298:0:18562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192236416 00000100:00100000:2.0:1787338951.758359:0:18562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 55 00000100:00100000:2.0:1787338951.758370:0:18562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf7ed5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f11a8df7-6b86-4272-87dd-120efc0a0f31+37:17552:x1874160192236416:12345-192.168.201.53@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787338951.758489:0:18562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf7ed5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f11a8df7-6b86-4272-87dd-120efc0a0f31+37:17552:x1874160192236416:12345-192.168.201.53@tcp:57:lhsmtool_posix.0 Request processed in 120us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338951.758513:0:18562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 55 00000100:00100000:1.0:1787338951.782125:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338951.782227:0:19270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192236544 00000100:00100000:2.0:1787338951.782238:0:19270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192236544 00000100:00100000:2.0:1787338951.782300:0:19270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 56 00000100:00100000:2.0:1787338951.782309:0:19270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee562a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f11a8df7-6b86-4272-87dd-120efc0a0f31+37:17552:x1874160192236544:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787338951.782330:0:19270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787338951.782352:0:19270:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c35a3 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadabe77 expref: -99 pid: 19270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338951.782442:0:19270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3a00/0x83671231080c35aa lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338951.782456:0:19270:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3a00/0x83671231080c35aa lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338951.782467:0:19270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3a00/0x83671231080c35aa lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787338951.782530:0:19270:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787338951.782548:0:19270:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3a00/0x83671231080c35aa lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338951.782581:0:19270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c35a3 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabe77 expref: 39 pid: 19270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338951.782601:0:19270:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3a00/0x83671231080c35aa lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabe77 expref: 38 pid: 19270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338951.782610:0:19270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff90bbc8283d00) 00010000:00010000:2.0:1787338951.782613:0:19270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787338951.782615:0:19270:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf40e3a00, rc 0) 00000100:00100000:2.0:1787338951.782676:0:19270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee562a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f11a8df7-6b86-4272-87dd-120efc0a0f31+38:17552:x1874160192236544:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 Request processed in 367us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338951.782683:0:19270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 56 00000100:00100000:1.0:1787338951.790134:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338951.792555:0:19248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192236672 00000100:00100000:3.0:1787338951.792574:0:19248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192236672 00000100:00100000:3.0:1787338951.792655:0:19248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 11 00000100:00100000:3.0:1787338951.792666:0:19248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee562680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f11a8df7-6b86-4272-87dd-120efc0a0f31+6:2358:x1874160192236672:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787338951.792684:0:19248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787338951.792709:0:19248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd0f5b9e/0x83671231080c35b1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadabe7e expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787338951.792740:0:19248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a88a0c7, blocks: 0x1 00010000:00010000:3.0:1787338951.792761:0:19248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=604s v=(0 0) 00010000:00010000:3.0:1787338951.792766:0:19248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787338951.792785:0:19248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd0f5b9e/0x83671231080c35b1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabe7e expref: 7 pid: 19248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338951.792806:0:19248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dd0f5b9e/0x83671231080c35b1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabe7e expref: 7 pid: 19248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338951.792842:0:19248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf7ea4000, rc 0) 00000100:00100000:3.0:1787338951.792970:0:19248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee562680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f11a8df7-6b86-4272-87dd-120efc0a0f31+7:2358:x1874160192236672:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 Request processed in 305us (2844us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338951.792978:0:19248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 11 00000100:00100000:3.0:1787338951.802937:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338951.803311:0:18562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192236928 00000100:00100000:2.0:1787338951.803323:0:18562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192236928 00000100:00100000:2.0:1787338951.803375:0:18562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 57 00000100:00100000:2.0:1787338951.803385:0:18562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf7ed7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f11a8df7-6b86-4272-87dd-120efc0a0f31+38:17552:x1874160192236928:12345-192.168.201.53@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787338951.803522:0:18562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf7ed7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f11a8df7-6b86-4272-87dd-120efc0a0f31+38:17552:x1874160192236928:12345-192.168.201.53@tcp:57:lhsmtool_posix.0 Request processed in 112us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338951.803530:0:18562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 57 00000100:00100000:1.0:1787338951.811080:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338951.811736:0:19270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192237056 00000100:00100000:2.0:1787338951.811747:0:19270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192237056 00000100:00100000:2.0:1787338951.811805:0:19270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 58 00000100:00100000:2.0:1787338951.811815:0:19270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee561180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f11a8df7-6b86-4272-87dd-120efc0a0f31+38:17552:x1874160192237056:12345-192.168.201.53@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1787338951.927621:0:19270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee561180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f11a8df7-6b86-4272-87dd-120efc0a0f31+38:17552:x1874160192237056:12345-192.168.201.53@tcp:44:lhsmtool_posix.0 Request processed in 115796us (116541us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338951.927635:0:19270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 58 00000001:00080000:1.0:1787338951.927837:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901918 is committed 00000004:00080000:1.0:1787338951.927899:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:1.0:1787338951.927919:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901894 is committed 00000001:00080000:1.0:1787338951.927949:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00000100:00100000:3.0:1787338951.928264:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787338951.928281:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbffa4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874160212123264:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787338951.928331:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787338951.929239:0:20031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212123264 00000100:00100000:0.0:1787338951.929247:0:20031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212123264 00000100:00100000:0.0:1787338951.929311:0:20031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787338951.929320:0:20031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbf7ed7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1874160212123264:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1787338951.929476:0:20031:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1787338951.929491:0:20031:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1787338951.929504:0:20031:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787338951.929507:0:20031:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb ctime from disk: 1787338951 -> 1787338951 00002000:00010000:0.0:1787338951.929509:0:20031:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1787338951.929560:0:20031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbf7ed7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3317:x1874160212123264:12345-0@lo:2:osp-syn-0-0.0 Request processed in 241us (1228us total) trans 12884901891 rc 0/0 00000100:00100000:0.0:1787338951.929568:0:20031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000004:00080000:0.0:1787338951.929615:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90bbffa4ad80/2, rc 0, transno 12884901891 00000100:00100000:0.0:1787338951.929622:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbffa4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874160212123264:0@lo:2:osp-syn-0-0.0 00000100:00080000:3.0:1787338951.929677:0:18558:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787338951.934448:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338951.934541:0:19248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192237184 00000100:00100000:3.0:1787338951.934552:0:19248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192237184 00000100:00100000:3.0:1787338951.934611:0:19248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 13 00000100:00100000:3.0:1787338951.934622:0:19248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee560380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f11a8df7-6b86-4272-87dd-120efc0a0f31+7:2359:x1874160192237184:12345-192.168.201.53@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1787338951.934732:0:19248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee560380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f11a8df7-6b86-4272-87dd-120efc0a0f31+7:2359:x1874160192237184:12345-192.168.201.53@tcp:16:lhsmtool_posix.0 Request processed in 112us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338951.934739:0:19248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 13 00000100:00100000:3.0:1787338951.938172:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338951.938336:0:18562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192237440 00000100:00100000:2.0:1787338951.938347:0:18562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192237440 00000100:00100000:2.0:1787338951.938419:0:18562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 59 00000100:00100000:2.0:1787338951.938429:0:18562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f11a8df7-6b86-4272-87dd-120efc0a0f31+13:17552:x1874160192237440:12345-192.168.201.53@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787338951.938487:0:18562:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787338951.938525:0:18562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3a00/0x83671231080c35aa lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabe77 expref: 13 pid: 19270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338951.938547:0:18562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff90bbc8283d00) 00010000:00010000:2.0:1787338951.938552:0:18562:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787338951.938582:0:18562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c35b8 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338951.938597:0:18562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c35b8 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338951.938607:0:18562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c35b8 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18562 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787338951.938865:0:18562:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005faa36c9 reply state 00000000ce0a64df transno 12884901919 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c35b8 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18562 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338951.939091:0:18562:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787338951.939208:0:18562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f11a8df7-6b86-4272-87dd-120efc0a0f31+14:17552:x1874160192237440:12345-192.168.201.53@tcp:36:lhsmtool_posix.0 Request processed in 780us (1139us total) trans 12884901919 rc 0/0 00000100:00100000:2.0:1787338951.939216:0:18562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 59 00010000:00010000:2.0:1787338951.942463:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c35b8 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338951.942483:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c35b8 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338951.942523:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c35b8 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338951.942529:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e2a00 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:2.0:1787338951.942534:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c35b8 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338951.942540:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c35b8 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338951.942557:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff90bbc8283d00) 00010000:00010000:2.0:1787338951.942560:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787338951.942566:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c35b8 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338951.942661:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c35b8 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18562 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338951.943636:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338951.943719:0:20031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192237568 00000100:00100000:0.0:1787338951.943730:0:20031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192237568 00000100:00100000:0.0:1787338951.943788:0:20031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 14 00000100:00100000:0.0:1787338951.943798:0:20031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f11a8df7-6b86-4272-87dd-120efc0a0f31+7:17552:x1874160192237568:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787338951.943815:0:20031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787338951.943832:0:20031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e37ea40/0x83671231080c35bf lrc: 2/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadabe85 expref: -99 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338951.943864:0:20031:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000dd0f5b9e/0x83671231080c35b1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabe7e expref: 8 pid: 19248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338951.943911:0:20031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787338951.943917:0:20031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787338951.943923:0:20031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e37ea40/0x83671231080c35bf lrc: 4/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabe85 expref: 8 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338951.943963:0:20031:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000dd0f5b9e/0x83671231080c35b1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabe7e expref: 8 pid: 19248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338951.943987:0:20031:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000dd0f5b9e/0x83671231080c35b1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabe7e expref: 8 pid: 19248 timeout: 704 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338951.944002:0:20031:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee44df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:20031:1874160212123392:192.168.201.53@tcp:104: 00000100:00100000:0.0:1787338951.944098:0:20031:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbfbcd8180 going to sleep for 11 seconds 00000100:00100000:0.0:1787338951.949490:0:20031:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee44df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:20031:1874160212123392:192.168.201.53@tcp:104: 00010000:00010000:0.0:1787338951.949544:0:20031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000e37ea40/0x83671231080c35bf lrc: 3/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabe85 expref: 8 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338951.949570:0:20031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bac3b92c00, rc 0) 00000100:00100000:0.0:1787338951.949657:0:20031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f11a8df7-6b86-4272-87dd-120efc0a0f31+8:17552:x1874160192237568:12345-192.168.201.53@tcp:101:lhsmtool_posix.0 Request processed in 5859us (6025us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338951.949666:0:20031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 14 00000100:00100000:2.0:1787338951.959318:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338951.961840:0:18549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192237696 00000100:00100000:3.0:1787338951.961867:0:18549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192237696 00010000:00010000:3.0:1787338951.962488:0:18549:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000dd0f5b9e/0x83671231080c35b1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabe7e expref: 8 pid: 19248 timeout: 704 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338951.962548:0:18549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 14 00000100:00100000:3.0:1787338951.962559:0:18549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4096300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f11a8df7-6b86-4272-87dd-120efc0a0f31+8:2358:x1874160192237696:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787338951.962593:0:18549:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787338951.962619:0:18549:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000dd0f5b9e/0x83671231080c35b1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabe7e expref: 8 pid: 19248 timeout: 704 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338951.962634:0:18549:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000dd0f5b9e/0x83671231080c35b1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabe7e expref: 8 pid: 19248 timeout: 704 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338951.962657:0:18549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd0f5b9e/0x83671231080c35b1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabe7e expref: 8 pid: 19248 timeout: 704 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338951.962675:0:18549:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787338951.962680:0:18549:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787338951.962688:0:18549:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000e37ea40/0x83671231080c35bf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabe85 expref: 7 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338951.962698:0:18549:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e37ea40/0x83671231080c35bf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabe85 expref: 7 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338951.962739:0:18549:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000000e37ea40/0x83671231080c35bf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabe85 expref: 7 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338951.962754:0:18549:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbffa18380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:18549:1874160212123520:192.168.201.53@tcp:105: 00000100:00100000:3.0:1787338951.963048:0:18549:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbd189b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787338951.968719:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338951.969322:0:19248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192237824 00000100:00100000:1.0:1787338951.969335:0:19248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192237824 00000100:00100000:1.0:1787338951.969403:0:19248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 15 00000100:00100000:1.0:1787338951.969416:0:19248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee44df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f11a8df7-6b86-4272-87dd-120efc0a0f31+8:2359:x1874160192237824:12345-192.168.201.53@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787338951.969645:0:19248:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1787338951.969650:0:19248:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb mtime from disk: 0 -> 1787338950 00002000:00010000:1.0:1787338951.969652:0:19248:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb atime from disk: 0 -> 1787338949 00002000:00010000:1.0:1787338951.969655:0:19248:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb ctime from disk: 1787338951 -> 1787338950 00002000:00010000:1.0:1787338951.969657:0:19248:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787338951.970009:0:19248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee44df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f11a8df7-6b86-4272-87dd-120efc0a0f31+9:2359:x1874160192237824:12345-192.168.201.53@tcp:2:lhsmtool_posix.0 Request processed in 594us (1300us total) trans 12884901892 rc 0/0 00000100:00100000:1.0:1787338951.970018:0:19248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 15 00000100:00100000:3.0:1787338951.973432:0:18549:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbffa18380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:18549:1874160212123520:192.168.201.53@tcp:105: 00010000:00010000:3.0:1787338951.973461:0:18549:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787338951.973817:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338951.974271:0:18549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4096300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f11a8df7-6b86-4272-87dd-120efc0a0f31+8:2358:x1874160192237696:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 11711us (15189us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338951.974283:0:18549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 14 00000100:00100000:3.0:1787338951.976004:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192237952 00000100:00100000:3.0:1787338951.976024:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192237952 00000100:00100000:2.0:1787338951.976379:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 16 00000100:00100000:2.0:1787338951.976392:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee561500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f11a8df7-6b86-4272-87dd-120efc0a0f31+8:2359:x1874160192237952:12345-192.168.201.53@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787338951.976444:0:19246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b0b9c1b0/0x83671231080c35c6 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338951.976468:0:19246:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000e37ea40/0x83671231080c35bf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabe85 expref: 8 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338951.976504:0:19246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787338951.976511:0:19246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787338951.976516:0:19246:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b0b9c1b0/0x83671231080c35c6 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338951.976556:0:19246:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000e37ea40/0x83671231080c35bf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabe85 expref: 8 pid: 20031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338951.976570:0:19246:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000e37ea40/0x83671231080c35bf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabe85 expref: 8 pid: 20031 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338951.976584:0:19246:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc4097b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:19246:1874160212123648:192.168.201.53@tcp:104: 00000100:00100000:2.0:1787338951.976677:0:19246:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbd1649180 going to sleep for 11 seconds 00000100:00100000:1.0:1787338951.981672:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338951.981805:0:19246:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc4097b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:19246:1874160212123648:192.168.201.53@tcp:104: 00010000:00010000:2.0:1787338951.981835:0:19246:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b0b9c1b0/0x83671231080c35c6 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338951.982086:0:18548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192238080 00000100:00100000:3.0:1787338951.982094:0:18548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192238080 00010000:00010000:3.0:1787338951.982152:0:18548:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000e37ea40/0x83671231080c35bf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabe85 expref: 9 pid: 20031 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338951.982399:0:18548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 15 00000100:00100000:3.0:1787338951.982412:0:18548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee560e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f11a8df7-6b86-4272-87dd-120efc0a0f31+9:2358:x1874160192238080:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787338951.982430:0:18548:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787338951.982459:0:18548:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000e37ea40/0x83671231080c35bf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabe85 expref: 9 pid: 20031 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338951.982475:0:18548:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000e37ea40/0x83671231080c35bf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabe85 expref: 9 pid: 20031 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338951.982514:0:18548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e37ea40/0x83671231080c35bf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabe85 expref: 9 pid: 20031 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338951.982532:0:18548:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787338951.982537:0:18548:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787338951.982545:0:18548:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b0b9c1b0/0x83671231080c35c6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338951.982555:0:18548:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b0b9c1b0/0x83671231080c35c6 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338951.982600:0:18548:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787338951.982670:0:18548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee560e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f11a8df7-6b86-4272-87dd-120efc0a0f31+8:2358:x1874160192238080:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 260us (1011us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338951.982679:0:18548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 15 00010000:00010000:2.0:1787338951.982804:0:19246:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b0b9c1b0/0x83671231080c35c6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338951.982814:0:19246:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b0b9c1b0/0x83671231080c35c6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338951.982841:0:19246:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b0b9c1b0/0x83671231080c35c6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338951.982869:0:19246:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b0b9c1b0/0x83671231080c35c6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338951.983100:0:19246:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b0b9c1b0/0x83671231080c35c6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338951.983121:0:19246:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e2a00 already unused, calling callback (ffffffffc1546230) 00010000:00010000:2.0:1787338951.983126:0:19246:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b0b9c1b0/0x83671231080c35c6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338951.983136:0:19246:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b0b9c1b0/0x83671231080c35c6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338951.983153:0:19246:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b0b9c1b0/0x83671231080c35c6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338951.983338:0:19246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b0b9c1b0/0x83671231080c35c6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338951.983403:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee561500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f11a8df7-6b86-4272-87dd-120efc0a0f31+7:2359:x1874160192237952:12345-192.168.201.53@tcp:1:lhsmtool_posix.0 Request processed in 7014us (9586us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338951.983411:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 16 00000100:00100000:2.0:1787338951.988192:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338951.988382:0:18563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192238336 00000100:00100000:0.0:1787338951.988395:0:18563:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192238336 00000100:00100000:0.0:1787338951.988462:0:18563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 60 00000100:00100000:0.0:1787338951.988474:0:18563:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4097b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f11a8df7-6b86-4272-87dd-120efc0a0f31+13:17552:x1874160192238336:12345-192.168.201.53@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787338951.988590:0:18563:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93800/0x83671231080c35cd lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338951.988611:0:18563:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93800/0x83671231080c35cd lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338951.988647:0:18563:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93800/0x83671231080c35cd lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338951.988982:0:18563:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93400/0x83671231080c35d4 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338951.988995:0:18563:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c359c lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabe70 expref: 14 pid: 19270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338951.989005:0:18563:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93400/0x83671231080c35d4 lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338951.989044:0:18563:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c359c lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabe70 expref: 14 pid: 19270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338951.989125:0:18563:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c359c lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabe70 expref: 14 pid: 19270 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787338951.989148:0:18563:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee44fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:18563:1874160212123776:192.168.201.53@tcp:104: 00000100:00100000:0.0:1787338951.989453:0:18563:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbd1b79240 going to sleep for 11 seconds 00000100:00100000:0.0:1787338951.994629:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338951.994732:0:18547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192238464 00000100:00100000:2.0:1787338951.994743:0:18547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192238464 00010000:00010000:2.0:1787338951.994818:0:18547:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c359c lrc: 5/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabe70 expref: 15 pid: 19270 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338951.994908:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 16 00000100:00100000:2.0:1787338951.994918:0:18547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfbfea450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f11a8df7-6b86-4272-87dd-120efc0a0f31+15:2359:x1874160192238464:12345-192.168.201.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787338951.994934:0:18547:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787338951.994942:0:18547:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c359c lrc: 5/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabe70 expref: 15 pid: 19270 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338951.994957:0:18547:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c359c lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabe70 expref: 15 pid: 19270 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338951.994979:0:18547:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff90bbc8283d00) 00010000:00010000:2.0:1787338951.994986:0:18547:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93400/0x83671231080c35d4 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338951.994998:0:18547:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93400/0x83671231080c35d4 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338951.995005:0:18547:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93400/0x83671231080c35d4 lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338951.995024:0:18547:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787338951.995089:0:18547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfbfea450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f11a8df7-6b86-4272-87dd-120efc0a0f31+15:2359:x1874160192238464:12345-192.168.201.53@tcp:103:ldlm_bl.0 Request processed in 172us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338951.995097:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 16 00010000:00010000:1.0:1787338951.995949:0:18563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3200/0x83671231080c359c lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabe70 expref: 14 pid: 19270 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787338951.995974:0:18563:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee44fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:18563:1874160212123776:192.168.201.53@tcp:104: 00010000:00010000:1.0:1787338951.996001:0:18563:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93400/0x83671231080c35d4 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338951.996011:0:18563:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93400/0x83671231080c35d4 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338951.996034:0:18563:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93400/0x83671231080c35d4 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787338951.996538:0:18563:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901920 00000001:00080000:1.0:1787338951.996707:0:18563:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901921 00000001:00080000:1.0:1787338951.996759:0:18563:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901922 00000100:00100000:1.0:1787338951.996989:0:18563:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbee562300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:18563:1874160212123904:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787338951.997645:0:18563:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338951.997728:0:18563:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbc2c1cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1787338951.998551:0:18567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212123904 00000100:00100000:0.0:1787338951.998560:0:18567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212123904 00000100:00100000:0.0:1787338951.998682:0:18567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787338951.998692:0:18567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee560000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:18563:x1874160212123904:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787338951.998812:0:18567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee560000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:18563:x1874160212123904:12345-0@lo:1000:mdt00_001.0 Request processed in 121us (1168us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338951.998819:0:18567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787338951.998931:0:18563:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbee562300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:18563:1874160212123904:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1787338951.999666:0:18563:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901923 00000100:00100000:2.0:1787338951.999759:0:18563:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc4096300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:18563:1874160212124032:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787338951.999803:0:18563:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787338952.001566:0:18563:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbedc57540 going to sleep for 10 seconds 00000100:00100000:1.0:1787338952.001669:0:18568:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212124032 00000100:00100000:1.0:1787338952.001677:0:18568:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212124032 00000100:00100000:1.0:1787338952.001721:0:18568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787338952.001732:0:18568:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4096d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:18563:x1874160212124032:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787338952.002650:0:18568:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4096d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:18563:x1874160212124032:12345-0@lo:1000:mdt00_001.0 Request processed in 917us (2843us total) trans 12884901893 rc 0/0 00000100:00100000:1.0:1787338952.002661:0:18568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787338952.003566:0:18563:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc4096300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:18563:1874160212124032:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1787338952.003623:0:18563:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93400/0x83671231080c35d4 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338952.003636:0:18563:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93400/0x83671231080c35d4 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338952.003644:0:18563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93400/0x83671231080c35d4 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338952.003651:0:18563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bac3b93400 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:2.0:1787338952.003656:0:18563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93400/0x83671231080c35d4 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338952.003665:0:18563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93400/0x83671231080c35d4 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338952.003685:0:18563:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff90bbc8283d00) 00010000:00010000:2.0:1787338952.003688:0:18563:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787338952.003693:0:18563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93400/0x83671231080c35d4 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338952.003699:0:18563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93400/0x83671231080c35d4 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338952.003748:0:18563:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5000/0x83671231080c352c lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338952.003754:0:18563:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5000/0x83671231080c352c lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338952.004150:0:18563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5000/0x83671231080c352c lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338952.004155:0:18563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf7ea5000 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:2.0:1787338952.004219:0:18563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5000/0x83671231080c352c lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338952.004229:0:18563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5000/0x83671231080c352c lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338952.004239:0:18563:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90bbd38d6d00) 00010000:00010000:2.0:1787338952.004242:0:18563:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787338952.004249:0:18563:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9de00/0x83671231080c3533 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabe54 expref: 17 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338952.004260:0:18563:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9de00/0x83671231080c3533 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabe54 expref: 17 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338952.004269:0:18563:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9de00/0x83671231080c3533 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabe54 expref: 17 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338952.004338:0:18563:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff90bbfbe9de00/0x83671231080c3533 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabe54 expref: 17 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338952.004354:0:18563:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc4095c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:18563:1874160212124160:192.168.201.53@tcp:105: 00000100:00100000:2.0:1787338952.004473:0:18563:0:(client.c:2715:ptlrpc_set_wait()) set ffff90bbedc57540 going to sleep for 11 seconds 00000100:00100000:0.0:1787338952.009729:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338952.009812:0:18566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192238592 00000100:00100000:1.0:1787338952.009822:0:18566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192238592 00000100:00100000:1.0:1787338952.009921:0:18566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 12 00000100:00100000:1.0:1787338952.009931:0:18566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee44fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f11a8df7-6b86-4272-87dd-120efc0a0f31+18:17551:x1874160192238592:12345-192.168.201.53@tcp:49:bash.0 00000100:00080000:3.0:1787338952.010147:0:18558:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787338952.010519:0:18566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee44fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f11a8df7-6b86-4272-87dd-120efc0a0f31+18:17551:x1874160192238592:12345-192.168.201.53@tcp:49:bash.0 Request processed in 587us (800us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338952.010527:0:18566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 12 00000100:00100000:1.0:1787338952.014585:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338952.015691:0:19248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192238720 00000100:00100000:3.0:1787338952.015703:0:19248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192238720 00000100:00100000:3.0:1787338952.015780:0:19248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 17 00000100:00100000:3.0:1787338952.015792:0:19248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee561880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f11a8df7-6b86-4272-87dd-120efc0a0f31+7:17551:x1874160192238720:12345-192.168.201.53@tcp:101:bash.0 00010000:00010000:3.0:1787338952.015811:0:19248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787338952.015835:0:19248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd0f5b9e/0x83671231080c35db lrc: 2/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadabe8c expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787338952.016071:0:19248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x42:0x0] initial LVB size: 0, mtime: 0x6a88a0c6, atime: 0x6a88a0c5, ctime: 0x6a88a0c6, blocks: 0x1 00010000:00010000:3.0:1787338952.016097:0:19248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=604s v=(0 0) 00010000:00010000:3.0:1787338952.016102:0:19248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787338952.016113:0:19248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd0f5b9e/0x83671231080c35db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabe8c expref: 8 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338952.016131:0:19248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dd0f5b9e/0x83671231080c35db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabe8c expref: 8 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787338952.016145:0:19248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bbf7ea4000, rc 0) 00000100:00100000:0.0:1787338952.016466:0:19248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee561880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f11a8df7-6b86-4272-87dd-120efc0a0f31+8:17551:x1874160192238720:12345-192.168.201.53@tcp:101:bash.0 Request processed in 672us (1890us total) trans 0 rc 0/0 00000100:00100000:0.0:1787338952.016475:0:19248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 17 00000100:00100000:0.0:1787338952.020689:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338952.020794:0:18565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192238976 00000100:00100000:1.0:1787338952.020805:0:18565:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192238976 00000100:00100000:1.0:1787338952.020923:0:18565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 13 00000100:00100000:1.0:1787338952.020934:0:18565:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbd17edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f11a8df7-6b86-4272-87dd-120efc0a0f31+18:17551:x1874160192238976:12345-192.168.201.53@tcp:35:bash.0 00000001:00080000:1.0:1787338952.021577:0:18565:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901925 00000001:00080000:1.0:1787338952.021675:0:18565:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901926 00000100:00100000:1.0:1787338952.021794:0:18565:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbd17edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f11a8df7-6b86-4272-87dd-120efc0a0f31+21:17551:x1874160192238976:12345-192.168.201.53@tcp:35:bash.0 Request processed in 859us (1111us total) trans 12884901927 rc 0/0 00000100:00100000:1.0:1787338952.021803:0:18565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 13 00000020:00080000:1.0:1787338952.021808:0:18565:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1787338952.023356:0:18563:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc4095c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:18563:1874160212124160:192.168.201.53@tcp:105: 00010000:00010000:2.0:1787338952.023403:0:18563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5000/0x83671231080c352c lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338952.023415:0:18563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf7ea5000/0x83671231080c352c lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338952.023449:0:18563:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c35e2 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338952.023473:0:18563:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c35e2 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338952.023485:0:18563:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c35e2 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338952.023503:0:18563:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c35e2 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338952.023510:0:18563:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c35e2 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338952.023517:0:18563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c35e2 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338952.023523:0:18563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e2a00 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:2.0:1787338952.023528:0:18563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c35e2 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338952.023537:0:18563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c35e2 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338952.023549:0:18563:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90bbd38d6d00) 00010000:00010000:2.0:1787338952.023558:0:18563:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787338952.023562:0:18563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c35e2 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338952.023568:0:18563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c35e2 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338952.023581:0:18563:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93800/0x83671231080c35cd lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338952.023587:0:18563:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93800/0x83671231080c35cd lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338952.023594:0:18563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93800/0x83671231080c35cd lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338952.023599:0:18563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bac3b93800 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:2.0:1787338952.023602:0:18563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93800/0x83671231080c35cd lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338952.023608:0:18563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93800/0x83671231080c35cd lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338952.023617:0:18563:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90bbd38d6d00) 00010000:00010000:2.0:1787338952.023619:0:18563:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787338952.023622:0:18563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93800/0x83671231080c35cd lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338952.023628:0:18563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93800/0x83671231080c35cd lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18563 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787338952.024132:0:18563:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4097b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f11a8df7-6b86-4272-87dd-120efc0a0f31+20:17552:x1874160192238336:12345-192.168.201.53@tcp:57:lhsmtool_posix.0 Request processed in 35658us (35949us total) trans 12884901924 rc 0/0 00000100:00100000:2.0:1787338952.024151:0:18563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 60 00000020:00080000:2.0:1787338952.024225:0:18563:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1787338952.024488:0:18597:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1787338952.024503:0:18597:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787338952.024529:0:18597:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:0.0:1787338952.024536:0:18597:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:0.0:1787338952.033209:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338952.033774:0:18565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192239232 00000100:00100000:1.0:1787338952.033786:0:18565:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192239232 00000100:00100000:1.0:1787338952.033861:0:18565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 14 00000100:00100000:1.0:1787338952.033920:0:18565:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbd17ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f11a8df7-6b86-4272-87dd-120efc0a0f31+20:17552:x1874160192239232:12345-192.168.201.53@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1787338952.039753:0:18565:0:(mdd_object.c:4014:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787338952.041398:0:18565:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901928 00010000:00010000:0.0:1787338952.041684:0:18565:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93c00/0x83671231080c35e9 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338952.041707:0:18565:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93c00/0x83671231080c35e9 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338952.041720:0:18565:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93c00/0x83671231080c35e9 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338952.041730:0:18565:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93c00/0x83671231080c35e9 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338952.041737:0:18565:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93c00/0x83671231080c35e9 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338952.041743:0:18565:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93c00/0x83671231080c35e9 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338952.042079:0:18565:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787338952.042234:0:18565:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbd17ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f11a8df7-6b86-4272-87dd-120efc0a0f31+22:17552:x1874160192239232:12345-192.168.201.53@tcp:35:lhsmtool_posix.0 Request processed in 8357us (9032us total) trans 12884901929 rc 0/0 00000100:00100000:0.0:1787338952.042245:0:18565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 14 00000020:00080000:0.0:1787338952.042252:0:18565:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787338952.061614:0:18551:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787338952.061630:0:18551:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93c00/0x83671231080c35e9 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338952.061642:0:18551:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bac3b93c00 already unused, calling callback (ffffffffc1546230) 00010000:00010000:1.0:1787338952.061652:0:18551:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93c00/0x83671231080c35e9 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338952.061665:0:18551:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93c00/0x83671231080c35e9 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338952.061686:0:18551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff90bbc8283d00) 00010000:00010000:1.0:1787338952.061689:0:18551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787338952.061695:0:18551:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93c00/0x83671231080c35e9 lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338952.061701:0:18551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93c00/0x83671231080c35e9 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787338952.061764:0:18551:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338952.061766:0:18551:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338952.061778:0:18551:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787338952.207706:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338952.207812:0:18564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192239488 00000100:00100000:0.0:1787338952.207826:0:18564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192239488 00000100:00100000:0.0:1787338952.207942:0:18564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 61 00000100:00100000:0.0:1787338952.207954:0:18564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee561f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f11a8df7-6b86-4272-87dd-120efc0a0f31+22:17562:x1874160192239488:12345-192.168.201.53@tcp:101:lfs.0 00010000:00010000:0.0:1787338952.207982:0:18564:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787338952.208005:0:18564:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93000/0x83671231080c35f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x81bcb3edadabe93 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787338952.208353:0:18564:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 7680 00010000:00010000:0.0:1787338952.208582:0:18564:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93000/0x83671231080c35f0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabe93 expref: 24 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338952.208600:0:18564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90bbeb14d900) 00010000:00010000:0.0:1787338952.208604:0:18564:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787338952.208610:0:18564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bac3b93000/0x83671231080c35f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.53@tcp remote: 0x81bcb3edadabe93 expref: 24 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787338952.208638:0:18564:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90bac3b93000, rc 0) 00000100:00100000:0.0:1787338952.208713:0:18564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee561f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f11a8df7-6b86-4272-87dd-120efc0a0f31+23:17562:x1874160192239488:12345-192.168.201.53@tcp:101:lfs.0 Request processed in 760us (1016us total) trans 12884901930 rc 301/301 00000100:00100000:0.0:1787338952.208721:0:18564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 61 00000100:00100000:3.0:1787338952.218202:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338952.218417:0:19270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192239616 00000100:00100000:2.0:1787338952.218428:0:19270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192239616 00000100:00100000:2.0:1787338952.218513:0:19270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 62 00000100:00100000:2.0:1787338952.218524:0:19270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbffa18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f11a8df7-6b86-4272-87dd-120efc0a0f31+23:17562:x1874160192239616:12345-192.168.201.53@tcp:34:lfs.0 00010000:00010000:2.0:1787338952.218606:0:19270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c35fe lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338952.218624:0:19270:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c35fe lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338952.218639:0:19270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c35fe lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338952.218655:0:19270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3a00/0x83671231080c3605 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338952.218663:0:19270:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3a00/0x83671231080c3605 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338952.218670:0:19270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3a00/0x83671231080c3605 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338952.219007:0:19270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3400/0x83671231080c360c lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338952.219018:0:19270:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3400/0x83671231080c360c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338952.219026:0:19270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3400/0x83671231080c360c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787338952.219082:0:19270:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3400/0x83671231080c360c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338952.219095:0:19270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c35fe lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338952.219101:0:19270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c35fe lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338952.219108:0:19270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c35fe lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338952.219113:0:19270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e2a00 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:2.0:1787338952.219118:0:19270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c35fe lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338952.219125:0:19270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c35fe lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338952.219138:0:19270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff90bbeb14de00) 00010000:00010000:2.0:1787338952.219141:0:19270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787338952.219146:0:19270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c35fe lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338952.219151:0:19270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e2a00/0x83671231080c35fe lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338952.219177:0:19270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3a00/0x83671231080c3605 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338952.219672:0:19270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3a00/0x83671231080c3605 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338952.219685:0:19270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3a00/0x83671231080c3605 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338952.219691:0:19270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e3a00 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:2.0:1787338952.219694:0:19270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3a00/0x83671231080c3605 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338952.219701:0:19270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3a00/0x83671231080c3605 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338952.219711:0:19270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff90bbc8283c00) 00010000:00010000:2.0:1787338952.219713:0:19270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787338952.219716:0:19270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3a00/0x83671231080c3605 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338952.219722:0:19270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3a00/0x83671231080c3605 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338952.219739:0:19270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3400/0x83671231080c360c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338952.219745:0:19270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3400/0x83671231080c360c lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338952.219751:0:19270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3400/0x83671231080c360c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338952.219757:0:19270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90bbf40e3400 already unused, calling callback (ffffffffc1f504f0) 00010000:00010000:2.0:1787338952.219759:0:19270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3400/0x83671231080c360c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338952.219774:0:19270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3400/0x83671231080c360c lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338952.219783:0:19270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90bbd38d6d00) 00010000:00010000:2.0:1787338952.219785:0:19270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787338952.219788:0:19270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3400/0x83671231080c360c lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787338952.219794:0:19270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90bbf40e3400/0x83671231080c360c lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19270 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787338952.220992:0:19270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbffa18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f11a8df7-6b86-4272-87dd-120efc0a0f31+23:17562:x1874160192239616:12345-192.168.201.53@tcp:34:lfs.0 Request processed in 2456us (2787us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338952.221014:0:19270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 62 00000100:00100000:1.0:1787338952.226564:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:0.0:1787338952.226777:0:18566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192239872 00000100:00100000:0.0:1787338952.226788:0:18566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192239872 00000100:00100000:0.0:1787338952.226859:0:18566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 15 00000100:00100000:0.0:1787338952.226979:0:18566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee560a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f11a8df7-6b86-4272-87dd-120efc0a0f31+23:17562:x1874160192239872:12345-192.168.201.53@tcp:35:lfs.0 00000100:00100000:0.0:1787338952.227814:0:18566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee560a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f11a8df7-6b86-4272-87dd-120efc0a0f31+24:17562:x1874160192239872:12345-192.168.201.53@tcp:35:lfs.0 Request processed in 834us (1253us total) trans 12884901931 rc 0/0 00000100:00100000:0.0:1787338952.227826:0:18566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 15 00010000:00010000:3.0:1787338952.311168:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787338952.421464:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901891 is committed 00000001:00080000:3.0:1787338952.421480:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901893 is committed 00000001:00080000:3.0:1787338952.421499:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901892 is committed 00010000:00010000:1.0:1787338953.334336:0:18551:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787338954.370316:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787338954.385706:0:20734:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: /mnt/lustre/d1d.sanity-pcc/f1d.sanity-pcc expected pcc state: readwrite, but got: none 00000100:00100000:2.0:1787338954.873609:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787338954.873637:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbc4095c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874160212124288:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787338954.873722:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787338954.874000:0:19250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212124288 00000100:00100000:3.0:1787338954.874019:0:19250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212124288 00000100:00100000:3.0:1787338954.874079:0:19250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787338954.874091:0:19250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc4094380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874160212124288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787338954.874131:0:19250:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787338954.874181:0:19250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc4094380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874160212124288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338954.874188:0:19250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1787338954.874208:0:18558:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787338954.874314:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787338954.874325:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbffa19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874160212124416:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787338954.874356:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338954.874584:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbd17eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1874160212124800:0@lo:400:kworker.0 00000100:00100000:1.0:1787338954.874613:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338954.874639:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787338954.874645:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbd17ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874160212124672:0@lo:400:kworker.0 00000100:00100000:1.0:1787338954.874665:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338954.874693:0:18562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212124800 00000100:00100000:1.0:1787338954.874698:0:18562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212124800 00000100:00100000:1.0:1787338954.874734:0:18562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212124672 00000100:00100000:1.0:1787338954.874738:0:18562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212124672 00000100:00100000:1.0:1787338954.874771:0:18562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787338954.874779:0:18562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee563480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874160212124800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787338954.874820:0:18562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee563480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874160212124800:12345-0@lo:400:kworker.0 Request processed in 41us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338954.874826:0:18562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787338954.874840:0:18562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787338954.874846:0:18562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee563b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874160212124672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787338954.874911:0:18562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee563b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874160212124672:12345-0@lo:400:kworker.0 Request processed in 65us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338954.874917:0:18562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:1.0:1787338954.874940:0:18558:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787338954.874956:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbd17eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4530016f-1c37-4f4c-b7ee-21f57031a048:3315:1874160212124544:0@lo:400:kworker.0 00000100:00100000:1.0:1787338954.874986:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338954.875027:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787338954.875033:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90bbd17ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1874160212124928:0@lo:400:kworker.0 00000100:00100000:1.0:1787338954.875074:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787338954.875100:0:18556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212124544 00000100:00100000:1.0:1787338954.875104:0:18556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212124544 00000100:00100000:1.0:1787338954.875130:0:18556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1787338954.875136:0:18556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc168050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4530016f-1c37-4f4c-b7ee-21f57031a048+19:3315:x1874160212124544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787338954.875182:0:18556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc168050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4530016f-1c37-4f4c-b7ee-21f57031a048+19:3315:x1874160212124544:12345-0@lo:400:kworker.0 Request processed in 46us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338954.875189:0:18556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1787338954.875237:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbd17ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874160212124672:0@lo:400:kworker.0 00000100:00100000:1.0:1787338954.875246:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbd17eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1874160212124800:0@lo:400:kworker.0 00000100:00100000:1.0:1787338954.875273:0:18562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212124928 00000100:00100000:1.0:1787338954.875276:0:18562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212124928 00000100:00100000:1.0:1787338954.875300:0:18562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787338954.875306:0:18562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee560700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874160212124928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787338954.875334:0:18562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee560700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874160212124928:12345-0@lo:400:kworker.0 Request processed in 27us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1787338954.875339:0:18562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1787338954.875362:0:18558:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787338954.875378:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbd17ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1874160212124928:0@lo:400:kworker.0 00000100:00100000:1.0:1787338954.875387:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbd17eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4530016f-1c37-4f4c-b7ee-21f57031a048:3315:1874160212124544:0@lo:400:kworker.0 00000100:00100000:3.0:1787338954.875911:0:19250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160212124416 00000100:00100000:3.0:1787338954.875916:0:19250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160212124416 00000100:00100000:3.0:1787338954.875957:0:19250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787338954.875964:0:19250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee561c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874160212124416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787338954.875991:0:19250:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787338954.876039:0:19250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee561c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874160212124416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (1682us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338954.876045:0:19250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787338954.876434:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbc4095c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874160212124288:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1787338954.876954:0:18558:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787338954.876979:0:3315:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901893 gen 2 00000004:00080000:1.0:1787338954.876986:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90bbffa4ad80, transno 12884901891 00000004:00080000:1.0:1787338954.877005:0:3315:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884901893 committed transno 12884901893 00000100:00100000:1.0:1787338954.877038:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90bbffa19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874160212124416:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787338955.078740:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338955.080085:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338955.080116:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338955.080148:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338955.080168:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338955.080180:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338955.080195:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:1.0:1787338955.080204:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:3.0:1787338955.080332:0:19270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192240512 00000100:00100000:3.0:1787338955.080340:0:19270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192240512 00000100:00100000:3.0:1787338955.080397:0:19270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192240128 00000100:00100000:3.0:1787338955.080399:0:19270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192240128 00000100:00100000:3.0:1787338955.080414:0:19270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 30 00000100:00100000:3.0:1787338955.080421:0:19270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee563100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eed3ef97-e99d-4750-973c-88dcada624d6+6:2357:x1874160192240512:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:3.0:1787338955.080527:0:19270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee563100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eed3ef97-e99d-4750-973c-88dcada624d6+6:2357:x1874160192240512:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 104us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338955.080541:0:19270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 30 00000100:00100000:3.0:1787338955.080560:0:19270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 31 00000100:00100000:3.0:1787338955.080566:0:19270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc7c6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f11a8df7-6b86-4272-87dd-120efc0a0f31+24:2357:x1874160192240128:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:2.0:1787338955.080572:0:18557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192240000 00000100:00100000:2.0:1787338955.080577:0:18557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192240000 00000100:00100000:3.0:1787338955.080597:0:19270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc7c6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f11a8df7-6b86-4272-87dd-120efc0a0f31+24:2357:x1874160192240128:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 31us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338955.080603:0:19270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 31 00000100:00100000:2.0:1787338955.080605:0:18557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 123 00000100:00100000:2.0:1787338955.080611:0:18557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbfc16a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6691873-d8b0-4399-ba40-203a8aa11ea0+13:2357:x1874160192240000:12345-192.168.201.53@tcp:400:kworker.0 00000100:00080000:3.0:1787338955.080631:0:18558:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787338955.080635:0:18557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbfc16a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6691873-d8b0-4399-ba40-203a8aa11ea0+13:2357:x1874160192240000:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 24us (1907us total) trans 0 rc 0/0 00000100:00100000:2.0:1787338955.080641:0:18557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 123 00000100:00100000:3.0:1787338955.080654:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192240256 00000100:00100000:3.0:1787338955.080658:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192240256 00000100:00100000:3.0:1787338955.080680:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192240768 00000100:00100000:3.0:1787338955.080683:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192240768 00000100:00100000:3.0:1787338955.080698:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192241024 00000100:00100000:3.0:1787338955.080701:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192241024 00000100:00100000:3.0:1787338955.080712:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192240384 00000100:00100000:3.0:1787338955.080714:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192240384 00000100:00100000:3.0:1787338955.080724:0:19246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192240640 00000100:00100000:3.0:1787338955.080726:0:19246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192240640 00000100:00100000:3.0:1787338955.080739:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 16 00000100:00100000:3.0:1787338955.080744:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee562d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f11a8df7-6b86-4272-87dd-120efc0a0f31+7:2357:x1874160192240256:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:3.0:1787338955.080998:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee562d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f11a8df7-6b86-4272-87dd-120efc0a0f31+7:2357:x1874160192240256:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 252us (916us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338955.081066:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 16 00000100:00100000:3.0:1787338955.081082:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 17 00000100:00100000:3.0:1787338955.081089:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee562300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eed3ef97-e99d-4750-973c-88dcada624d6+5:2357:x1874160192240768:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:3.0:1787338955.081295:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee562300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eed3ef97-e99d-4750-973c-88dcada624d6+5:2357:x1874160192240768:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 37us (977us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338955.081305:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 17 00000100:00100000:3.0:1787338955.081320:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 18 00000100:00100000:3.0:1787338955.081327:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc7c6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f11a8df7-6b86-4272-87dd-120efc0a0f31+5:2357:x1874160192240384:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:3.0:1787338955.081409:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc7c6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f11a8df7-6b86-4272-87dd-120efc0a0f31+5:2357:x1874160192240384:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 26us (1154us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338955.081417:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 18 00000100:00100000:3.0:1787338955.081430:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 19 00000100:00100000:3.0:1787338955.081436:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc7c6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eed3ef97-e99d-4750-973c-88dcada624d6+5:2357:x1874160192240640:12345-192.168.201.53@tcp:400:kworker.0 00000100:00100000:3.0:1787338955.081471:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc7c6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eed3ef97-e99d-4750-973c-88dcada624d6+5:2357:x1874160192240640:12345-192.168.201.53@tcp:400:kworker.0 Request processed in 36us (1265us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338955.081478:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 19 00000100:00100000:3.0:1787338955.081489:0:19246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 18 00000100:00100000:3.0:1787338955.081495:0:19246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbee560e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f11a8df7-6b86-4272-87dd-120efc0a0f31+6:2357:x1874160192241024:12345-192.168.201.53@tcp:16:kworker.0 00000100:00100000:3.0:1787338955.081567:0:19246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbee560e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f11a8df7-6b86-4272-87dd-120efc0a0f31+6:2357:x1874160192241024:12345-192.168.201.53@tcp:16:kworker.0 Request processed in 71us (1397us total) trans 0 rc 0/0 00000100:00100000:3.0:1787338955.081574:0:19246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 18 00000100:00080000:3.0:1787338955.081591:0:18558:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787338955.081594:0:18558:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787338955.081861:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.53@tcp (source: 12345-192.168.201.53@tcp) 00000100:00100000:2.0:1787338955.082630:0:19251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874160192240896 00000100:00100000:2.0:1787338955.082638:0:19251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874160192240896 00002000:00100000:2.0:1787338955.082672:0:19251:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x42:0x0] (0->8) req@ffff90bbc7c6e680 x1874160192240896/t0(0) o4->f11a8df7-6b86-4272-87dd-120efc0a0f31@192.168.201.53@tcp:286/0 lens 504/0 e 0 to 0 dl 1787338966 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:2.0:1787338955.082683:0:19251:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90bbc7c6e680 with x1874160192240896 ext(0->8) 00002000:00010000:2.0:1787338955.082701:0:19251:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90bbc7c6e680 00000100:00100000:2.0:1787338955.082959:0:19251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.53@tcp, seq: 0 00000100:00100000:2.0:1787338955.082970:0:19251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90bbc7c6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f11a8df7-6b86-4272-87dd-120efc0a0f31+6:2357:x1874160192240896:12345-192.168.201.53@tcp:4:bash.0 00000100:00100000:2.0:1787338955.084205:0:19251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90bbc7c6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f11a8df7-6b86-4272-87dd-120efc0a0f31+8:2357:x1874160192240896:12345-192.168.201.53@tcp:4:bash.0 Request processed in 1234us (2340us total) trans 12884901894 rc 0/0 00000100:00100000:2.0:1787338955.084216:0:19251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.53@tcp, seq: 0 00002000:00100000:2.0:1787338955.084226:0:19251:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x42:0x0] (0->8) req@ffff90bbc7c6e680 x1874160192240896/t12884901894(0) o4->f11a8df7-6b86-4272-87dd-120efc0a0f31@192.168.201.53@tcp:286/0 lens 504/448 e 0 to 0 dl 1787338966 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:2.0:1787338955.085589:0:19251:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90bbc7c6e680 with x1874160192240896 ext(0->8) 00002000:00010000:2.0:1787338955.085597:0:19251:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90bbc7c6e680 00010000:00010000:1.0:1787338955.382362:0:18551:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787338956.150297:0:18597:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1787338956.150307:0:18597:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787338956.150356:0:18597:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:2.0:1787338956.150365:0:18597:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:0.0:1787338956.412295:0:18550:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 41682 lines, 41682 kept, 0 dropped, 0 bad.